Building

Started building at 2022/01/03 08:55:42
Calculating base
Updating mirror
Basing run on 7.1.0-1985 f1b32e609
Updating tree for run 03.01.2022-08.55
gocb is at 635fa6c, changes since last good build: none
libcouchbase is at f6822fc, changes since last good build: none
indexing is at 8d3522b, changes since last good build: none
kv_engine is at cda4d73, changes since last good build: none
ns_server is at fadbef1, changes since last good build: none
couchstore is at 0bf3a4b, changes since last good build: none
couchdb is at fca2e6b, changes since last good build: none
testrunner is at a23e488, changes since last good build: none
Switching eventing to unstable
eventing is at ee5930d, changes since last good build: none
Switching eventing-ee to unstable
eventing-ee is at 80089ff, changes since last good build: none
Pulling in uncommitted change 160397 at refs/changes/97/160397/3
Total 23 (delta 15), reused 17 (delta 15)
[unstable 1d9b8bdd] MB-100 : Do not fail n1ql timeout test if we are catching timeout exceptions successfully
 Author: abhijpes 
 Date: Mon Aug 30 08:24:38 2021 +0530
 1 file changed, 2 insertions(+), 2 deletions(-)
Pulling in uncommitted change 163449 at refs/changes/49/163449/1
Total 48 (delta 27), reused 39 (delta 27)
[unstable 68bc5220] MB-100: collect data when test fails
 Author: AnkitPrabhu 
 Date: Tue Oct 12 14:02:31 2021 +0530
 1 file changed, 2 insertions(+)
Pulling in uncommitted change 166698 at refs/changes/98/166698/3
Total 4 (delta 3), reused 4 (delta 3)
[unstable 8196c09c] MB-48334 : Fail rebalance unless all functions deployed on current encryption level
 Author: abhijpes 
 Date: Wed Dec 1 14:51:29 2021 +0530
 1 file changed, 9 insertions(+)
Building cmakefiles and deps
Building main product

Testing

Started testing at 2022/01/03 09:11:26
Testing mode: rebalance,n1ql,functional
Starting server
Starting server: attempt 1

Functional tests

2022/01/03 09:13:19 Started functional
2022/01/03 09:13:36 Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2022/01/03 09:13:42 Error in adding nodes : , response: {"otpNode":"n_1@127.0.0.1"}
2022/01/03 09:13:42 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 09:13:47 Removing node(s): [] from the cluster
2022/01/03 09:13:52 Rebalance progress: 0
2022/01/03 09:13:57 Rebalance progress: 0.4521122685185185
2022/01/03 09:14:02 Rebalance progress: 5.190248842592593
2022/01/03 09:14:07 Rebalance progress: 9.25925925925926
2022/01/03 09:14:12 Rebalance progress: 13.34635416666667
2022/01/03 09:14:17 Rebalance progress: 18.13874421296296
2022/01/03 09:14:22 Rebalance progress: 21.41203703703703
2022/01/03 09:14:27 Rebalance progress: 26.07783564814815
2022/01/03 09:14:32 Rebalance progress: 100
=== RUN   TestAdvancedGetOps
2022/01/03 09:14:38 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/03 09:14:53 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/03 09:15:08 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/03 09:15:23 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/03 09:15:38 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/03 09:15:53 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/03 09:16:08 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/03 09:16:23 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/03 09:16:38 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/03 09:16:53 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/03 09:17:08 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/03 09:17:23 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/03 09:17:38 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/03 09:17:53 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/03 09:18:08 Deploying app: TestAdvancedGetOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:18:09 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedGetOps stored in temp store"
}
2022/01/03 09:18:14 Waiting for app: TestAdvancedGetOps to get deployed
2022/01/03 09:18:19 Waiting for app: TestAdvancedGetOps to get deployed
2022/01/03 09:18:24 Waiting for app: TestAdvancedGetOps to get deployed
2022/01/03 09:18:29 Waiting for app: TestAdvancedGetOps to get deployed
2022/01/03 09:18:29 App: TestAdvancedGetOps got deployed
2022/01/03 09:18:29 Starting bucket ops to source bucket
2022/01/03 09:18:34 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 09:18:39 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/03 09:18:44 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/03 09:18:44 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 09:18:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:18:44 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:18:49 Waiting for app: TestAdvancedGetOps to get un-deployed
2022/01/03 09:18:54 Waiting for app: TestAdvancedGetOps to get un-deployed
2022/01/03 09:18:59 Waiting for app: TestAdvancedGetOps to get un-deployed
2022/01/03 09:19:04 Waiting for app: TestAdvancedGetOps to get un-deployed
2022/01/03 09:19:04 App: TestAdvancedGetOps got un-deployed
2022/01/03 09:19:04 No eventing-con process running
2022/01/03 09:19:04 Function: TestAdvancedGetOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedGetOps deleting in background"
}
2022/01/03 09:19:06 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:19:16 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:19:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:19:18 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:19:28 Waiting for dst bucket item count to get to: 0 curr count: 60
2022/01/03 09:19:33 Waiting for dst bucket item count to get to: 0 curr count: 10
2022/01/03 09:19:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedGetOps (295.25s)
=== RUN   TestAdvancedInsertOps
2022/01/03 09:19:33 Deploying app: TestAdvancedInsertOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:19:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps stored in temp store"
}
2022/01/03 09:19:39 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/03 09:19:44 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/03 09:19:49 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/03 09:19:54 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/03 09:19:54 App: TestAdvancedInsertOps got deployed
2022/01/03 09:19:54 Starting bucket ops to source bucket
2022/01/03 09:20:00 Waiting for dst bucket item count to get to: 1024 curr count: 0
2022/01/03 09:20:05 Waiting for dst bucket item count to get to: 1024 curr count: 512
2022/01/03 09:20:05 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2022/01/03 09:20:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:20:05 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:20:10 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/03 09:20:15 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/03 09:20:20 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/03 09:20:25 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/03 09:20:25 App: TestAdvancedInsertOps got un-deployed
2022/01/03 09:20:25 No eventing-con process running
2022/01/03 09:20:25 Function: TestAdvancedInsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps deleting in background"
}
2022/01/03 09:20:27 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:20:37 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/03 09:20:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:20:39 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:20:49 Waiting for dst bucket item count to get to: 0 curr count: 930
2022/01/03 09:20:54 Waiting for dst bucket item count to get to: 0 curr count: 418
2022/01/03 09:20:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:20:54 Testing insert operation on source bucket
2022/01/03 09:20:54 Deploying app: TestAdvancedInsertOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:20:55 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps stored in temp store"
}
2022/01/03 09:21:00 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/03 09:21:05 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/03 09:21:10 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/03 09:21:15 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/03 09:21:15 App: TestAdvancedInsertOps got deployed
2022/01/03 09:21:15 Starting bucket ops to source bucket
2022/01/03 09:21:21 Waiting for dst bucket item count to get to: 2048 curr count: 0
2022/01/03 09:21:26 Waiting for dst bucket item count to get to: 2048 curr count: 1024
2022/01/03 09:21:26 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2022/01/03 09:21:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:21:26 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:21:31 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/03 09:21:36 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/03 09:21:41 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/03 09:21:46 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/03 09:21:46 App: TestAdvancedInsertOps got un-deployed
2022/01/03 09:21:46 No eventing-con process running
2022/01/03 09:21:46 Function: TestAdvancedInsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps deleting in background"
}
2022/01/03 09:21:48 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:21:58 Waiting for dst bucket item count to get to: 0 curr count: 1098
2022/01/03 09:22:03 Waiting for dst bucket item count to get to: 0 curr count: 74
2022/01/03 09:22:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:22:04 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:22:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedInsertOps (156.63s)
=== RUN   TestAdvancedUpsertOps
2022/01/03 09:22:09 Starting bucket ops to source bucket
2022/01/03 09:22:10 Deploying app: TestAdvancedUpsertOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:22:11 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps stored in temp store"
}
2022/01/03 09:22:16 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/03 09:22:21 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/03 09:22:26 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/03 09:22:31 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/03 09:22:31 App: TestAdvancedUpsertOps got deployed
2022/01/03 09:22:31 Starting bucket ops to source bucket
2022/01/03 09:22:37 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/03 09:22:42 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/03 09:22:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:22:42 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:22:42 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:22:47 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/03 09:22:52 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/03 09:22:57 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/03 09:23:02 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/03 09:23:02 App: TestAdvancedUpsertOps got un-deployed
2022/01/03 09:23:02 No eventing-con process running
2022/01/03 09:23:02 Function: TestAdvancedUpsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps deleting in background"
}
2022/01/03 09:23:04 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:23:14 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/03 09:23:19 Waiting for dst bucket item count to get to: 0 curr count: 512
2022/01/03 09:23:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:23:21 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:23:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:23:26 Testing upsert operation on source bucket
2022/01/03 09:23:26 Deploying app: TestAdvancedUpsertOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:23:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps stored in temp store"
}
2022/01/03 09:23:32 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/03 09:23:37 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/03 09:23:42 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/03 09:23:47 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/03 09:23:47 App: TestAdvancedUpsertOps got deployed
2022/01/03 09:23:47 Starting bucket ops to source bucket
2022/01/03 09:23:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:23:48 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:23:48 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:23:53 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/03 09:23:58 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/03 09:24:03 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/03 09:24:08 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/03 09:24:08 App: TestAdvancedUpsertOps got un-deployed
2022/01/03 09:24:08 No eventing-con process running
2022/01/03 09:24:08 Function: TestAdvancedUpsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps deleting in background"
}
2022/01/03 09:24:10 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:24:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:24:17 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:24:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedUpsertOps (132.88s)
=== RUN   TestAdvancedReplaceOps
2022/01/03 09:24:22 Starting bucket ops to source bucket
2022/01/03 09:24:23 Deploying app: TestAdvancedReplaceOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:24:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps stored in temp store"
}
2022/01/03 09:24:29 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/03 09:24:34 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/03 09:24:39 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/03 09:24:44 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/03 09:24:44 App: TestAdvancedReplaceOps got deployed
2022/01/03 09:24:44 Starting bucket ops to source bucket
2022/01/03 09:24:51 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/03 09:24:56 Waiting for dst bucket item count to get to: 0 curr count: 512
2022/01/03 09:24:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:24:56 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:24:56 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:25:01 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/03 09:25:06 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/03 09:25:11 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/03 09:25:16 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/03 09:25:16 App: TestAdvancedReplaceOps got un-deployed
2022/01/03 09:25:16 No eventing-con process running
2022/01/03 09:25:16 Function: TestAdvancedReplaceOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps deleting in background"
}
2022/01/03 09:25:17 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:25:27 Waiting for dst bucket item count to get to: 0 curr count: 512
2022/01/03 09:25:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:25:29 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:25:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:25:34 Testing upsert operation on source bucket
2022/01/03 09:25:34 Deploying app: TestAdvancedReplaceOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:25:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps stored in temp store"
}
2022/01/03 09:25:40 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/03 09:25:45 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/03 09:25:50 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/03 09:25:55 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/03 09:25:55 App: TestAdvancedReplaceOps got deployed
2022/01/03 09:25:55 Starting bucket ops to source bucket
2022/01/03 09:25:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:25:57 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:25:57 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:26:02 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/03 09:26:07 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/03 09:26:12 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/03 09:26:17 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/03 09:26:17 App: TestAdvancedReplaceOps got un-deployed
2022/01/03 09:26:17 No eventing-con process running
2022/01/03 09:26:17 Function: TestAdvancedReplaceOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps deleting in background"
}
2022/01/03 09:26:19 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:26:29 Waiting for dst bucket item count to get to: 0 curr count: 116
2022/01/03 09:26:34 Waiting for dst bucket item count to get to: 0 curr count: 35
2022/01/03 09:26:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:26:35 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:26:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedReplaceOps (137.96s)
=== RUN   TestAdvancedDeleteOps
2022/01/03 09:26:40 Starting bucket ops to source bucket
2022/01/03 09:26:40 Deploying app: TestAdvancedDeleteOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:26:42 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps stored in temp store"
}
2022/01/03 09:26:47 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/03 09:26:52 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/03 09:26:57 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/03 09:27:02 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/03 09:27:02 App: TestAdvancedDeleteOps got deployed
2022/01/03 09:27:02 Starting bucket ops to source bucket
2022/01/03 09:27:07 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:27:12 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:27:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:27:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:27:12 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:27:17 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/03 09:27:22 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/03 09:27:27 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/03 09:27:32 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/03 09:27:32 App: TestAdvancedDeleteOps got un-deployed
2022/01/03 09:27:32 No eventing-con process running
2022/01/03 09:27:32 Function: TestAdvancedDeleteOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps deleting in background"
}
2022/01/03 09:27:34 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:27:44 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:27:49 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 09:27:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:27:50 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:27:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:27:55 Testing delete operation on source bucket
2022/01/03 09:27:55 Deploying app: TestAdvancedDeleteOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:27:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps stored in temp store"
}
2022/01/03 09:28:02 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/03 09:28:07 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/03 09:28:12 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/03 09:28:17 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/03 09:28:17 App: TestAdvancedDeleteOps got deployed
2022/01/03 09:28:17 Starting bucket ops to source bucket
2022/01/03 09:28:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:28:17 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:28:17 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:28:22 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/03 09:28:27 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/03 09:28:32 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/03 09:28:37 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/03 09:28:37 App: TestAdvancedDeleteOps got un-deployed
2022/01/03 09:28:37 No eventing-con process running
2022/01/03 09:28:37 Function: TestAdvancedDeleteOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps deleting in background"
}
2022/01/03 09:28:39 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:28:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:28:46 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:28:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedDeleteOps (130.63s)
=== RUN   TestEnoentAdvancedGet
2022/01/03 09:28:51 Deploying app: TestEnoentAdvancedGet. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:28:52 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet stored in temp store"
}
2022/01/03 09:28:57 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/03 09:29:02 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/03 09:29:07 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/03 09:29:12 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/03 09:29:12 App: TestEnoentAdvancedGet got deployed
2022/01/03 09:29:12 Starting bucket ops to source bucket
2022/01/03 09:29:17 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 09:29:22 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 09:29:22 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 09:29:22 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:29:22 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:29:27 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/03 09:29:32 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/03 09:29:37 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/03 09:29:42 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/03 09:29:42 App: TestEnoentAdvancedGet got un-deployed
2022/01/03 09:29:42 No eventing-con process running
2022/01/03 09:29:42 Function: TestEnoentAdvancedGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet deleting in background"
}
2022/01/03 09:29:44 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:29:54 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:29:59 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 09:29:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:30:01 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:30:11 Waiting for dst bucket item count to get to: 0 curr count: 97
2022/01/03 09:30:16 Waiting for dst bucket item count to get to: 0 curr count: 97
2022/01/03 09:30:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:30:16 Testing get enoent operation on source bucket
2022/01/03 09:30:16 Deploying app: TestEnoentAdvancedGet. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:30:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet stored in temp store"
}
2022/01/03 09:30:22 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/03 09:30:27 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/03 09:30:32 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/03 09:30:32 App: TestEnoentAdvancedGet got deployed
2022/01/03 09:30:32 Starting bucket ops to source bucket
2022/01/03 09:30:37 Waiting for dst bucket item count to get to: 200 curr count: 0
2022/01/03 09:30:42 Waiting for dst bucket item count to get to: 200 curr count: 0
2022/01/03 09:30:42 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2022/01/03 09:30:42 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:30:42 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:30:47 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/03 09:30:52 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/03 09:30:57 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/03 09:31:02 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/03 09:31:02 App: TestEnoentAdvancedGet got un-deployed
2022/01/03 09:31:02 No eventing-con process running
2022/01/03 09:31:02 Function: TestEnoentAdvancedGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet deleting in background"
}
2022/01/03 09:31:04 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:31:14 Waiting for dst bucket item count to get to: 0 curr count: 200
2022/01/03 09:31:19 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:31:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:31:21 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:31:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedGet (154.96s)
=== RUN   TestEnoentAdvancedReplace
2022/01/03 09:31:26 Deploying app: TestEnoentAdvancedReplace. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:31:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace stored in temp store"
}
2022/01/03 09:31:32 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/03 09:31:37 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/03 09:31:42 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/03 09:31:47 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/03 09:31:47 App: TestEnoentAdvancedReplace got deployed
2022/01/03 09:31:47 Starting bucket ops to source bucket
2022/01/03 09:31:52 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 09:31:57 Waiting for dst bucket item count to get to: 100 curr count: 81
2022/01/03 09:32:02 Waiting for dst bucket item count to get to: 100 curr count: 81
2022/01/03 09:32:02 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 09:32:02 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:32:02 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:32:07 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/03 09:32:12 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/03 09:32:17 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/03 09:32:22 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/03 09:32:22 App: TestEnoentAdvancedReplace got un-deployed
2022/01/03 09:32:22 No eventing-con process running
2022/01/03 09:32:22 Function: TestEnoentAdvancedReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace deleting in background"
}
2022/01/03 09:32:24 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:32:34 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:32:39 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 09:32:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:32:41 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:32:51 Waiting for dst bucket item count to get to: 0 curr count: 98
2022/01/03 09:32:56 Waiting for dst bucket item count to get to: 0 curr count: 98
2022/01/03 09:32:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:32:56 Testing get enoent operation on source bucket
2022/01/03 09:32:56 Deploying app: TestEnoentAdvancedReplace. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:32:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace stored in temp store"
}
2022/01/03 09:33:02 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/03 09:33:07 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/03 09:33:12 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/03 09:33:17 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/03 09:33:17 App: TestEnoentAdvancedReplace got deployed
2022/01/03 09:33:17 Starting bucket ops to source bucket
2022/01/03 09:33:22 Waiting for dst bucket item count to get to: 200 curr count: 0
2022/01/03 09:33:27 Waiting for dst bucket item count to get to: 200 curr count: 100
2022/01/03 09:33:32 Waiting for dst bucket item count to get to: 200 curr count: 100
2022/01/03 09:33:32 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2022/01/03 09:33:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:33:32 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:33:37 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/03 09:33:42 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/03 09:33:48 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/03 09:33:53 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/03 09:33:53 App: TestEnoentAdvancedReplace got un-deployed
2022/01/03 09:33:53 No eventing-con process running
2022/01/03 09:33:53 Function: TestEnoentAdvancedReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace deleting in background"
}
2022/01/03 09:33:54 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:34:04 Waiting for dst bucket item count to get to: 0 curr count: 200
2022/01/03 09:34:09 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:34:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:34:11 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:34:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedReplace (170.07s)
=== RUN   TestEnoentAdvancedDelete
2022/01/03 09:34:16 Deploying app: TestEnoentAdvancedDelete. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:34:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete stored in temp store"
}
2022/01/03 09:34:22 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/03 09:34:27 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/03 09:34:32 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/03 09:34:37 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/03 09:34:37 App: TestEnoentAdvancedDelete got deployed
2022/01/03 09:34:37 Starting bucket ops to source bucket
2022/01/03 09:34:42 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 09:34:47 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/03 09:34:52 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/03 09:34:52 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 09:34:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:34:52 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:34:57 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/03 09:35:02 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/03 09:35:07 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/03 09:35:12 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/03 09:35:12 App: TestEnoentAdvancedDelete got un-deployed
2022/01/03 09:35:12 No eventing-con process running
2022/01/03 09:35:13 Function: TestEnoentAdvancedDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete deleting in background"
}
2022/01/03 09:35:14 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:35:24 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:35:29 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 09:35:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:35:31 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:35:41 Waiting for dst bucket item count to get to: 0 curr count: 98
2022/01/03 09:35:46 Waiting for dst bucket item count to get to: 0 curr count: 98
2022/01/03 09:35:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:35:46 Testing get enoent operation on source bucket
2022/01/03 09:35:46 Deploying app: TestEnoentAdvancedDelete. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:35:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete stored in temp store"
}
2022/01/03 09:35:52 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/03 09:35:57 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/03 09:36:02 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/03 09:36:07 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/03 09:36:07 App: TestEnoentAdvancedDelete got deployed
2022/01/03 09:36:07 Starting bucket ops to source bucket
2022/01/03 09:36:12 Waiting for dst bucket item count to get to: 200 curr count: 0
2022/01/03 09:36:17 Waiting for dst bucket item count to get to: 200 curr count: 106
2022/01/03 09:36:22 Waiting for dst bucket item count to get to: 200 curr count: 106
2022/01/03 09:36:22 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2022/01/03 09:36:22 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:36:22 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:36:27 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/03 09:36:32 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/03 09:36:37 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/03 09:36:42 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/03 09:36:42 App: TestEnoentAdvancedDelete got un-deployed
2022/01/03 09:36:42 No eventing-con process running
2022/01/03 09:36:42 Function: TestEnoentAdvancedDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete deleting in background"
}
2022/01/03 09:36:44 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:36:54 Waiting for dst bucket item count to get to: 0 curr count: 200
2022/01/03 09:36:59 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:36:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:37:01 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:37:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedDelete (169.90s)
=== RUN   TestAdvancedInsertKeyExist
2022/01/03 09:37:06 Deploying app: TestAdvancedInsertKeyExist. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:37:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist stored in temp store"
}
2022/01/03 09:37:12 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/03 09:37:17 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/03 09:37:22 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/03 09:37:27 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/03 09:37:27 App: TestAdvancedInsertKeyExist got deployed
2022/01/03 09:37:27 Starting bucket ops to source bucket
2022/01/03 09:37:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:37:27 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:37:27 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:37:32 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/03 09:37:37 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/03 09:37:42 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/03 09:37:47 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/03 09:37:47 App: TestAdvancedInsertKeyExist got un-deployed
2022/01/03 09:37:47 No eventing-con process running
2022/01/03 09:37:48 Function: TestAdvancedInsertKeyExist delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist deleting in background"
}
2022/01/03 09:37:49 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:37:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:37:57 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:38:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:38:02 Pumping document in the destination bucket
2022/01/03 09:38:02 Starting bucket ops to source bucket
2022/01/03 09:38:02 Deploying app: TestAdvancedInsertKeyExist. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:38:03 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist stored in temp store"
}
2022/01/03 09:38:08 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/03 09:38:13 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/03 09:38:18 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/03 09:38:23 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/03 09:38:23 App: TestAdvancedInsertKeyExist got deployed
2022/01/03 09:38:23 Starting bucket ops to source bucket
2022/01/03 09:38:28 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:38:33 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:38:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:38:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:38:33 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:38:38 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/03 09:38:43 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/03 09:38:48 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/03 09:38:53 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/03 09:38:53 App: TestAdvancedInsertKeyExist got un-deployed
2022/01/03 09:38:53 No eventing-con process running
2022/01/03 09:38:53 Function: TestAdvancedInsertKeyExist delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist deleting in background"
}
2022/01/03 09:38:55 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:39:05 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:39:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:39:07 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:39:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedInsertKeyExist (125.85s)
=== RUN   TestExipryGet
2022/01/03 09:39:12 Deploying app: TestExipryGet. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:39:13 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet stored in temp store"
}
2022/01/03 09:39:18 Waiting for app: TestExipryGet to get deployed
2022/01/03 09:39:23 Waiting for app: TestExipryGet to get deployed
2022/01/03 09:39:28 Waiting for app: TestExipryGet to get deployed
2022/01/03 09:39:33 Waiting for app: TestExipryGet to get deployed
2022/01/03 09:39:33 App: TestExipryGet got deployed
2022/01/03 09:39:33 Starting bucket ops to source bucket
2022/01/03 09:40:18 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:40:23 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 09:40:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:40:23 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:40:23 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:40:28 Waiting for app: TestExipryGet to get un-deployed
2022/01/03 09:40:33 Waiting for app: TestExipryGet to get un-deployed
2022/01/03 09:40:38 Waiting for app: TestExipryGet to get un-deployed
2022/01/03 09:40:43 Waiting for app: TestExipryGet to get un-deployed
2022/01/03 09:40:43 App: TestExipryGet got un-deployed
2022/01/03 09:40:43 No eventing-con process running
2022/01/03 09:40:43 Function: TestExipryGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet deleting in background"
}
2022/01/03 09:40:45 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:40:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:40:52 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:40:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:40:57 Pumping document in the destination bucket for expiry get
2022/01/03 09:40:57 Starting bucket ops to source bucket
2022/01/03 09:40:57 Deploying app: TestExipryGet. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:40:59 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet stored in temp store"
}
2022/01/03 09:41:04 Waiting for app: TestExipryGet to get deployed
2022/01/03 09:41:09 Waiting for app: TestExipryGet to get deployed
2022/01/03 09:41:14 Waiting for app: TestExipryGet to get deployed
2022/01/03 09:41:19 Waiting for app: TestExipryGet to get deployed
2022/01/03 09:41:19 App: TestExipryGet got deployed
2022/01/03 09:41:19 Starting bucket ops to source bucket
2022/01/03 09:42:04 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:42:09 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 09:42:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:42:09 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:42:09 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:42:14 Waiting for app: TestExipryGet to get un-deployed
2022/01/03 09:42:19 Waiting for app: TestExipryGet to get un-deployed
2022/01/03 09:42:24 Waiting for app: TestExipryGet to get un-deployed
2022/01/03 09:42:29 Waiting for app: TestExipryGet to get un-deployed
2022/01/03 09:42:29 App: TestExipryGet got un-deployed
2022/01/03 09:42:29 No eventing-con process running
2022/01/03 09:42:29 Function: TestExipryGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet deleting in background"
}
2022/01/03 09:42:31 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:42:41 Waiting for dst bucket item count to get to: 0 curr count: 92
2022/01/03 09:42:46 Waiting for dst bucket item count to get to: 0 curr count: 92
2022/01/03 09:42:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:42:48 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:42:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryGet (220.76s)
=== RUN   TestExipryInsert
2022/01/03 09:42:53 Deploying app: TestExipryInsert. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:42:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert stored in temp store"
}
2022/01/03 09:42:59 Waiting for app: TestExipryInsert to get deployed
2022/01/03 09:43:04 Waiting for app: TestExipryInsert to get deployed
2022/01/03 09:43:09 Waiting for app: TestExipryInsert to get deployed
2022/01/03 09:43:14 Waiting for app: TestExipryInsert to get deployed
2022/01/03 09:43:14 App: TestExipryInsert got deployed
2022/01/03 09:43:14 Starting bucket ops to source bucket
2022/01/03 09:43:59 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:44:04 Waiting for dst bucket item count to get to: 0 curr count: 25
2022/01/03 09:44:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:44:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:44:04 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:44:09 Waiting for app: TestExipryInsert to get un-deployed
2022/01/03 09:44:14 Waiting for app: TestExipryInsert to get un-deployed
2022/01/03 09:44:19 Waiting for app: TestExipryInsert to get un-deployed
2022/01/03 09:44:24 Waiting for app: TestExipryInsert to get un-deployed
2022/01/03 09:44:24 App: TestExipryInsert got un-deployed
2022/01/03 09:44:24 No eventing-con process running
2022/01/03 09:44:24 Function: TestExipryInsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert deleting in background"
}
2022/01/03 09:44:26 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:44:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:44:33 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:44:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:44:38 Testing on the destination bucket for expiry insert
2022/01/03 09:44:38 Deploying app: TestExipryInsert. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:44:39 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert stored in temp store"
}
2022/01/03 09:44:44 Waiting for app: TestExipryInsert to get deployed
2022/01/03 09:44:49 Waiting for app: TestExipryInsert to get deployed
2022/01/03 09:44:54 Waiting for app: TestExipryInsert to get deployed
2022/01/03 09:44:59 Waiting for app: TestExipryInsert to get deployed
2022/01/03 09:44:59 App: TestExipryInsert got deployed
2022/01/03 09:44:59 Starting bucket ops to source bucket
2022/01/03 09:45:45 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:45:50 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:45:55 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 09:45:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:45:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:45:55 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:46:00 Waiting for app: TestExipryInsert to get un-deployed
2022/01/03 09:46:05 Waiting for app: TestExipryInsert to get un-deployed
2022/01/03 09:46:10 Waiting for app: TestExipryInsert to get un-deployed
2022/01/03 09:46:15 Waiting for app: TestExipryInsert to get un-deployed
2022/01/03 09:46:15 App: TestExipryInsert got un-deployed
2022/01/03 09:46:15 No eventing-con process running
2022/01/03 09:46:15 Function: TestExipryInsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert deleting in background"
}
2022/01/03 09:46:16 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:46:26 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:46:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:46:28 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:46:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryInsert (220.71s)
=== RUN   TestExipryReplace
2022/01/03 09:46:33 Deploying app: TestExipryReplace. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:46:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace stored in temp store"
}
2022/01/03 09:46:40 Waiting for app: TestExipryReplace to get deployed
2022/01/03 09:46:45 Waiting for app: TestExipryReplace to get deployed
2022/01/03 09:46:50 Waiting for app: TestExipryReplace to get deployed
2022/01/03 09:46:55 Waiting for app: TestExipryReplace to get deployed
2022/01/03 09:46:55 App: TestExipryReplace got deployed
2022/01/03 09:46:55 Starting bucket ops to source bucket
2022/01/03 09:47:40 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:47:45 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 09:47:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:47:45 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:47:45 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:47:50 Waiting for app: TestExipryReplace to get un-deployed
2022/01/03 09:47:55 Waiting for app: TestExipryReplace to get un-deployed
2022/01/03 09:48:00 Waiting for app: TestExipryReplace to get un-deployed
2022/01/03 09:48:05 Waiting for app: TestExipryReplace to get un-deployed
2022/01/03 09:48:05 App: TestExipryReplace got un-deployed
2022/01/03 09:48:05 No eventing-con process running
2022/01/03 09:48:05 Function: TestExipryReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace deleting in background"
}
2022/01/03 09:48:07 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:48:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:48:14 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:48:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:48:19 Testing on the destination bucket for expiry insert
2022/01/03 09:48:19 Deploying app: TestExipryReplace. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:48:20 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace stored in temp store"
}
2022/01/03 09:48:25 Waiting for app: TestExipryReplace to get deployed
2022/01/03 09:48:30 Waiting for app: TestExipryReplace to get deployed
2022/01/03 09:48:35 Waiting for app: TestExipryReplace to get deployed
2022/01/03 09:48:40 Waiting for app: TestExipryReplace to get deployed
2022/01/03 09:48:40 App: TestExipryReplace got deployed
2022/01/03 09:48:40 Starting bucket ops to source bucket
2022/01/03 09:49:25 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:49:30 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:49:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:49:30 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:49:30 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:49:35 Waiting for app: TestExipryReplace to get un-deployed
2022/01/03 09:49:40 Waiting for app: TestExipryReplace to get un-deployed
2022/01/03 09:49:45 Waiting for app: TestExipryReplace to get un-deployed
2022/01/03 09:49:50 Waiting for app: TestExipryReplace to get un-deployed
2022/01/03 09:49:50 App: TestExipryReplace got un-deployed
2022/01/03 09:49:50 No eventing-con process running
2022/01/03 09:49:50 Function: TestExipryReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace deleting in background"
}
2022/01/03 09:49:52 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:50:02 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:50:07 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:50:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:50:09 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:50:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryReplace (220.72s)
=== RUN   TestExipryUpsert
2022/01/03 09:50:14 Deploying app: TestExipryUpsert. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:50:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert stored in temp store"
}
2022/01/03 09:50:20 Waiting for app: TestExipryUpsert to get deployed
2022/01/03 09:50:25 Waiting for app: TestExipryUpsert to get deployed
2022/01/03 09:50:30 Waiting for app: TestExipryUpsert to get deployed
2022/01/03 09:50:35 Waiting for app: TestExipryUpsert to get deployed
2022/01/03 09:50:35 App: TestExipryUpsert got deployed
2022/01/03 09:50:35 Starting bucket ops to source bucket
2022/01/03 09:51:20 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:51:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:51:20 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:51:20 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:51:25 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/03 09:51:31 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/03 09:51:36 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/03 09:51:41 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/03 09:51:41 App: TestExipryUpsert got un-deployed
2022/01/03 09:51:41 No eventing-con process running
2022/01/03 09:51:41 Function: TestExipryUpsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert deleting in background"
}
2022/01/03 09:51:42 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:51:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:51:50 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:51:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:51:55 Testing on the destination bucket for expiry insert
2022/01/03 09:51:55 Deploying app: TestExipryUpsert. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:51:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert stored in temp store"
}
2022/01/03 09:52:01 Waiting for app: TestExipryUpsert to get deployed
2022/01/03 09:52:06 Waiting for app: TestExipryUpsert to get deployed
2022/01/03 09:52:11 Waiting for app: TestExipryUpsert to get deployed
2022/01/03 09:52:16 Waiting for app: TestExipryUpsert to get deployed
2022/01/03 09:52:16 App: TestExipryUpsert got deployed
2022/01/03 09:52:16 Starting bucket ops to source bucket
2022/01/03 09:53:01 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:53:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:53:01 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:53:01 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:53:06 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/03 09:53:11 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/03 09:53:16 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/03 09:53:21 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/03 09:53:21 App: TestExipryUpsert got un-deployed
2022/01/03 09:53:21 No eventing-con process running
2022/01/03 09:53:21 Function: TestExipryUpsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert deleting in background"
}
2022/01/03 09:53:23 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:53:33 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:53:38 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 09:53:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:53:40 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:53:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryUpsert (210.69s)
=== RUN   TestCasReplace
2022/01/03 09:53:45 Deploying app: TestCasReplace. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:53:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace stored in temp store"
}
2022/01/03 09:53:51 Waiting for app: TestCasReplace to get deployed
2022/01/03 09:53:56 Waiting for app: TestCasReplace to get deployed
2022/01/03 09:54:01 Waiting for app: TestCasReplace to get deployed
2022/01/03 09:54:06 Waiting for app: TestCasReplace to get deployed
2022/01/03 09:54:06 App: TestCasReplace got deployed
2022/01/03 09:54:06 Starting bucket ops to source bucket
2022/01/03 09:54:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:54:06 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:54:06 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:54:11 Waiting for app: TestCasReplace to get un-deployed
2022/01/03 09:54:16 Waiting for app: TestCasReplace to get un-deployed
2022/01/03 09:54:21 Waiting for app: TestCasReplace to get un-deployed
2022/01/03 09:54:26 Waiting for app: TestCasReplace to get un-deployed
2022/01/03 09:54:26 App: TestCasReplace got un-deployed
2022/01/03 09:54:26 No eventing-con process running
2022/01/03 09:54:26 Function: TestCasReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace deleting in background"
}
2022/01/03 09:54:28 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:54:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:54:35 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:54:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:54:40 Testing on the destination bucket for upsert with cas
2022/01/03 09:54:40 Starting bucket ops to source bucket
2022/01/03 09:54:40 Deploying app: TestCasReplace. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:54:42 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace stored in temp store"
}
2022/01/03 09:54:47 Waiting for app: TestCasReplace to get deployed
2022/01/03 09:54:52 Waiting for app: TestCasReplace to get deployed
2022/01/03 09:54:57 Waiting for app: TestCasReplace to get deployed
2022/01/03 09:55:02 Waiting for app: TestCasReplace to get deployed
2022/01/03 09:55:02 App: TestCasReplace got deployed
2022/01/03 09:55:02 Starting bucket ops to source bucket
2022/01/03 09:55:07 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:55:12 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:55:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:55:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:55:12 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:55:17 Waiting for app: TestCasReplace to get un-deployed
2022/01/03 09:55:22 Waiting for app: TestCasReplace to get un-deployed
2022/01/03 09:55:27 Waiting for app: TestCasReplace to get un-deployed
2022/01/03 09:55:32 Waiting for app: TestCasReplace to get un-deployed
2022/01/03 09:55:32 App: TestCasReplace got un-deployed
2022/01/03 09:55:32 No eventing-con process running
2022/01/03 09:55:32 Function: TestCasReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace deleting in background"
}
2022/01/03 09:55:34 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:55:44 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:55:49 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 09:55:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:55:50 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:55:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCasReplace (130.78s)
=== RUN   TestCasDelete
2022/01/03 09:55:55 Deploying app: TestCasDelete. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:55:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete stored in temp store"
}
2022/01/03 09:56:02 Waiting for app: TestCasDelete to get deployed
2022/01/03 09:56:07 Waiting for app: TestCasDelete to get deployed
2022/01/03 09:56:12 Waiting for app: TestCasDelete to get deployed
2022/01/03 09:56:17 Waiting for app: TestCasDelete to get deployed
2022/01/03 09:56:17 App: TestCasDelete got deployed
2022/01/03 09:56:17 Starting bucket ops to source bucket
2022/01/03 09:56:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:56:17 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:56:17 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:56:22 Waiting for app: TestCasDelete to get un-deployed
2022/01/03 09:56:27 Waiting for app: TestCasDelete to get un-deployed
2022/01/03 09:56:32 Waiting for app: TestCasDelete to get un-deployed
2022/01/03 09:56:37 Waiting for app: TestCasDelete to get un-deployed
2022/01/03 09:56:37 App: TestCasDelete got un-deployed
2022/01/03 09:56:37 No eventing-con process running
2022/01/03 09:56:37 Function: TestCasDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete deleting in background"
}
2022/01/03 09:56:39 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:56:49 Waiting for dst bucket item count to get to: 0 curr count: 2
2022/01/03 09:56:54 Waiting for dst bucket item count to get to: 0 curr count: 2
2022/01/03 09:56:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:56:56 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:57:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:57:01 Testing on the destination bucket for delete with cas
2022/01/03 09:57:01 Starting bucket ops to source bucket
2022/01/03 09:57:01 Deploying app: TestCasDelete. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:57:02 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete stored in temp store"
}
2022/01/03 09:57:07 Waiting for app: TestCasDelete to get deployed
2022/01/03 09:57:12 Waiting for app: TestCasDelete to get deployed
2022/01/03 09:57:17 Waiting for app: TestCasDelete to get deployed
2022/01/03 09:57:22 Waiting for app: TestCasDelete to get deployed
2022/01/03 09:57:22 App: TestCasDelete got deployed
2022/01/03 09:57:22 Starting bucket ops to source bucket
2022/01/03 09:57:27 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:57:32 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:57:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:57:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:57:32 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 09:57:37 Waiting for app: TestCasDelete to get un-deployed
2022/01/03 09:57:42 Waiting for app: TestCasDelete to get un-deployed
2022/01/03 09:57:47 Waiting for app: TestCasDelete to get un-deployed
2022/01/03 09:57:52 Waiting for app: TestCasDelete to get un-deployed
2022/01/03 09:57:52 App: TestCasDelete got un-deployed
2022/01/03 09:57:52 No eventing-con process running
2022/01/03 09:57:52 Function: TestCasDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete deleting in background"
}
2022/01/03 09:57:54 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:58:04 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 09:58:09 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 09:58:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:58:11 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:58:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCasDelete (140.33s)
=== RUN   TestCountersIncrement
2022/01/03 09:58:16 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 09:58:22 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 09:58:22 Removing node(s): [] from the cluster
2022/01/03 09:58:27 Rebalance progress: 100
2022/01/03 09:58:27 Deploying app: TestCountersIncrement. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:58:29 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement stored in temp store"
}
2022/01/03 09:58:34 Waiting for app: TestCountersIncrement to get deployed
2022/01/03 09:58:39 Waiting for app: TestCountersIncrement to get deployed
2022/01/03 09:58:44 Waiting for app: TestCountersIncrement to get deployed
2022/01/03 09:58:49 Waiting for app: TestCountersIncrement to get deployed
2022/01/03 09:58:49 App: TestCountersIncrement got deployed
2022/01/03 09:58:49 Starting bucket ops to source bucket
2022/01/03 09:58:55 Waiting for dst bucket item count to get to: 1024 curr count: 0
2022/01/03 09:59:00 Waiting for dst bucket item count to get to: 1024 curr count: 237
2022/01/03 09:59:05 Waiting for dst bucket item count to get to: 1024 curr count: 237
2022/01/03 09:59:05 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2022/01/03 09:59:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 09:59:10 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/03 09:59:15 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/03 09:59:20 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/03 09:59:25 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/03 09:59:25 App: TestCountersIncrement got un-deployed
2022/01/03 09:59:25 No eventing-con process running
2022/01/03 09:59:25 Function: TestCountersIncrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement deleting in background"
}
2022/01/03 09:59:27 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:59:37 Waiting for dst bucket item count to get to: 0 curr count: 1025
2022/01/03 09:59:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:59:39 Context: Bucket flush, response code: 200 dump: 
2022/01/03 09:59:49 Waiting for dst bucket item count to get to: 0 curr count: 945
2022/01/03 09:59:54 Waiting for dst bucket item count to get to: 0 curr count: 433
2022/01/03 09:59:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 09:59:54 Deploying app: TestCountersIncrement. Item count src bucket: 0 dst bucket: 0
2022/01/03 09:59:55 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement stored in temp store"
}
2022/01/03 10:00:00 Waiting for app: TestCountersIncrement to get deployed
2022/01/03 10:00:05 Waiting for app: TestCountersIncrement to get deployed
2022/01/03 10:00:10 Waiting for app: TestCountersIncrement to get deployed
2022/01/03 10:00:15 Waiting for app: TestCountersIncrement to get deployed
2022/01/03 10:00:15 App: TestCountersIncrement got deployed
2022/01/03 10:00:15 Starting bucket ops to source bucket
2022/01/03 10:00:21 Waiting for dst bucket item count to get to: 2048 curr count: 0
2022/01/03 10:00:26 Waiting for dst bucket item count to get to: 2048 curr count: 1024
2022/01/03 10:00:26 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2022/01/03 10:00:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:00:31 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/03 10:00:36 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/03 10:00:41 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/03 10:00:46 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/03 10:00:46 App: TestCountersIncrement got un-deployed
2022/01/03 10:00:46 No eventing-con process running
2022/01/03 10:00:46 Function: TestCountersIncrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement deleting in background"
}
2022/01/03 10:00:48 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:00:58 Waiting for dst bucket item count to get to: 0 curr count: 1349
2022/01/03 10:01:03 Waiting for dst bucket item count to get to: 0 curr count: 325
2022/01/03 10:01:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:01:05 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:01:15 Waiting for dst bucket item count to get to: 0 curr count: 1
2022/01/03 10:01:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:01:15 Removing node(s): [http://127.0.0.1:19002 http://127.0.0.1:19003] from the cluster
2022/01/03 10:01:20 Rebalance progress: 100
--- PASS: TestCountersIncrement (184.08s)
=== RUN   TestCountersDecrement
2022/01/03 10:01:20 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 10:01:20 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 10:01:21 Removing node(s): [] from the cluster
2022/01/03 10:01:26 Rebalance progress: 100
2022/01/03 10:01:26 Deploying app: TestCountersDecrement. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:01:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement stored in temp store"
}
2022/01/03 10:01:32 Waiting for app: TestCountersDecrement to get deployed
2022/01/03 10:01:37 Waiting for app: TestCountersDecrement to get deployed
2022/01/03 10:01:42 Waiting for app: TestCountersDecrement to get deployed
2022/01/03 10:01:47 Waiting for app: TestCountersDecrement to get deployed
2022/01/03 10:01:47 App: TestCountersDecrement got deployed
2022/01/03 10:01:47 Starting bucket ops to source bucket
2022/01/03 10:01:53 Waiting for dst bucket item count to get to: 1024 curr count: 0
2022/01/03 10:01:58 Waiting for dst bucket item count to get to: 1024 curr count: 512
2022/01/03 10:02:03 Waiting for dst bucket item count to get to: 1024 curr count: 512
2022/01/03 10:02:03 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2022/01/03 10:02:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:02:08 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/03 10:02:14 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/03 10:02:19 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/03 10:02:24 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/03 10:02:24 App: TestCountersDecrement got un-deployed
2022/01/03 10:02:24 No eventing-con process running
2022/01/03 10:02:24 Function: TestCountersDecrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement deleting in background"
}
2022/01/03 10:02:25 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:02:35 Waiting for dst bucket item count to get to: 0 curr count: 1025
2022/01/03 10:02:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:02:37 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:02:47 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/03 10:02:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:02:47 Deploying app: TestCountersDecrement. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:02:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement stored in temp store"
}
2022/01/03 10:02:53 Waiting for app: TestCountersDecrement to get deployed
2022/01/03 10:02:58 Waiting for app: TestCountersDecrement to get deployed
2022/01/03 10:03:03 Waiting for app: TestCountersDecrement to get deployed
2022/01/03 10:03:08 Waiting for app: TestCountersDecrement to get deployed
2022/01/03 10:03:08 App: TestCountersDecrement got deployed
2022/01/03 10:03:08 Starting bucket ops to source bucket
2022/01/03 10:03:15 Waiting for dst bucket item count to get to: 2048 curr count: 0
2022/01/03 10:03:20 Waiting for dst bucket item count to get to: 2048 curr count: 763
2022/01/03 10:03:25 Waiting for dst bucket item count to get to: 2048 curr count: 1787
2022/01/03 10:03:25 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2022/01/03 10:03:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:03:30 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/03 10:03:35 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/03 10:03:40 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/03 10:03:45 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/03 10:03:45 App: TestCountersDecrement got un-deployed
2022/01/03 10:03:45 No eventing-con process running
2022/01/03 10:03:45 Function: TestCountersDecrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement deleting in background"
}
2022/01/03 10:03:47 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:03:57 Waiting for dst bucket item count to get to: 0 curr count: 2048
2022/01/03 10:03:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:03:58 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:04:08 Waiting for dst bucket item count to get to: 0 curr count: 1
2022/01/03 10:04:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:04:08 Removing node(s): [http://127.0.0.1:19002 http://127.0.0.1:19003] from the cluster
2022/01/03 10:04:13 Rebalance progress: 100
--- PASS: TestCountersDecrement (173.64s)
=== RUN   TestCacheGet
2022/01/03 10:04:13 Deploying app: TestCacheGet. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:04:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheGet stored in temp store"
}
2022/01/03 10:04:20 Waiting for app: TestCacheGet to get deployed
2022/01/03 10:04:25 Waiting for app: TestCacheGet to get deployed
2022/01/03 10:04:30 Waiting for app: TestCacheGet to get deployed
2022/01/03 10:04:35 Waiting for app: TestCacheGet to get deployed
2022/01/03 10:04:35 App: TestCacheGet got deployed
2022/01/03 10:04:35 Starting bucket ops to source bucket
2022/01/03 10:04:40 Waiting for dst bucket item count to get to: 20 curr count: 0
2022/01/03 10:04:45 Waiting for dst bucket item count to get to: 20 curr count: 0
2022/01/03 10:04:50 Waiting for dst bucket item count to get to: 20 curr count: 0
2022/01/03 10:04:55 Waiting for dst bucket item count to get to: 20 curr count: 4
2022/01/03 10:05:00 Waiting for dst bucket item count to get to: 20 curr count: 12
2022/01/03 10:05:05 Waiting for dst bucket item count to get to: 20 curr count: 18
2022/01/03 10:05:05 src & dst bucket item count matched up. src bucket count: 20 dst bucket count: 20
2022/01/03 10:05:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:05:10 Waiting for app: TestCacheGet to get un-deployed
2022/01/03 10:05:15 Waiting for app: TestCacheGet to get un-deployed
2022/01/03 10:05:20 Waiting for app: TestCacheGet to get un-deployed
2022/01/03 10:05:25 Waiting for app: TestCacheGet to get un-deployed
2022/01/03 10:05:25 App: TestCacheGet got un-deployed
2022/01/03 10:05:25 No eventing-con process running
2022/01/03 10:05:25 Function: TestCacheGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheGet deleting in background"
}
2022/01/03 10:05:27 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:05:37 Waiting for dst bucket item count to get to: 0 curr count: 20
2022/01/03 10:05:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:05:39 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:05:49 Waiting for dst bucket item count to get to: 0 curr count: 19
2022/01/03 10:05:54 Waiting for dst bucket item count to get to: 0 curr count: 9
2022/01/03 10:05:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheGet (100.28s)
=== RUN   TestCacheRYOW
2022/01/03 10:05:54 Deploying app: TestCacheRYOW. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:05:55 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheRYOW stored in temp store"
}
2022/01/03 10:06:00 Waiting for app: TestCacheRYOW to get deployed
2022/01/03 10:06:05 Waiting for app: TestCacheRYOW to get deployed
2022/01/03 10:06:10 Waiting for app: TestCacheRYOW to get deployed
2022/01/03 10:06:15 Waiting for app: TestCacheRYOW to get deployed
2022/01/03 10:06:15 App: TestCacheRYOW got deployed
2022/01/03 10:06:15 Starting bucket ops to source bucket
2022/01/03 10:06:20 Waiting for dst bucket item count to get to: 50 curr count: 0
2022/01/03 10:06:25 Waiting for dst bucket item count to get to: 50 curr count: 25
2022/01/03 10:06:25 src & dst bucket item count matched up. src bucket count: 50 dst bucket count: 50
2022/01/03 10:06:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:06:30 Waiting for app: TestCacheRYOW to get un-deployed
2022/01/03 10:06:35 Waiting for app: TestCacheRYOW to get un-deployed
2022/01/03 10:06:40 Waiting for app: TestCacheRYOW to get un-deployed
2022/01/03 10:06:45 Waiting for app: TestCacheRYOW to get un-deployed
2022/01/03 10:06:45 App: TestCacheRYOW got un-deployed
2022/01/03 10:06:45 No eventing-con process running
2022/01/03 10:06:45 Function: TestCacheRYOW delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheRYOW deleting in background"
}
2022/01/03 10:06:47 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:06:57 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 10:06:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:06:59 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:07:09 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 10:07:14 Waiting for dst bucket item count to get to: 0 curr count: 25
2022/01/03 10:07:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheRYOW (80.18s)
=== RUN   TestCacheExpiry
2022/01/03 10:07:14 Deploying app: TestCacheExpiry. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:07:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiry stored in temp store"
}
2022/01/03 10:07:20 Waiting for app: TestCacheExpiry to get deployed
2022/01/03 10:07:25 Waiting for app: TestCacheExpiry to get deployed
2022/01/03 10:07:30 Waiting for app: TestCacheExpiry to get deployed
2022/01/03 10:07:35 Waiting for app: TestCacheExpiry to get deployed
2022/01/03 10:07:35 App: TestCacheExpiry got deployed
2022/01/03 10:07:35 Starting bucket ops to source bucket
2022/01/03 10:07:40 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 10:07:45 Waiting for dst bucket item count to get to: 100 curr count: 19
2022/01/03 10:07:50 Waiting for dst bucket item count to get to: 100 curr count: 19
2022/01/03 10:07:55 Waiting for dst bucket item count to get to: 100 curr count: 94
2022/01/03 10:08:00 Waiting for dst bucket item count to get to: 100 curr count: 94
2022/01/03 10:08:00 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 10:08:01 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:08:06 Waiting for app: TestCacheExpiry to get un-deployed
2022/01/03 10:08:11 Waiting for app: TestCacheExpiry to get un-deployed
2022/01/03 10:08:16 Waiting for app: TestCacheExpiry to get un-deployed
2022/01/03 10:08:21 Waiting for app: TestCacheExpiry to get un-deployed
2022/01/03 10:08:21 App: TestCacheExpiry got un-deployed
2022/01/03 10:08:21 No eventing-con process running
2022/01/03 10:08:21 Function: TestCacheExpiry delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiry deleting in background"
}
2022/01/03 10:08:22 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:08:33 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 10:08:38 Waiting for dst bucket item count to get to: 0 curr count: 25
2022/01/03 10:08:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:08:39 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:08:49 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 10:08:54 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 10:08:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheExpiry (100.33s)
=== RUN   TestCacheExpiryCustom
2022/01/03 10:08:54 Deploying app: TestCacheExpiryCustom. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:08:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiryCustom stored in temp store"
}
2022/01/03 10:09:01 Waiting for app: TestCacheExpiryCustom to get deployed
2022/01/03 10:09:06 Waiting for app: TestCacheExpiryCustom to get deployed
2022/01/03 10:09:11 Waiting for app: TestCacheExpiryCustom to get deployed
2022/01/03 10:09:16 Waiting for app: TestCacheExpiryCustom to get deployed
2022/01/03 10:09:16 App: TestCacheExpiryCustom got deployed
2022/01/03 10:09:16 Starting bucket ops to source bucket
2022/01/03 10:09:21 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 10:09:26 Waiting for dst bucket item count to get to: 100 curr count: 19
2022/01/03 10:09:31 Waiting for dst bucket item count to get to: 100 curr count: 19
2022/01/03 10:09:36 Waiting for dst bucket item count to get to: 100 curr count: 94
2022/01/03 10:09:41 Waiting for dst bucket item count to get to: 100 curr count: 94
2022/01/03 10:09:41 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 10:09:41 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:09:46 Waiting for app: TestCacheExpiryCustom to get un-deployed
2022/01/03 10:09:51 Waiting for app: TestCacheExpiryCustom to get un-deployed
2022/01/03 10:09:56 Waiting for app: TestCacheExpiryCustom to get un-deployed
2022/01/03 10:10:01 Waiting for app: TestCacheExpiryCustom to get un-deployed
2022/01/03 10:10:01 App: TestCacheExpiryCustom got un-deployed
2022/01/03 10:10:01 No eventing-con process running
2022/01/03 10:10:01 Function: TestCacheExpiryCustom delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiryCustom deleting in background"
}
2022/01/03 10:10:03 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:10:13 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 10:10:18 Waiting for dst bucket item count to get to: 0 curr count: 25
2022/01/03 10:10:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:10:20 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:10:30 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 10:10:35 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 10:10:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheExpiryCustom (100.39s)
=== RUN   TestCacheOverflowCustom
2022/01/03 10:10:35 Deploying app: TestCacheOverflowCustom. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:10:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheOverflowCustom stored in temp store"
}
2022/01/03 10:10:41 Waiting for app: TestCacheOverflowCustom to get deployed
2022/01/03 10:10:46 Waiting for app: TestCacheOverflowCustom to get deployed
2022/01/03 10:10:51 Waiting for app: TestCacheOverflowCustom to get deployed
2022/01/03 10:10:56 Waiting for app: TestCacheOverflowCustom to get deployed
2022/01/03 10:10:56 App: TestCacheOverflowCustom got deployed
2022/01/03 10:10:56 Starting bucket ops to source bucket
2022/01/03 10:11:01 Waiting for dst bucket item count to get to: 35 curr count: 0
2022/01/03 10:11:06 Waiting for dst bucket item count to get to: 35 curr count: 10
2022/01/03 10:11:11 Waiting for dst bucket item count to get to: 35 curr count: 10
2022/01/03 10:11:16 Waiting for dst bucket item count to get to: 35 curr count: 27
2022/01/03 10:11:21 Waiting for dst bucket item count to get to: 35 curr count: 27
2022/01/03 10:11:21 src & dst bucket item count matched up. src bucket count: 35 dst bucket count: 35
2022/01/03 10:11:21 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:11:26 Waiting for app: TestCacheOverflowCustom to get un-deployed
2022/01/03 10:11:31 Waiting for app: TestCacheOverflowCustom to get un-deployed
2022/01/03 10:11:36 Waiting for app: TestCacheOverflowCustom to get un-deployed
2022/01/03 10:11:41 Waiting for app: TestCacheOverflowCustom to get un-deployed
2022/01/03 10:11:41 App: TestCacheOverflowCustom got un-deployed
2022/01/03 10:11:41 No eventing-con process running
2022/01/03 10:11:41 Function: TestCacheOverflowCustom delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheOverflowCustom deleting in background"
}
2022/01/03 10:11:43 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:11:53 Waiting for dst bucket item count to get to: 0 curr count: 5
2022/01/03 10:11:58 Waiting for dst bucket item count to get to: 0 curr count: 3
2022/01/03 10:11:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:12:00 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:12:10 Waiting for dst bucket item count to get to: 0 curr count: 22
2022/01/03 10:12:15 Waiting for dst bucket item count to get to: 0 curr count: 22
2022/01/03 10:12:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheOverflowCustom (100.28s)
=== RUN   TestStrictMode
2022/01/03 10:12:15 Deploying app: TestStrictMode. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:12:16 Context: Post to main store, response code: 422 dump: {
 "name": "ERR_HANDLER_COMPILATION",
 "code": 27,
 "description": {
  "area": "handlerCode",
  "column_number": 63,
  "compile_success": false,
  "description": "        destination[meta.id] = 00000000000000000000000000000101;\n                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nSyntaxError: Octal literals are not allowed in strict mode.\n",
  "index": 132,
  "language": "JavaScript",
  "line_number": 4
 }
}
--- PASS: TestStrictMode (1.07s)
=== RUN   TestDataTypes
2022/01/03 10:12:16 Deploying app: TestDataTypes. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:12:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDataTypes stored in temp store"
}
2022/01/03 10:12:22 Waiting for app: TestDataTypes to get deployed
2022/01/03 10:12:27 Waiting for app: TestDataTypes to get deployed
2022/01/03 10:12:32 Waiting for app: TestDataTypes to get deployed
2022/01/03 10:12:37 Waiting for app: TestDataTypes to get deployed
2022/01/03 10:12:37 App: TestDataTypes got deployed
2022/01/03 10:12:37 Starting bucket ops to source bucket
2022/01/03 10:12:42 Waiting for dst bucket item count to get to: 18 curr count: 0
2022/01/03 10:12:47 Waiting for dst bucket item count to get to: 18 curr count: 10
2022/01/03 10:12:52 Waiting for dst bucket item count to get to: 18 curr count: 10
2022/01/03 10:12:52 src & dst bucket item count matched up. src bucket count: 18 dst bucket count: 18
2022/01/03 10:12:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:12:57 Waiting for app: TestDataTypes to get un-deployed
2022/01/03 10:13:03 Waiting for app: TestDataTypes to get un-deployed
2022/01/03 10:13:08 Waiting for app: TestDataTypes to get un-deployed
2022/01/03 10:13:13 Waiting for app: TestDataTypes to get un-deployed
2022/01/03 10:13:13 App: TestDataTypes got un-deployed
2022/01/03 10:13:13 No eventing-con process running
2022/01/03 10:13:13 Function: TestDataTypes delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDataTypes deleting in background"
}
2022/01/03 10:13:14 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:13:24 Waiting for dst bucket item count to get to: 0 curr count: 1
2022/01/03 10:13:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:13:26 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:13:36 Waiting for dst bucket item count to get to: 0 curr count: 18
2022/01/03 10:13:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDataTypes (80.21s)
=== RUN   TestEnoentGet
2022/01/03 10:13:36 Deploying app: TestEnoentGet. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:13:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet stored in temp store"
}
2022/01/03 10:13:42 Waiting for app: TestEnoentGet to get deployed
2022/01/03 10:13:47 Waiting for app: TestEnoentGet to get deployed
2022/01/03 10:13:52 Waiting for app: TestEnoentGet to get deployed
2022/01/03 10:13:57 Waiting for app: TestEnoentGet to get deployed
2022/01/03 10:13:57 App: TestEnoentGet got deployed
2022/01/03 10:13:57 Starting bucket ops to source bucket
2022/01/03 10:14:03 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 10:14:08 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/03 10:14:13 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/03 10:14:13 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 10:14:13 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:14:18 Waiting for app: TestEnoentGet to get un-deployed
2022/01/03 10:14:23 Waiting for app: TestEnoentGet to get un-deployed
2022/01/03 10:14:28 Waiting for app: TestEnoentGet to get un-deployed
2022/01/03 10:14:33 Waiting for app: TestEnoentGet to get un-deployed
2022/01/03 10:14:33 App: TestEnoentGet got un-deployed
2022/01/03 10:14:33 No eventing-con process running
2022/01/03 10:14:33 Function: TestEnoentGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet deleting in background"
}
2022/01/03 10:14:35 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:14:45 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 10:14:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:14:46 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:14:56 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 10:14:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:14:56 Deploying app: TestEnoentGet. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:14:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet stored in temp store"
}
2022/01/03 10:15:03 Waiting for app: TestEnoentGet to get deployed
2022/01/03 10:15:08 Waiting for app: TestEnoentGet to get deployed
2022/01/03 10:15:13 Waiting for app: TestEnoentGet to get deployed
2022/01/03 10:15:18 Waiting for app: TestEnoentGet to get deployed
2022/01/03 10:15:18 App: TestEnoentGet got deployed
2022/01/03 10:15:18 Starting bucket ops to source bucket
2022/01/03 10:15:23 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 10:15:28 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/03 10:15:33 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/03 10:15:33 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 10:15:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:15:38 Waiting for app: TestEnoentGet to get un-deployed
2022/01/03 10:15:43 Waiting for app: TestEnoentGet to get un-deployed
2022/01/03 10:15:48 Waiting for app: TestEnoentGet to get un-deployed
2022/01/03 10:15:53 Waiting for app: TestEnoentGet to get un-deployed
2022/01/03 10:15:53 App: TestEnoentGet got un-deployed
2022/01/03 10:15:53 No eventing-con process running
2022/01/03 10:15:53 Function: TestEnoentGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet deleting in background"
}
2022/01/03 10:15:55 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:16:05 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 10:16:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:16:07 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:16:17 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 10:16:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentGet (160.32s)
=== RUN   TestEnoentDelete
2022/01/03 10:16:17 Deploying app: TestEnoentDelete. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:16:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete stored in temp store"
}
2022/01/03 10:16:23 Waiting for app: TestEnoentDelete to get deployed
2022/01/03 10:16:28 Waiting for app: TestEnoentDelete to get deployed
2022/01/03 10:16:33 Waiting for app: TestEnoentDelete to get deployed
2022/01/03 10:16:38 Waiting for app: TestEnoentDelete to get deployed
2022/01/03 10:16:38 App: TestEnoentDelete got deployed
2022/01/03 10:16:38 Starting bucket ops to source bucket
2022/01/03 10:16:43 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 10:16:48 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/03 10:16:53 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/03 10:16:53 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 10:16:53 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:16:58 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/03 10:17:03 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/03 10:17:08 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/03 10:17:13 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/03 10:17:13 App: TestEnoentDelete got un-deployed
2022/01/03 10:17:13 No eventing-con process running
2022/01/03 10:17:13 Function: TestEnoentDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete deleting in background"
}
2022/01/03 10:17:15 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:17:25 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 10:17:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:17:27 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:17:37 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 10:17:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:17:37 Deploying app: TestEnoentDelete. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:17:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete stored in temp store"
}
2022/01/03 10:17:43 Waiting for app: TestEnoentDelete to get deployed
2022/01/03 10:17:48 Waiting for app: TestEnoentDelete to get deployed
2022/01/03 10:17:53 Waiting for app: TestEnoentDelete to get deployed
2022/01/03 10:17:58 Waiting for app: TestEnoentDelete to get deployed
2022/01/03 10:17:58 App: TestEnoentDelete got deployed
2022/01/03 10:17:58 Starting bucket ops to source bucket
2022/01/03 10:18:03 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 10:18:08 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/03 10:18:13 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/03 10:18:13 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 10:18:13 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:18:18 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/03 10:18:23 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/03 10:18:28 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/03 10:18:33 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/03 10:18:33 App: TestEnoentDelete got un-deployed
2022/01/03 10:18:33 No eventing-con process running
2022/01/03 10:18:33 Function: TestEnoentDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete deleting in background"
}
2022/01/03 10:18:35 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:18:45 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 10:18:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:18:47 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:18:57 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 10:18:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentDelete (160.44s)
=== RUN   TestError
2022/01/03 10:19:07 Waiting for app: TestError to get un-deployed
2022/01/03 10:19:07 App: TestError got un-deployed
2022/01/03 10:19:07 No eventing-con process running
2022/01/03 10:19:07 Function: TestError delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestError not found"
}
2022/01/03 10:19:09 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:19:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:19:16 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:19:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:19:21 Deploying app: TestError. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:19:22 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestError stored in temp store"
}
2022/01/03 10:19:27 Waiting for app: TestError to get deployed
2022/01/03 10:19:32 Waiting for app: TestError to get deployed
2022/01/03 10:19:37 Waiting for app: TestError to get deployed
2022/01/03 10:19:42 Waiting for app: TestError to get deployed
2022/01/03 10:19:42 App: TestError got deployed
2022/01/03 10:19:42 Starting bucket ops to source bucket
2022/01/03 10:19:47 Waiting for dst bucket item count to get to: 300 curr count: 0
2022/01/03 10:19:52 Waiting for dst bucket item count to get to: 300 curr count: 0
2022/01/03 10:19:52 src & dst bucket item count matched up. src bucket count: 300 dst bucket count: 300
2022/01/03 10:19:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:19:57 Waiting for app: TestError to get un-deployed
2022/01/03 10:20:02 Waiting for app: TestError to get un-deployed
2022/01/03 10:20:07 Waiting for app: TestError to get un-deployed
2022/01/03 10:20:12 Waiting for app: TestError to get un-deployed
2022/01/03 10:20:12 App: TestError got un-deployed
2022/01/03 10:20:12 No eventing-con process running
2022/01/03 10:20:12 Function: TestError delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestError deleting in background"
}
2022/01/03 10:20:14 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:20:24 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 10:20:29 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 10:20:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:20:31 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:20:41 Waiting for dst bucket item count to get to: 0 curr count: 283
2022/01/03 10:20:46 Waiting for dst bucket item count to get to: 0 curr count: 283
2022/01/03 10:20:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestError (108.94s)
=== RUN   TestCRLF
2022/01/03 10:20:56 Waiting for app: TestCRLF to get un-deployed
2022/01/03 10:20:56 App: TestCRLF got un-deployed
2022/01/03 10:20:56 No eventing-con process running
2022/01/03 10:20:56 Function: TestCRLF delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCRLF not found"
}
2022/01/03 10:20:58 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:21:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:21:04 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:21:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:21:10 Deploying app: TestCRLF. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:21:11 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCRLF stored in temp store"
}
2022/01/03 10:21:16 Waiting for app: TestCRLF to get deployed
2022/01/03 10:21:21 Waiting for app: TestCRLF to get deployed
2022/01/03 10:21:26 Waiting for app: TestCRLF to get deployed
2022/01/03 10:21:31 Waiting for app: TestCRLF to get deployed
2022/01/03 10:21:31 App: TestCRLF got deployed
2022/01/03 10:21:31 Starting bucket ops to source bucket
2022/01/03 10:21:36 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 10:21:41 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 10:21:41 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 10:21:41 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:21:46 Waiting for app: TestCRLF to get un-deployed
2022/01/03 10:21:51 Waiting for app: TestCRLF to get un-deployed
2022/01/03 10:21:56 Waiting for app: TestCRLF to get un-deployed
2022/01/03 10:22:01 Waiting for app: TestCRLF to get un-deployed
2022/01/03 10:22:01 App: TestCRLF got un-deployed
2022/01/03 10:22:01 No eventing-con process running
2022/01/03 10:22:01 Function: TestCRLF delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCRLF deleting in background"
}
2022/01/03 10:22:03 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:22:13 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 10:22:18 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 10:22:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:22:20 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:22:30 Waiting for dst bucket item count to get to: 0 curr count: 54
2022/01/03 10:22:35 Waiting for dst bucket item count to get to: 0 curr count: 54
2022/01/03 10:22:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCRLF (108.91s)
=== RUN   TestImportExport
2022/01/03 10:22:45 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2022/01/03 10:22:45 App: TestImportExport_n1ql_insert_on_update got un-deployed
2022/01/03 10:22:45 No eventing-con process running
2022/01/03 10:22:45 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestImportExport_n1ql_insert_on_update not found"
}
2022/01/03 10:22:47 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:22:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:22:53 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:22:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:23:03 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2022/01/03 10:23:03 App: TestImportExport_bucket_op_on_update got un-deployed
2022/01/03 10:23:03 No eventing-con process running
2022/01/03 10:23:03 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestImportExport_bucket_op_on_update not found"
}
2022/01/03 10:23:05 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:23:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:23:12 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:23:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:23:17 Deploying app: TestImportExport_n1ql_insert_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:23:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update stored in temp store"
}
2022/01/03 10:23:18 Deploying app: TestImportExport_bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:23:19 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update stored in temp store"
}
2022/01/03 10:23:24 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2022/01/03 10:23:29 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2022/01/03 10:23:34 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2022/01/03 10:23:39 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2022/01/03 10:23:39 App: TestImportExport_n1ql_insert_on_update got deployed
2022/01/03 10:23:44 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2022/01/03 10:23:49 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2022/01/03 10:23:54 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2022/01/03 10:23:54 App: TestImportExport_bucket_op_on_update got deployed
2022/01/03 10:24:00 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2022/01/03 10:24:05 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2022/01/03 10:24:10 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2022/01/03 10:24:15 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2022/01/03 10:24:15 App: TestImportExport_n1ql_insert_on_update got un-deployed
2022/01/03 10:24:15 No eventing-con process running
2022/01/03 10:24:15 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update deleting in background"
}
2022/01/03 10:24:20 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2022/01/03 10:24:25 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2022/01/03 10:24:30 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2022/01/03 10:24:35 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2022/01/03 10:24:35 App: TestImportExport_bucket_op_on_update got un-deployed
2022/01/03 10:24:35 No eventing-con process running
2022/01/03 10:24:35 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update deleting in background"
}
2022/01/03 10:24:52 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2022/01/03 10:24:52 App: TestImportExport_bucket_op_on_update got un-deployed
2022/01/03 10:24:52 No eventing-con process running
2022/01/03 10:24:52 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update deleting in background"
}
2022/01/03 10:24:54 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:24:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:25:01 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:25:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:25:11 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2022/01/03 10:25:11 App: TestImportExport_n1ql_insert_on_update got un-deployed
2022/01/03 10:25:11 No eventing-con process running
2022/01/03 10:25:11 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update deleting in background"
}
2022/01/03 10:25:13 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:25:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:25:19 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:25:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestImportExport (169.62s)
=== RUN   TestDeployUndeployLoopNonDefaultSettings
2022/01/03 10:25:34 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:25:34 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2022/01/03 10:25:34 No eventing-con process running
2022/01/03 10:25:34 Function: TestDeployUndeployLoopNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeployUndeployLoopNonDefaultSettings not found"
}
2022/01/03 10:25:36 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:25:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:25:43 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:25:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:25:48 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:25:49 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2022/01/03 10:25:49 Starting bucket ops to source bucket
2022/01/03 10:25:57 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:26:02 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:26:07 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:26:12 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:26:17 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2022/01/03 10:26:17 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 10:26:22 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2022/01/03 10:26:22 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2022/01/03 10:26:22 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:26:22 Undeploying app: bucket_op_on_update
2022/01/03 10:26:27 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:26:32 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:26:37 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:26:42 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:26:42 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2022/01/03 10:26:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:26:42 No eventing-con process running
2022/01/03 10:26:44 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:26:51 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:27:26 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:27:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2022/01/03 10:27:27 Starting bucket ops to source bucket
2022/01/03 10:27:35 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:27:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:27:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:27:50 Waiting for dst bucket item count to get to: 5000 curr count: 696
2022/01/03 10:27:55 Waiting for dst bucket item count to get to: 5000 curr count: 696
2022/01/03 10:27:55 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 10:28:00 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2022/01/03 10:28:00 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2022/01/03 10:28:00 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:28:00 Undeploying app: bucket_op_on_update
2022/01/03 10:28:05 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:28:10 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:28:15 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:28:20 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:28:21 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2022/01/03 10:28:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:28:21 No eventing-con process running
2022/01/03 10:28:22 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:28:29 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:29:04 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:29:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2022/01/03 10:29:06 Starting bucket ops to source bucket
2022/01/03 10:29:14 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:29:19 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:29:24 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:29:29 Waiting for dst bucket item count to get to: 5000 curr count: 2987
2022/01/03 10:29:34 Waiting for dst bucket item count to get to: 5000 curr count: 2987
2022/01/03 10:29:34 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 10:29:39 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2022/01/03 10:29:39 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2022/01/03 10:29:39 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:29:39 Undeploying app: bucket_op_on_update
2022/01/03 10:29:44 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:29:49 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:29:54 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:29:59 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:29:59 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2022/01/03 10:29:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:29:59 No eventing-con process running
2022/01/03 10:30:01 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:30:08 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:30:43 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:30:44 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2022/01/03 10:30:44 Starting bucket ops to source bucket
2022/01/03 10:30:52 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:30:57 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:31:02 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:31:07 Waiting for dst bucket item count to get to: 5000 curr count: 1322
2022/01/03 10:31:12 Waiting for dst bucket item count to get to: 5000 curr count: 3822
2022/01/03 10:31:12 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 10:31:17 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2022/01/03 10:31:17 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2022/01/03 10:31:17 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:31:17 Undeploying app: bucket_op_on_update
2022/01/03 10:31:22 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:31:27 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:31:32 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:31:37 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:31:37 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2022/01/03 10:31:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:31:37 No eventing-con process running
2022/01/03 10:31:39 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:31:46 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:32:21 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:32:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2022/01/03 10:32:23 Starting bucket ops to source bucket
2022/01/03 10:32:30 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:32:35 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:32:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:32:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:32:45 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 10:32:50 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2022/01/03 10:32:51 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2022/01/03 10:32:51 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:32:51 Undeploying app: bucket_op_on_update
2022/01/03 10:32:56 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:33:01 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:33:06 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:33:11 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 10:33:11 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2022/01/03 10:33:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:33:11 No eventing-con process running
2022/01/03 10:33:12 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:33:20 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:33:55 Function: TestDeployUndeployLoopNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings deleting in background"
}
--- PASS: TestDeployUndeployLoopNonDefaultSettings (510.30s)
=== RUN   TestOnUpdateN1QLOp
2022/01/03 10:34:05 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2022/01/03 10:34:05 App: TestOnUpdateN1QLOp got un-deployed
2022/01/03 10:34:05 No eventing-con process running
2022/01/03 10:34:05 Function: TestOnUpdateN1QLOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateN1QLOp not found"
}
2022/01/03 10:34:07 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:34:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:34:13 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:34:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:34:18 Deploying app: TestOnUpdateN1QLOp. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:34:19 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateN1QLOp stored in temp store"
}
2022/01/03 10:34:19 Starting bucket ops to source bucket
2022/01/03 10:34:27 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:34:32 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:34:37 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:34:42 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:34:47 Waiting for dst bucket item count to get to: 5000 curr count: 2504
2022/01/03 10:34:47 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 10:34:47 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:34:52 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2022/01/03 10:34:58 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2022/01/03 10:35:03 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2022/01/03 10:35:08 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2022/01/03 10:35:08 App: TestOnUpdateN1QLOp got un-deployed
2022/01/03 10:35:08 No eventing-con process running
2022/01/03 10:35:08 Function: TestOnUpdateN1QLOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateN1QLOp deleting in background"
}
2022/01/03 10:35:09 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:35:19 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/03 10:35:24 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/03 10:35:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:35:26 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:35:36 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 10:35:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateN1QLOp (101.54s)
=== RUN   TestOnUpdateBucketOpDefaultSettings
2022/01/03 10:35:46 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2022/01/03 10:35:46 App: TestOnUpdateBucketOpDefaultSettings got un-deployed
2022/01/03 10:35:46 No eventing-con process running
2022/01/03 10:35:46 Function: TestOnUpdateBucketOpDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings not found"
}
2022/01/03 10:35:48 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:35:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:35:55 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:36:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:36:00 Deploying app: TestOnUpdateBucketOpDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:36:01 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings stored in temp store"
}
2022/01/03 10:36:01 Starting bucket ops to source bucket
2022/01/03 10:36:09 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:36:14 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:36:19 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:36:24 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:36:24 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 10:36:24 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:36:29 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2022/01/03 10:36:34 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2022/01/03 10:36:39 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2022/01/03 10:36:44 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2022/01/03 10:36:44 App: TestOnUpdateBucketOpDefaultSettings got un-deployed
2022/01/03 10:36:44 No eventing-con process running
2022/01/03 10:36:44 Function: TestOnUpdateBucketOpDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings deleting in background"
}
2022/01/03 10:36:46 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:36:56 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 10:36:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:36:58 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:37:08 Waiting for dst bucket item count to get to: 0 curr count: 3231
2022/01/03 10:37:13 Waiting for dst bucket item count to get to: 0 curr count: 731
2022/01/03 10:37:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings (96.59s)
=== RUN   TestOnUpdateBucketOpNonDefaultSettings
2022/01/03 10:37:23 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 10:37:23 App: TestOnUpdateBucketOpNonDefaultSettings got un-deployed
2022/01/03 10:37:23 No eventing-con process running
2022/01/03 10:37:23 Function: TestOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpNonDefaultSettings not found"
}
2022/01/03 10:37:25 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:37:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:37:31 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:37:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:37:36 Deploying app: TestOnUpdateBucketOpNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:37:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpNonDefaultSettings stored in temp store"
}
2022/01/03 10:37:38 Starting bucket ops to source bucket
2022/01/03 10:37:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:37:50 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:37:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:38:00 Waiting for dst bucket item count to get to: 5000 curr count: 727
2022/01/03 10:38:05 Waiting for dst bucket item count to get to: 5000 curr count: 727
2022/01/03 10:38:05 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 10:38:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:38:11 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 10:38:16 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 10:38:21 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 10:38:26 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 10:38:26 App: TestOnUpdateBucketOpNonDefaultSettings got un-deployed
2022/01/03 10:38:26 No eventing-con process running
2022/01/03 10:38:26 Function: TestOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpNonDefaultSettings deleting in background"
}
2022/01/03 10:38:27 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:38:38 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/03 10:38:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:38:39 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:38:49 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 10:38:54 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/03 10:38:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpNonDefaultSettings (101.39s)
=== RUN   TestOnUpdateBucketOpDefaultSettings10K
2022/01/03 10:39:04 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2022/01/03 10:39:04 App: TestOnUpdateBucketOpDefaultSettings10K got un-deployed
2022/01/03 10:39:04 No eventing-con process running
2022/01/03 10:39:04 Function: TestOnUpdateBucketOpDefaultSettings10K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings10K not found"
}
2022/01/03 10:39:06 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:39:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:39:13 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:39:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:39:18 Deploying app: TestOnUpdateBucketOpDefaultSettings10K. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:39:19 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings10K stored in temp store"
}
2022/01/03 10:39:19 Starting bucket ops to source bucket
2022/01/03 10:39:27 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:39:32 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:39:37 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:39:42 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:39:47 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2022/01/03 10:39:47 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 10:39:47 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:39:52 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2022/01/03 10:39:57 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2022/01/03 10:40:02 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2022/01/03 10:40:07 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2022/01/03 10:40:07 App: TestOnUpdateBucketOpDefaultSettings10K got un-deployed
2022/01/03 10:40:07 No eventing-con process running
2022/01/03 10:40:07 Function: TestOnUpdateBucketOpDefaultSettings10K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings10K deleting in background"
}
2022/01/03 10:40:09 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:40:19 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 10:40:24 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/03 10:40:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:40:26 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:40:36 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 10:40:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings10K (101.53s)
=== RUN   TestOnUpdateBucketOpDefaultSettings100K
2022/01/03 10:40:46 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2022/01/03 10:40:46 App: TestOnUpdateBucketOpDefaultSettings100K got un-deployed
2022/01/03 10:40:46 No eventing-con process running
2022/01/03 10:40:46 Function: TestOnUpdateBucketOpDefaultSettings100K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings100K not found"
}
2022/01/03 10:40:48 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:40:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:40:54 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:40:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:40:59 Deploying app: TestOnUpdateBucketOpDefaultSettings100K. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:41:01 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings100K stored in temp store"
}
2022/01/03 10:41:01 Starting bucket ops to source bucket
2022/01/03 10:41:09 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:41:14 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:41:19 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:41:24 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:41:24 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 10:41:24 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:41:29 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2022/01/03 10:41:34 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2022/01/03 10:41:39 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2022/01/03 10:41:44 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2022/01/03 10:41:44 App: TestOnUpdateBucketOpDefaultSettings100K got un-deployed
2022/01/03 10:41:44 No eventing-con process running
2022/01/03 10:41:44 Function: TestOnUpdateBucketOpDefaultSettings100K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings100K deleting in background"
}
2022/01/03 10:41:46 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:41:56 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 10:41:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:41:58 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:42:08 Waiting for dst bucket item count to get to: 0 curr count: 3152
2022/01/03 10:42:13 Waiting for dst bucket item count to get to: 0 curr count: 652
2022/01/03 10:42:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings100K (97.01s)
=== RUN   TestOnDeleteBucketOp
2022/01/03 10:42:23 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2022/01/03 10:42:23 App: TestOnDeleteBucketOp got un-deployed
2022/01/03 10:42:23 No eventing-con process running
2022/01/03 10:42:23 Function: TestOnDeleteBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteBucketOp not found"
}
2022/01/03 10:42:25 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:42:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:42:31 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:42:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:42:36 Deploying app: TestOnDeleteBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:42:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp stored in temp store"
}
2022/01/03 10:42:37 Starting bucket ops to source bucket
2022/01/03 10:42:48 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:42:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:42:58 Waiting for dst bucket item count to get to: 5000 curr count: 321
2022/01/03 10:43:03 Waiting for dst bucket item count to get to: 5000 curr count: 321
2022/01/03 10:43:03 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 10:43:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:43:08 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2022/01/03 10:43:14 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2022/01/03 10:43:19 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2022/01/03 10:43:24 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2022/01/03 10:43:24 App: TestOnDeleteBucketOp got un-deployed
2022/01/03 10:43:24 No eventing-con process running
2022/01/03 10:43:24 Function: TestOnDeleteBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp deleting in background"
}
2022/01/03 10:43:25 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:43:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:43:33 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:43:43 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 10:43:48 Waiting for dst bucket item count to get to: 0 curr count: 2496
2022/01/03 10:43:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteBucketOp (94.88s)
=== RUN   TestOnDeleteBucketOp5K
2022/01/03 10:43:58 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2022/01/03 10:43:58 App: TestOnDeleteBucketOp5K got un-deployed
2022/01/03 10:43:58 No eventing-con process running
2022/01/03 10:43:58 Function: TestOnDeleteBucketOp5K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteBucketOp5K not found"
}
2022/01/03 10:43:59 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:44:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:44:06 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:44:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:44:11 Deploying app: TestOnDeleteBucketOp5K. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:44:12 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp5K stored in temp store"
}
2022/01/03 10:44:12 Starting bucket ops to source bucket
2022/01/03 10:44:23 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:44:28 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:44:33 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:44:33 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 10:44:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:44:38 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2022/01/03 10:44:43 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2022/01/03 10:44:48 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2022/01/03 10:44:53 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2022/01/03 10:44:53 App: TestOnDeleteBucketOp5K got un-deployed
2022/01/03 10:44:53 No eventing-con process running
2022/01/03 10:44:53 Function: TestOnDeleteBucketOp5K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp5K deleting in background"
}
2022/01/03 10:44:55 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:45:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:45:02 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:45:12 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 10:45:17 Waiting for dst bucket item count to get to: 0 curr count: 2496
2022/01/03 10:45:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteBucketOp5K (89.75s)
=== RUN   TestTimerBucketOp
2022/01/03 10:45:27 Waiting for app: TestTimerBucketOp to get un-deployed
2022/01/03 10:45:27 App: TestTimerBucketOp got un-deployed
2022/01/03 10:45:27 No eventing-con process running
2022/01/03 10:45:27 Function: TestTimerBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerBucketOp not found"
}
2022/01/03 10:45:29 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:45:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:45:36 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:45:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:45:41 Deploying app: TestTimerBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:45:42 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerBucketOp stored in temp store"
}
2022/01/03 10:45:42 Starting bucket ops to source bucket
2022/01/03 10:45:50 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:45:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:46:00 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:46:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:46:10 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:46:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:46:20 Waiting for dst bucket item count to get to: 5000 curr count: 956
2022/01/03 10:46:25 Waiting for dst bucket item count to get to: 5000 curr count: 956
2022/01/03 10:46:25 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 10:46:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:46:30 Waiting for app: TestTimerBucketOp to get un-deployed
2022/01/03 10:46:35 Waiting for app: TestTimerBucketOp to get un-deployed
2022/01/03 10:46:40 Waiting for app: TestTimerBucketOp to get un-deployed
2022/01/03 10:46:45 Waiting for app: TestTimerBucketOp to get un-deployed
2022/01/03 10:46:45 App: TestTimerBucketOp got un-deployed
2022/01/03 10:46:45 No eventing-con process running
2022/01/03 10:46:45 Function: TestTimerBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerBucketOp deleting in background"
}
2022/01/03 10:46:47 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:46:57 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 10:46:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:46:59 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:47:09 Waiting for dst bucket item count to get to: 0 curr count: 4994
2022/01/03 10:47:14 Waiting for dst bucket item count to get to: 0 curr count: 2494
2022/01/03 10:47:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerBucketOp (116.44s)
=== RUN   TestTimerInPastBucketOp
2022/01/03 10:47:24 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2022/01/03 10:47:24 App: TestTimerInPastBucketOp got un-deployed
2022/01/03 10:47:24 No eventing-con process running
2022/01/03 10:47:24 Function: TestTimerInPastBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerInPastBucketOp not found"
}
2022/01/03 10:47:26 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:47:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:47:32 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:47:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:47:37 Deploying app: TestTimerInPastBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:47:39 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerInPastBucketOp stored in temp store"
}
2022/01/03 10:47:39 Starting bucket ops to source bucket
2022/01/03 10:47:47 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:47:52 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:47:57 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:48:02 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:48:07 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:48:12 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:48:17 Waiting for dst bucket item count to get to: 5000 curr count: 2242
2022/01/03 10:48:22 Waiting for dst bucket item count to get to: 5000 curr count: 4569
2022/01/03 10:48:27 Waiting for dst bucket item count to get to: 5000 curr count: 4827
2022/01/03 10:48:27 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 10:48:27 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:48:32 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2022/01/03 10:48:37 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2022/01/03 10:48:42 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2022/01/03 10:48:47 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2022/01/03 10:48:47 App: TestTimerInPastBucketOp got un-deployed
2022/01/03 10:48:47 No eventing-con process running
2022/01/03 10:48:47 Function: TestTimerInPastBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerInPastBucketOp deleting in background"
}
2022/01/03 10:48:49 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:48:59 Waiting for dst bucket item count to get to: 0 curr count: 4700
2022/01/03 10:49:04 Waiting for dst bucket item count to get to: 0 curr count: 2200
2022/01/03 10:49:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:49:05 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:49:15 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 10:49:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerInPastBucketOp (121.58s)
=== RUN   TestDeployUndeployLoopTimer
2022/01/03 10:49:25 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:49:25 App: TestDeployUndeployLoopTimer got un-deployed
2022/01/03 10:49:25 No eventing-con process running
2022/01/03 10:49:25 Function: TestDeployUndeployLoopTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeployUndeployLoopTimer not found"
}
2022/01/03 10:49:27 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:49:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:49:34 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:49:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:49:39 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:49:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2022/01/03 10:49:40 Starting bucket ops to source bucket
2022/01/03 10:49:48 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:49:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:49:58 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:50:03 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:50:08 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:50:13 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:50:18 Waiting for dst bucket item count to get to: 5000 curr count: 3279
2022/01/03 10:50:23 Waiting for dst bucket item count to get to: 5000 curr count: 3279
2022/01/03 10:50:23 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 10:50:28 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2022/01/03 10:50:28 App: TestDeployUndeployLoopTimer got deployed
2022/01/03 10:50:28 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:50:28 Undeploying app: bucket_op_with_timer
2022/01/03 10:50:33 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:50:38 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:50:43 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:50:48 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:50:48 App: TestDeployUndeployLoopTimer got un-deployed
2022/01/03 10:50:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:50:48 No eventing-con process running
2022/01/03 10:50:50 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:50:57 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:51:32 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:51:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2022/01/03 10:51:33 Starting bucket ops to source bucket
2022/01/03 10:51:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:51:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:51:51 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:51:56 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:52:01 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:52:06 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:52:11 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:52:16 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2022/01/03 10:52:16 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 10:52:21 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2022/01/03 10:52:21 App: TestDeployUndeployLoopTimer got deployed
2022/01/03 10:52:21 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:52:21 Undeploying app: bucket_op_with_timer
2022/01/03 10:52:26 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:52:32 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:52:37 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:52:42 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:52:42 App: TestDeployUndeployLoopTimer got un-deployed
2022/01/03 10:52:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:52:42 No eventing-con process running
2022/01/03 10:52:43 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:52:51 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:53:26 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:53:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2022/01/03 10:53:27 Starting bucket ops to source bucket
2022/01/03 10:53:35 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:53:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:53:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:53:50 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:53:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:54:00 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:54:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:54:05 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 10:54:10 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2022/01/03 10:54:10 App: TestDeployUndeployLoopTimer got deployed
2022/01/03 10:54:10 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:54:10 Undeploying app: bucket_op_with_timer
2022/01/03 10:54:15 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:54:20 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:54:25 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:54:30 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:54:30 App: TestDeployUndeployLoopTimer got un-deployed
2022/01/03 10:54:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:54:30 No eventing-con process running
2022/01/03 10:54:32 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:54:39 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:55:14 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:55:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2022/01/03 10:55:15 Starting bucket ops to source bucket
2022/01/03 10:55:23 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:55:28 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:55:33 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:55:38 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:55:43 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:55:48 Waiting for dst bucket item count to get to: 5000 curr count: 919
2022/01/03 10:55:53 Waiting for dst bucket item count to get to: 5000 curr count: 919
2022/01/03 10:55:53 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 10:55:58 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2022/01/03 10:55:58 App: TestDeployUndeployLoopTimer got deployed
2022/01/03 10:55:58 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:55:58 Undeploying app: bucket_op_with_timer
2022/01/03 10:56:03 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:56:08 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:56:13 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:56:18 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:56:18 App: TestDeployUndeployLoopTimer got un-deployed
2022/01/03 10:56:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:56:18 No eventing-con process running
2022/01/03 10:56:20 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:56:27 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:57:02 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:57:03 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2022/01/03 10:57:03 Starting bucket ops to source bucket
2022/01/03 10:57:11 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:57:16 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:57:21 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:57:26 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:57:31 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:57:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:57:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 10:57:46 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2022/01/03 10:57:46 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 10:57:51 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2022/01/03 10:57:51 App: TestDeployUndeployLoopTimer got deployed
2022/01/03 10:57:51 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 10:57:51 Undeploying app: bucket_op_with_timer
2022/01/03 10:57:56 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:58:02 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:58:07 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:58:12 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 10:58:12 App: TestDeployUndeployLoopTimer got un-deployed
2022/01/03 10:58:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:58:12 No eventing-con process running
2022/01/03 10:58:13 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:58:21 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:58:56 Function: TestDeployUndeployLoopTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer deleting in background"
}
--- PASS: TestDeployUndeployLoopTimer (580.19s)
=== RUN   TestMultipleHandlers
2022/01/03 10:59:06 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2022/01/03 10:59:06 App: TestMultipleHandlers_bucket_op_on_update got un-deployed
2022/01/03 10:59:06 No eventing-con process running
2022/01/03 10:59:06 Function: TestMultipleHandlers_bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMultipleHandlers_bucket_op_on_update not found"
}
2022/01/03 10:59:07 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:59:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:59:14 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:59:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:59:24 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2022/01/03 10:59:24 App: TestMultipleHandlers_bucket_op_on_delete got un-deployed
2022/01/03 10:59:24 No eventing-con process running
2022/01/03 10:59:24 Function: TestMultipleHandlers_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMultipleHandlers_bucket_op_on_delete not found"
}
2022/01/03 10:59:26 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:59:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:59:33 Context: Bucket flush, response code: 200 dump: 
2022/01/03 10:59:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 10:59:38 Deploying app: TestMultipleHandlers_bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:59:39 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_update stored in temp store"
}
2022/01/03 10:59:39 Deploying app: TestMultipleHandlers_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2022/01/03 10:59:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_delete stored in temp store"
}
2022/01/03 10:59:45 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2022/01/03 10:59:50 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2022/01/03 10:59:55 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2022/01/03 11:00:00 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2022/01/03 11:00:00 App: TestMultipleHandlers_bucket_op_on_update got deployed
2022/01/03 11:00:05 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2022/01/03 11:00:10 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2022/01/03 11:00:15 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2022/01/03 11:00:15 App: TestMultipleHandlers_bucket_op_on_delete got deployed
2022/01/03 11:00:15 Starting bucket ops to source bucket
2022/01/03 11:00:25 Waiting for dst bucket item count to get to: 5000 curr count: 888
2022/01/03 11:00:30 Waiting for dst bucket item count to get to: 5000 curr count: 2857
2022/01/03 11:00:35 Waiting for dst bucket item count to get to: 5000 curr count: 4469
2022/01/03 11:00:35 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 11:00:35 Starting bucket ops to source bucket
2022/01/03 11:00:50 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 11:00:55 Waiting for dst bucket item count to get to: 10000 curr count: 7504
2022/01/03 11:00:55 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 11:00:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:00:55 Function: TestMultipleHandlers_bucket_op_on_update update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:00:56 Function: TestMultipleHandlers_bucket_op_on_delete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:01:01 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2022/01/03 11:01:06 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2022/01/03 11:01:11 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2022/01/03 11:01:16 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2022/01/03 11:01:16 App: TestMultipleHandlers_bucket_op_on_update got un-deployed
2022/01/03 11:01:16 No eventing-con process running
2022/01/03 11:01:16 Function: TestMultipleHandlers_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_update deleting in background"
}
2022/01/03 11:01:18 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:01:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:01:25 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:01:35 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/03 11:01:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:01:40 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2022/01/03 11:01:45 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2022/01/03 11:01:50 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2022/01/03 11:01:55 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2022/01/03 11:01:55 App: TestMultipleHandlers_bucket_op_on_delete got un-deployed
2022/01/03 11:01:55 No eventing-con process running
2022/01/03 11:01:55 Function: TestMultipleHandlers_bucket_op_on_delete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_delete deleting in background"
}
2022/01/03 11:01:57 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:02:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:02:04 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:02:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMultipleHandlers (192.94s)
=== RUN   TestPauseResumeLoopDefaultSettings
2022/01/03 11:02:19 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2022/01/03 11:02:19 App: TestPauseResumeLoopDefaultSettings got un-deployed
2022/01/03 11:02:19 No eventing-con process running
2022/01/03 11:02:19 Function: TestPauseResumeLoopDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeLoopDefaultSettings not found"
}
2022/01/03 11:02:20 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:02:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:02:27 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:02:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:02:32 Deploying app: TestPauseResumeLoopDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:02:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopDefaultSettings stored in temp store"
}
2022/01/03 11:02:33 Starting bucket ops to source bucket
2022/01/03 11:02:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:02:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:02:51 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:02:56 Waiting for dst bucket item count to get to: 5000 curr count: 2311
2022/01/03 11:03:01 Waiting for dst bucket item count to get to: 5000 curr count: 4811
2022/01/03 11:03:01 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 11:03:01 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:03:06 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2022/01/03 11:03:06 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2022/01/03 11:03:06 Pausing app: bucket_op_on_update
2022/01/03 11:03:06 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:03:11 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2022/01/03 11:03:11 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2022/01/03 11:03:11 Resuming app: bucket_op_on_update
2022/01/03 11:03:13 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:03:13 Starting bucket ops to source bucket
2022/01/03 11:03:21 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 11:03:26 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 11:03:31 Waiting for dst bucket item count to get to: 10000 curr count: 5511
2022/01/03 11:03:36 Waiting for dst bucket item count to get to: 10000 curr count: 8011
2022/01/03 11:03:36 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 11:03:36 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:03:41 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2022/01/03 11:03:41 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2022/01/03 11:03:41 Pausing app: bucket_op_on_update
2022/01/03 11:03:41 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:03:46 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2022/01/03 11:03:46 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2022/01/03 11:03:46 Resuming app: bucket_op_on_update
2022/01/03 11:03:47 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:03:47 Starting bucket ops to source bucket
2022/01/03 11:03:55 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2022/01/03 11:04:00 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2022/01/03 11:04:05 Waiting for dst bucket item count to get to: 15000 curr count: 12500
2022/01/03 11:04:05 src & dst bucket item count matched up. src bucket count: 15000 dst bucket count: 15000
2022/01/03 11:04:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:04:10 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2022/01/03 11:04:10 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2022/01/03 11:04:10 Pausing app: bucket_op_on_update
2022/01/03 11:04:10 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:04:15 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2022/01/03 11:04:15 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2022/01/03 11:04:15 Resuming app: bucket_op_on_update
2022/01/03 11:04:16 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:04:16 Starting bucket ops to source bucket
2022/01/03 11:04:24 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/03 11:04:29 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/03 11:04:34 Waiting for dst bucket item count to get to: 20000 curr count: 17500
2022/01/03 11:04:39 Waiting for dst bucket item count to get to: 20000 curr count: 17500
2022/01/03 11:04:39 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2022/01/03 11:04:39 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:04:44 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2022/01/03 11:04:44 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2022/01/03 11:04:44 Pausing app: bucket_op_on_update
2022/01/03 11:04:44 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:04:49 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2022/01/03 11:04:49 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2022/01/03 11:04:49 Resuming app: bucket_op_on_update
2022/01/03 11:04:51 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:04:51 Starting bucket ops to source bucket
2022/01/03 11:04:58 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/03 11:05:03 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/03 11:05:08 Waiting for dst bucket item count to get to: 25000 curr count: 23144
2022/01/03 11:05:14 Waiting for dst bucket item count to get to: 25000 curr count: 23144
2022/01/03 11:05:14 src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2022/01/03 11:05:14 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:05:19 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2022/01/03 11:05:19 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2022/01/03 11:05:19 Pausing app: bucket_op_on_update
2022/01/03 11:05:19 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:05:24 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2022/01/03 11:05:24 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2022/01/03 11:05:29 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2022/01/03 11:05:34 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2022/01/03 11:05:39 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2022/01/03 11:05:44 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2022/01/03 11:05:44 App: TestPauseResumeLoopDefaultSettings got un-deployed
2022/01/03 11:05:44 No eventing-con process running
2022/01/03 11:05:44 Function: TestPauseResumeLoopDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopDefaultSettings deleting in background"
}
2022/01/03 11:05:46 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:05:56 Waiting for dst bucket item count to get to: 0 curr count: 25000
2022/01/03 11:05:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:05:57 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:06:07 Waiting for dst bucket item count to get to: 0 curr count: 12500
2022/01/03 11:06:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeLoopDefaultSettings (238.88s)
=== RUN   TestPauseResumeLoopNonDefaultSettings
2022/01/03 11:06:17 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2022/01/03 11:06:17 App: TestPauseResumeLoopNonDefaultSettings got un-deployed
2022/01/03 11:06:18 No eventing-con process running
2022/01/03 11:06:18 Function: TestPauseResumeLoopNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeLoopNonDefaultSettings not found"
}
2022/01/03 11:06:19 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:06:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:06:26 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:06:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:06:31 Deploying app: TestPauseResumeLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:06:32 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopNonDefaultSettings stored in temp store"
}
2022/01/03 11:06:32 Starting bucket ops to source bucket
2022/01/03 11:06:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:06:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:06:50 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:06:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:07:00 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:07:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:07:10 Waiting for dst bucket item count to get to: 5000 curr count: 1159
2022/01/03 11:07:15 Waiting for dst bucket item count to get to: 5000 curr count: 1159
2022/01/03 11:07:15 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 11:07:15 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:07:20 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2022/01/03 11:07:20 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2022/01/03 11:07:20 Pausing app: bucket_op_with_timer
2022/01/03 11:07:20 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:07:25 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2022/01/03 11:07:25 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2022/01/03 11:07:25 Resuming app: bucket_op_with_timer
2022/01/03 11:07:27 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:07:27 Starting bucket ops to source bucket
2022/01/03 11:07:35 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 11:07:40 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 11:07:45 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 11:07:50 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 11:07:55 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 11:08:00 Waiting for dst bucket item count to get to: 10000 curr count: 7152
2022/01/03 11:08:05 Waiting for dst bucket item count to get to: 10000 curr count: 9652
2022/01/03 11:08:05 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 11:08:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:08:10 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2022/01/03 11:08:10 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2022/01/03 11:08:10 Pausing app: bucket_op_with_timer
2022/01/03 11:08:10 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:08:15 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2022/01/03 11:08:15 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2022/01/03 11:08:15 Resuming app: bucket_op_with_timer
2022/01/03 11:08:16 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:08:16 Starting bucket ops to source bucket
2022/01/03 11:08:24 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2022/01/03 11:08:29 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2022/01/03 11:08:34 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2022/01/03 11:08:39 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2022/01/03 11:08:44 Waiting for dst bucket item count to get to: 15000 curr count: 10443
2022/01/03 11:08:49 Waiting for dst bucket item count to get to: 15000 curr count: 12582
2022/01/03 11:08:54 Waiting for dst bucket item count to get to: 15000 curr count: 14639
2022/01/03 11:08:54 src & dst bucket item count matched up. src bucket count: 15000 dst bucket count: 15000
2022/01/03 11:08:54 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:08:59 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2022/01/03 11:08:59 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2022/01/03 11:08:59 Pausing app: bucket_op_with_timer
2022/01/03 11:08:59 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:09:04 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2022/01/03 11:09:04 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2022/01/03 11:09:04 Resuming app: bucket_op_with_timer
2022/01/03 11:09:05 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:09:05 Starting bucket ops to source bucket
2022/01/03 11:09:13 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/03 11:09:18 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/03 11:09:23 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/03 11:09:28 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/03 11:09:33 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/03 11:09:38 Waiting for dst bucket item count to get to: 20000 curr count: 16825
2022/01/03 11:09:43 Waiting for dst bucket item count to get to: 20000 curr count: 19088
2022/01/03 11:09:48 Waiting for dst bucket item count to get to: 20000 curr count: 19763
2022/01/03 11:09:48 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2022/01/03 11:09:48 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:09:53 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2022/01/03 11:09:53 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2022/01/03 11:09:53 Pausing app: bucket_op_with_timer
2022/01/03 11:09:54 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:09:59 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2022/01/03 11:09:59 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2022/01/03 11:09:59 Resuming app: bucket_op_with_timer
2022/01/03 11:10:00 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:10:00 Starting bucket ops to source bucket
2022/01/03 11:10:08 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/03 11:10:13 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/03 11:10:18 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/03 11:10:23 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/03 11:10:28 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/03 11:10:33 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/03 11:10:33 src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2022/01/03 11:10:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:10:38 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2022/01/03 11:10:38 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2022/01/03 11:10:38 Pausing app: bucket_op_with_timer
2022/01/03 11:10:38 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:10:43 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2022/01/03 11:10:43 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2022/01/03 11:10:48 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2022/01/03 11:10:53 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2022/01/03 11:10:58 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2022/01/03 11:11:03 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2022/01/03 11:11:03 App: TestPauseResumeLoopNonDefaultSettings got un-deployed
2022/01/03 11:11:03 No eventing-con process running
2022/01/03 11:11:03 Function: TestPauseResumeLoopNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopNonDefaultSettings deleting in background"
}
2022/01/03 11:11:05 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:11:15 Waiting for dst bucket item count to get to: 0 curr count: 25000
2022/01/03 11:11:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:11:16 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:11:26 Waiting for dst bucket item count to get to: 0 curr count: 25000
2022/01/03 11:11:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeLoopNonDefaultSettings (319.00s)
=== RUN   TestPauseAndResumeWithWorkerCountChange
2022/01/03 11:11:36 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2022/01/03 11:11:36 App: TestPauseAndResumeWithWorkerCountChange got un-deployed
2022/01/03 11:11:37 No eventing-con process running
2022/01/03 11:11:37 Function: TestPauseAndResumeWithWorkerCountChange delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseAndResumeWithWorkerCountChange not found"
}
2022/01/03 11:11:38 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:11:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:11:45 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:11:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:11:50 Deploying app: TestPauseAndResumeWithWorkerCountChange. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:11:51 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseAndResumeWithWorkerCountChange stored in temp store"
}
2022/01/03 11:11:56 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2022/01/03 11:12:01 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2022/01/03 11:12:06 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2022/01/03 11:12:11 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2022/01/03 11:12:11 App: TestPauseAndResumeWithWorkerCountChange got deployed
2022/01/03 11:12:11 Starting bucket ops to source bucket
2022/01/03 11:12:20 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:12:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:12:30 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:12:35 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:12:35 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 11:12:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:12:36 Pausing app: bucket_op_with_timer
2022/01/03 11:12:36 Function: TestPauseAndResumeWithWorkerCountChange update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:12:41 Waiting for function: TestPauseAndResumeWithWorkerCountChange status to change to paused
2022/01/03 11:12:41 Function: TestPauseAndResumeWithWorkerCountChange status changed to paused
2022/01/03 11:12:41 Resuming app: bucket_op_with_timer
2022/01/03 11:12:42 Function: TestPauseAndResumeWithWorkerCountChange update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:6] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:12:42 Starting bucket ops to source bucket
2022/01/03 11:12:54 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 11:12:59 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 11:13:04 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 11:13:09 Waiting for dst bucket item count to get to: 10000 curr count: 5416
2022/01/03 11:13:14 Waiting for dst bucket item count to get to: 10000 curr count: 5416
2022/01/03 11:13:19 Waiting for dst bucket item count to get to: 10000 curr count: 7435
2022/01/03 11:13:24 Waiting for dst bucket item count to get to: 10000 curr count: 7435
2022/01/03 11:13:24 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 11:13:29 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2022/01/03 11:13:34 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2022/01/03 11:13:39 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2022/01/03 11:13:44 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2022/01/03 11:13:44 App: TestPauseAndResumeWithWorkerCountChange got un-deployed
2022/01/03 11:13:44 No eventing-con process running
2022/01/03 11:13:44 Function: TestPauseAndResumeWithWorkerCountChange delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseAndResumeWithWorkerCountChange deleting in background"
}
2022/01/03 11:13:46 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:13:56 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/03 11:13:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:13:57 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:14:07 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 11:14:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseAndResumeWithWorkerCountChange (160.99s)
=== RUN   TestPauseResumeWithEventingReb
2022/01/03 11:14:17 Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2022/01/03 11:14:17 App: TestPauseResumeWithEventingReb got un-deployed
2022/01/03 11:14:17 No eventing-con process running
2022/01/03 11:14:17 Function: TestPauseResumeWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeWithEventingReb not found"
}
2022/01/03 11:14:19 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:14:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:14:26 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:14:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:14:31 Deploying app: TestPauseResumeWithEventingReb. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:14:32 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeWithEventingReb stored in temp store"
}
2022/01/03 11:14:37 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2022/01/03 11:14:42 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2022/01/03 11:14:47 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2022/01/03 11:14:52 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2022/01/03 11:14:52 App: TestPauseResumeWithEventingReb got deployed
2022/01/03 11:14:52 Starting bucket ops to source bucket
2022/01/03 11:15:01 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:15:06 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:15:11 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:15:16 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:15:21 Waiting for dst bucket item count to get to: 5000 curr count: 4220
2022/01/03 11:15:26 Waiting for dst bucket item count to get to: 5000 curr count: 4220
2022/01/03 11:15:26 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 11:15:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:15:26 Pausing app: bucket_op_with_timer
2022/01/03 11:15:27 Function: TestPauseResumeWithEventingReb update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:15:32 Waiting for function: TestPauseResumeWithEventingReb status to change to paused
2022/01/03 11:15:32 Function: TestPauseResumeWithEventingReb status changed to paused
2022/01/03 11:15:32 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 11:15:32 Removing node(s): [] from the cluster
2022/01/03 11:15:37 Rebalance progress: 29.16666666666666
2022/01/03 11:15:42 Rebalance progress: 29.16666666666666
2022/01/03 11:15:47 Rebalance progress: 100
2022/01/03 11:15:47 Resuming app: bucket_op_with_timer
2022/01/03 11:15:48 Function: TestPauseResumeWithEventingReb update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:6] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:15:48 Starting bucket ops to source bucket
2022/01/03 11:16:00 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 11:16:05 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 11:16:10 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 11:16:15 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 11:16:20 Waiting for dst bucket item count to get to: 10000 curr count: 5025
2022/01/03 11:16:25 Waiting for dst bucket item count to get to: 10000 curr count: 7525
2022/01/03 11:16:25 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 11:16:25 Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/03 11:16:30 Rebalance progress: 29.16666666666666
2022/01/03 11:16:35 Rebalance progress: 29.16666666666666
2022/01/03 11:16:40 Rebalance progress: 100

VB distribution across eventing nodes and their workers::

2022/01/03 11:16:45 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:17:00 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:17:15 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:17:30 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:17:45 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:18:00 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:18:15 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:18:30 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:18:45 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:19:00 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:19:15 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:19:30 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:19:45 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:20:00 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:20:15 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:20:30 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:20:45 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:21:00 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:21:15 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:21:30 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 11:21:45 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]

DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: edcfc9f70b745f275e2b458181f5201b
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [0-56]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [57-113]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [114-170]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [171-227]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [228-284]
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 57
	v: [285-341]
Producer node: 172.31.2.134:9300	Node UUID: eba7d358554213e092d4a31eec3dccd5
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 56
	v: [968-1023]
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [683-739]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [740-796]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [797-853]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [854-910]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [911-967]
Producer node: 127.0.0.1:9303	Node UUID: cd95b133223436c07acef5d0efc6c0b9
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [342-398]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [399-455]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [456-512]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [513-569]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [570-626]
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 56
	v: [627-682]


2022/01/03 11:22:00 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:22:05 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2022/01/03 11:22:11 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2022/01/03 11:22:16 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2022/01/03 11:22:21 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2022/01/03 11:22:21 clusterSetup.go:405: App: TestPauseResumeWithEventingReb got un-deployed
2022/01/03 11:22:21 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:22:21 eventingSetup.go:418: Function: TestPauseResumeWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeWithEventingReb deleting in background"
}
2022/01/03 11:22:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:22:32 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/03 11:22:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 11:22:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:22:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:22:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/03 11:22:54 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 11:22:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeWithEventingReb (526.66s)
=== RUN   TestBucketDeleteAfterPause
2022/01/03 11:23:04 clusterSetup.go:397: Waiting for app: TestBucketDeleteAfterPause to get un-deployed
2022/01/03 11:23:04 clusterSetup.go:405: App: TestBucketDeleteAfterPause got un-deployed
2022/01/03 11:23:04 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:23:04 eventingSetup.go:418: Function: TestBucketDeleteAfterPause delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketDeleteAfterPause not found"
}
2022/01/03 11:23:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:23:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:23:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:23:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:23:18 eventingSetup.go:125: Deploying app: TestBucketDeleteAfterPause. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:23:19 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteAfterPause stored in temp store"
}
2022/01/03 11:23:24 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2022/01/03 11:23:29 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2022/01/03 11:23:34 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2022/01/03 11:23:39 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2022/01/03 11:23:39 clusterSetup.go:354: App: TestBucketDeleteAfterPause got deployed
2022/01/03 11:23:39 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 11:23:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 224
2022/01/03 11:23:53 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2724
2022/01/03 11:23:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2724
2022/01/03 11:23:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 11:23:58 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:23:58 handler_test.go:712: Pausing app: bucket_op_on_update
2022/01/03 11:23:59 eventingSetup.go:270: Function: TestBucketDeleteAfterPause update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:24:04 eventingSetup.go:719: Waiting for function: TestBucketDeleteAfterPause status to change to paused
2022/01/03 11:24:04 eventingSetup.go:727: Function: TestBucketDeleteAfterPause status changed to paused
2022/01/03 11:24:04 handler_test.go:716: Deleting source bucket: default
2022/01/03 11:24:10 eventingSetup.go:719: Waiting for function: TestBucketDeleteAfterPause status to change to undeployed
2022/01/03 11:24:10 eventingSetup.go:727: Function: TestBucketDeleteAfterPause status changed to undeployed
2022/01/03 11:24:15 clusterSetup.go:397: Waiting for app: TestBucketDeleteAfterPause to get un-deployed
2022/01/03 11:24:15 clusterSetup.go:405: App: TestBucketDeleteAfterPause got un-deployed
2022/01/03 11:24:15 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:24:15 eventingSetup.go:418: Function: TestBucketDeleteAfterPause delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteAfterPause deleting in background"
}
2022/01/03 11:24:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:24:26 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 11:24:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:24:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:24:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3924
2022/01/03 11:24:43 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1424
2022/01/03 11:24:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBucketDeleteAfterPause (109.12s)
=== RUN   TestChangeFnCodeBetweenPauseResume
2022/01/03 11:24:53 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2022/01/03 11:24:53 clusterSetup.go:405: App: TestChangeFnCodeBetweenPauseResume got un-deployed
2022/01/03 11:24:53 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:24:53 eventingSetup.go:418: Function: TestChangeFnCodeBetweenPauseResume delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestChangeFnCodeBetweenPauseResume not found"
}
2022/01/03 11:24:55 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:25:00 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:25:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:25:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:25:06 eventingSetup.go:125: Deploying app: TestChangeFnCodeBetweenPauseResume. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:25:08 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume stored in temp store"
}
2022/01/03 11:25:13 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2022/01/03 11:25:18 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2022/01/03 11:25:23 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2022/01/03 11:25:28 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2022/01/03 11:25:28 clusterSetup.go:354: App: TestChangeFnCodeBetweenPauseResume got deployed
2022/01/03 11:25:28 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 11:26:03 handler_test.go:739: Pausing function: TestChangeFnCodeBetweenPauseResume
2022/01/03 11:26:03 eventingSetup.go:270: Function: TestChangeFnCodeBetweenPauseResume update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:26:08 eventingSetup.go:719: Waiting for function: TestChangeFnCodeBetweenPauseResume status to change to paused
2022/01/03 11:26:08 eventingSetup.go:727: Function: TestChangeFnCodeBetweenPauseResume status changed to paused
2022/01/03 11:29:08 handler_test.go:748: Resuming function: TestChangeFnCodeBetweenPauseResume
2022/01/03 11:29:08 eventingSetup.go:125: Deploying app: TestChangeFnCodeBetweenPauseResume. Item count src bucket: 5000 dst bucket: 0
2022/01/03 11:29:09 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume stored in temp store"
}
2022/01/03 11:29:14 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2022/01/03 11:29:14 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:29:14 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 0 expected 5000
2022/01/03 11:29:19 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2022/01/03 11:29:19 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:29:19 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 3624 expected 5000
2022/01/03 11:29:24 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2022/01/03 11:29:24 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:29:24 eventingSetup.go:804: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 5000
2022/01/03 11:29:24 handler_test.go:753: Undeploying function: TestChangeFnCodeBetweenPauseResume
2022/01/03 11:29:24 eventingSetup.go:270: Function: TestChangeFnCodeBetweenPauseResume update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:29:34 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2022/01/03 11:29:39 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2022/01/03 11:29:44 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2022/01/03 11:29:44 clusterSetup.go:405: App: TestChangeFnCodeBetweenPauseResume got un-deployed
2022/01/03 11:29:44 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:29:44 eventingSetup.go:418: Function: TestChangeFnCodeBetweenPauseResume delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume deleting in background"
}
2022/01/03 11:29:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:29:56 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 11:29:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:29:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:30:02 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestChangeFnCodeBetweenPauseResume (319.21s)
=== RUN   TestCommentUnCommentOnDelete
2022/01/03 11:30:12 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2022/01/03 11:30:12 clusterSetup.go:405: App: TestCommentUnCommentOnDelete got un-deployed
2022/01/03 11:30:12 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:30:12 eventingSetup.go:418: Function: TestCommentUnCommentOnDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCommentUnCommentOnDelete not found"
}
2022/01/03 11:30:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:30:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:30:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:30:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:30:26 eventingSetup.go:125: Deploying app: TestCommentUnCommentOnDelete. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:30:27 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete stored in temp store"
}
2022/01/03 11:30:32 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/03 11:30:37 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/03 11:30:42 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/03 11:30:47 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/03 11:30:47 clusterSetup.go:354: App: TestCommentUnCommentOnDelete got deployed
2022/01/03 11:30:47 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 11:30:56 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:31:01 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 1630
2022/01/03 11:31:06 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 1630
2022/01/03 11:31:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 11:31:06 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:31:06 handler_test.go:780: Undeploying app: TestCommentUnCommentOnDelete
2022/01/03 11:31:06 eventingSetup.go:270: Function: TestCommentUnCommentOnDelete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:31:36 eventingSetup.go:125: Deploying app: TestCommentUnCommentOnDelete. Item count src bucket: 5000 dst bucket: 5000
2022/01/03 11:31:37 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete stored in temp store"
}
2022/01/03 11:31:42 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/03 11:31:47 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/03 11:31:52 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/03 11:31:57 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/03 11:31:57 clusterSetup.go:354: App: TestCommentUnCommentOnDelete got deployed
2022/01/03 11:31:57 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 11:32:10 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 11:32:15 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 11:32:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:32:15 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:32:15 handler_test.go:799: Undeploying app: TestCommentUnCommentOnDelete
2022/01/03 11:32:15 eventingSetup.go:270: Function: TestCommentUnCommentOnDelete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:32:25 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2022/01/03 11:32:30 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2022/01/03 11:32:35 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2022/01/03 11:32:35 clusterSetup.go:405: App: TestCommentUnCommentOnDelete got un-deployed
2022/01/03 11:32:35 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:32:35 eventingSetup.go:418: Function: TestCommentUnCommentOnDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete deleting in background"
}
2022/01/03 11:32:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:32:41 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:32:43 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:32:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCommentUnCommentOnDelete (165.67s)
=== RUN   TestCPPWorkerCleanup
2022/01/03 11:32:58 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2022/01/03 11:32:58 clusterSetup.go:405: App: TestCPPWorkerCleanup got un-deployed
2022/01/03 11:32:58 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:32:58 eventingSetup.go:418: Function: TestCPPWorkerCleanup delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCPPWorkerCleanup not found"
}
2022/01/03 11:32:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:33:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:33:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:33:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:33:11 eventingSetup.go:125: Deploying app: TestCPPWorkerCleanup. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:33:12 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCPPWorkerCleanup stored in temp store"
}
2022/01/03 11:33:12 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 11:33:19 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:33:24 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:33:29 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:33:34 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:33:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 3148
2022/01/03 11:33:44 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 3148
2022/01/03 11:33:44 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 11:33:44 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:33:50 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2022/01/03 11:33:55 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2022/01/03 11:34:00 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2022/01/03 11:34:05 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2022/01/03 11:34:05 clusterSetup.go:405: App: TestCPPWorkerCleanup got un-deployed
2022/01/03 11:34:05 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:34:05 eventingSetup.go:418: Function: TestCPPWorkerCleanup delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCPPWorkerCleanup deleting in background"
}
2022/01/03 11:34:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:34:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 11:34:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:34:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:34:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3069
2022/01/03 11:34:33 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 569
2022/01/03 11:34:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCPPWorkerCleanup (134.67s)
=== RUN   TestWithUserXattrs
2022/01/03 11:35:13 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2022/01/03 11:35:13 clusterSetup.go:405: App: TestWithUserXattrs got un-deployed
2022/01/03 11:35:13 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:35:13 eventingSetup.go:418: Function: TestWithUserXattrs delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestWithUserXattrs not found"
}
2022/01/03 11:35:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:35:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:35:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:35:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:35:26 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 11:35:28 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 11:35:30 eventingSetup.go:125: Deploying app: TestWithUserXattrs. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:35:31 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestWithUserXattrs stored in temp store"
}
2022/01/03 11:35:36 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2022/01/03 11:35:41 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2022/01/03 11:35:46 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2022/01/03 11:35:51 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2022/01/03 11:35:51 clusterSetup.go:354: App: TestWithUserXattrs got deployed
2022/01/03 11:35:51 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 11:36:00 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:36:05 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:36:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 11:36:05 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:36:11 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2022/01/03 11:36:16 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2022/01/03 11:36:21 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2022/01/03 11:36:26 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2022/01/03 11:36:26 clusterSetup.go:405: App: TestWithUserXattrs got un-deployed
2022/01/03 11:36:26 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:36:26 eventingSetup.go:418: Function: TestWithUserXattrs delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestWithUserXattrs deleting in background"
}
2022/01/03 11:36:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:36:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 11:36:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:36:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:36:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4564
2022/01/03 11:36:54 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2064
2022/01/03 11:36:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestWithUserXattrs (110.88s)
=== RUN   TestEventProcessingPostBucketFlush
2022/01/03 11:37:04 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2022/01/03 11:37:04 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2022/01/03 11:37:04 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:37:04 eventingSetup.go:418: Function: TestEventProcessingPostBucketFlush delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventProcessingPostBucketFlush not found"
}
2022/01/03 11:37:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:37:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:37:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:37:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:37:17 eventingSetup.go:125: Deploying app: TestEventProcessingPostBucketFlush. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:37:18 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventProcessingPostBucketFlush stored in temp store"
}
2022/01/03 11:37:23 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2022/01/03 11:37:28 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2022/01/03 11:37:33 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2022/01/03 11:37:38 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2022/01/03 11:37:38 clusterSetup.go:354: App: TestEventProcessingPostBucketFlush got deployed
2022/01/03 11:37:38 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 11:37:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:37:52 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 829
2022/01/03 11:37:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 829
2022/01/03 11:37:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 11:37:57 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:38:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:38:11 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2800
2022/01/03 11:38:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2800
2022/01/03 11:38:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:38:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:38:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3273
2022/01/03 11:38:33 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 773
2022/01/03 11:38:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:38:33 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 11:38:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 25000 curr count: 13121
2022/01/03 11:39:03 eventingSetup.go:441: Waiting for dst bucket item count to get to: 25000 curr count: 19517
2022/01/03 11:39:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 25000 curr count: 22931
2022/01/03 11:39:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2022/01/03 11:39:08 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:39:08 eventingSetup.go:270: Function: TestEventProcessingPostBucketFlush update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:39:13 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2022/01/03 11:39:18 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2022/01/03 11:39:23 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2022/01/03 11:39:28 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2022/01/03 11:39:28 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2022/01/03 11:39:28 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:39:33 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2022/01/03 11:39:33 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2022/01/03 11:39:33 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:39:33 eventingSetup.go:418: Function: TestEventProcessingPostBucketFlush delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventProcessingPostBucketFlush deleting in background"
}
2022/01/03 11:39:34 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:39:44 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 25000
2022/01/03 11:39:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12500
2022/01/03 11:39:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:39:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:40:01 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 22705
2022/01/03 11:40:06 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 22705
2022/01/03 11:40:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventProcessingPostBucketFlush (192.10s)
=== RUN   TestMetaBucketDelete
2022/01/03 11:40:16 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2022/01/03 11:40:16 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2022/01/03 11:40:16 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:40:16 eventingSetup.go:418: Function: TestMetaBucketDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaBucketDelete not found"
}
2022/01/03 11:40:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:40:22 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:40:24 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:40:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:40:29 eventingSetup.go:125: Deploying app: TestMetaBucketDelete. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:40:30 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDelete stored in temp store"
}
2022/01/03 11:40:35 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2022/01/03 11:40:40 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2022/01/03 11:40:45 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2022/01/03 11:40:50 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2022/01/03 11:40:50 clusterSetup.go:354: App: TestMetaBucketDelete got deployed
2022/01/03 11:40:50 handler_test.go:902: Deleting metadata bucket: eventing
2022/01/03 11:40:51 handler_test.go:904: Deleted metadata bucket: eventing
2022/01/03 11:40:56 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2022/01/03 11:40:56 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2022/01/03 11:41:11 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2022/01/03 11:41:11 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2022/01/03 11:41:11 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:41:11 eventingSetup.go:418: Function: TestMetaBucketDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDelete deleting in background"
}
2022/01/03 11:41:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:41:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:41:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:41:24 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaBucketDelete (78.48s)
=== RUN   TestMetaBucketDeleteWithBootstrap
2022/01/03 11:41:34 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2022/01/03 11:41:34 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2022/01/03 11:41:34 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:41:34 eventingSetup.go:418: Function: TestMetaBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaBucketDeleteWithBootstrap not found"
}
2022/01/03 11:41:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:41:41 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:41:42 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:41:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:41:47 eventingSetup.go:125: Deploying app: TestMetaBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:41:48 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDeleteWithBootstrap stored in temp store"
}
2022/01/03 11:42:07 handler_test.go:923: Deleting metadata bucket: eventing
2022/01/03 11:42:08 handler_test.go:925: Deleted metadata bucket: eventing
2022/01/03 11:42:23 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2022/01/03 11:42:23 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2022/01/03 11:42:38 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2022/01/03 11:42:38 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2022/01/03 11:42:38 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:42:38 eventingSetup.go:418: Function: TestMetaBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDeleteWithBootstrap deleting in background"
}
2022/01/03 11:42:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:42:44 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:42:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:42:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaBucketDeleteWithBootstrap (86.77s)
=== RUN   TestSourceBucketDelete
2022/01/03 11:43:01 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2022/01/03 11:43:01 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2022/01/03 11:43:01 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:43:01 eventingSetup.go:418: Function: TestSourceBucketDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceBucketDelete not found"
}
2022/01/03 11:43:02 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:43:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:43:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:43:14 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:43:14 eventingSetup.go:125: Deploying app: TestSourceBucketDelete. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:43:15 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDelete stored in temp store"
}
2022/01/03 11:43:20 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2022/01/03 11:43:25 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2022/01/03 11:43:30 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2022/01/03 11:43:35 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2022/01/03 11:43:35 clusterSetup.go:354: App: TestSourceBucketDelete got deployed
2022/01/03 11:43:35 handler_test.go:945: Deleting source bucket: default
2022/01/03 11:43:37 handler_test.go:947: Deleted source bucket: default
2022/01/03 11:43:42 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2022/01/03 11:43:42 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2022/01/03 11:43:57 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2022/01/03 11:43:57 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2022/01/03 11:43:57 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:43:57 eventingSetup.go:418: Function: TestSourceBucketDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDelete deleting in background"
}
2022/01/03 11:43:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:44:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:44:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:44:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceBucketDelete (78.85s)
=== RUN   TestSourceBucketDeleteWithBootstrap
2022/01/03 11:44:20 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2022/01/03 11:44:20 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2022/01/03 11:44:20 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:44:20 eventingSetup.go:418: Function: TestSourceBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceBucketDeleteWithBootstrap not found"
}
2022/01/03 11:44:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:44:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:44:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:44:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:44:33 eventingSetup.go:125: Deploying app: TestSourceBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:44:34 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDeleteWithBootstrap stored in temp store"
}
2022/01/03 11:44:53 handler_test.go:966: Deleting source bucket: default
2022/01/03 11:44:54 handler_test.go:968: Deleted source bucket: default
2022/01/03 11:45:09 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2022/01/03 11:45:09 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2022/01/03 11:45:24 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2022/01/03 11:45:24 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2022/01/03 11:45:24 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:45:25 eventingSetup.go:418: Function: TestSourceBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDeleteWithBootstrap deleting in background"
}
2022/01/03 11:45:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:45:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:45:33 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:45:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceBucketDeleteWithBootstrap (87.67s)
=== RUN   TestSourceAndMetaBucketDeleteWithBootstrap
2022/01/03 11:45:48 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2022/01/03 11:45:48 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2022/01/03 11:45:48 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:45:48 eventingSetup.go:418: Function: TestSourceAndMetaBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceAndMetaBucketDeleteWithBootstrap not found"
}
2022/01/03 11:45:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:45:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:45:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:46:01 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:46:01 eventingSetup.go:125: Deploying app: TestSourceAndMetaBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:46:02 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceAndMetaBucketDeleteWithBootstrap stored in temp store"
}
2022/01/03 11:46:21 handler_test.go:988: Deleting source bucket: default
2022/01/03 11:46:22 handler_test.go:990: Deleted source bucket: default
2022/01/03 11:46:22 handler_test.go:992: Deleting metadata bucket: eventing
2022/01/03 11:46:23 handler_test.go:994: Deleted metadata bucket: eventing
2022/01/03 11:46:38 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2022/01/03 11:46:38 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2022/01/03 11:46:53 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2022/01/03 11:46:53 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2022/01/03 11:46:53 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:46:53 eventingSetup.go:418: Function: TestSourceAndMetaBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceAndMetaBucketDeleteWithBootstrap deleting in background"
}
2022/01/03 11:46:54 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:46:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:47:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:47:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceAndMetaBucketDeleteWithBootstrap (88.11s)
=== RUN   TestUndeployDuringBootstrap
2022/01/03 11:47:16 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2022/01/03 11:47:16 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2022/01/03 11:47:16 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:47:16 eventingSetup.go:418: Function: TestUndeployDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployDuringBootstrap not found"
}
2022/01/03 11:47:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:47:22 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:47:24 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:47:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:47:29 eventingSetup.go:125: Deploying app: TestUndeployDuringBootstrap. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:47:30 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployDuringBootstrap stored in temp store"
}
2022/01/03 11:47:30 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 11:47:42 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:47:42 clusterSetup.go:375: Apps undergoing bootstrap: true
2022/01/03 11:47:42 clusterSetup.go:378: App: TestUndeployDuringBootstrap started bootstrap
2022/01/03 11:47:42 clusterSetup.go:375: Apps undergoing bootstrap: true
2022/01/03 11:47:47 clusterSetup.go:367: No apps undergoing bootstrap
2022/01/03 11:47:52 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2022/01/03 11:47:57 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2022/01/03 11:48:02 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2022/01/03 11:48:02 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2022/01/03 11:48:02 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:48:27 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2022/01/03 11:48:27 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2022/01/03 11:48:27 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:48:27 eventingSetup.go:418: Function: TestUndeployDuringBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployDuringBootstrap deleting in background"
}
2022/01/03 11:48:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:48:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 11:48:43 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/03 11:48:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:48:45 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:48:55 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3193
2022/01/03 11:48:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployDuringBootstrap (109.51s)
=== RUN   TestDeleteBeforeUndeploy
2022/01/03 11:49:00 eventingSetup.go:125: Deploying app: TestDeleteBeforeUndeploy. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:49:01 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeleteBeforeUndeploy stored in temp store"
}
2022/01/03 11:49:06 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2022/01/03 11:49:11 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2022/01/03 11:49:16 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2022/01/03 11:49:21 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2022/01/03 11:49:21 clusterSetup.go:354: App: TestDeleteBeforeUndeploy got deployed
2022/01/03 11:49:21 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 422 dump: {
 "name": "ERR_APP_NOT_UNDEPLOYED",
 "code": 22,
 "description": "Function: TestDeleteBeforeUndeploy skipping delete request as it hasn't been undeployed"
}
2022/01/03 11:49:22 eventingSetup.go:270: Function: TestDeleteBeforeUndeploy update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:49:22 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeleteBeforeUndeploy deleting in background"
}
2022/01/03 11:49:27 clusterSetup.go:397: Waiting for app: TestDeleteBeforeUndeploy to get un-deployed
2022/01/03 11:49:27 clusterSetup.go:405: App: TestDeleteBeforeUndeploy got un-deployed
2022/01/03 11:49:27 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:49:27 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeleteBeforeUndeploy not found"
}
2022/01/03 11:49:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:49:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:49:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:49:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDeleteBeforeUndeploy (44.53s)
=== RUN   TestUndeployWhenTimersAreFired
2022/01/03 11:49:50 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2022/01/03 11:49:50 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2022/01/03 11:49:50 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:49:50 eventingSetup.go:418: Function: TestUndeployWhenTimersAreFired delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployWhenTimersAreFired not found"
}
2022/01/03 11:49:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:49:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:49:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:50:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:50:03 eventingSetup.go:125: Deploying app: TestUndeployWhenTimersAreFired. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:50:04 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWhenTimersAreFired stored in temp store"
}
2022/01/03 11:50:09 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2022/01/03 11:50:14 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2022/01/03 11:50:19 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2022/01/03 11:50:24 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2022/01/03 11:50:24 clusterSetup.go:354: App: TestUndeployWhenTimersAreFired got deployed
2022/01/03 11:50:24 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 11:50:59 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2022/01/03 11:51:05 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2022/01/03 11:51:10 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2022/01/03 11:51:15 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2022/01/03 11:51:15 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2022/01/03 11:51:15 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:53:00 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2022/01/03 11:53:00 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2022/01/03 11:53:00 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:53:00 eventingSetup.go:418: Function: TestUndeployWhenTimersAreFired delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWhenTimersAreFired deleting in background"
}
2022/01/03 11:53:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:53:11 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 11:53:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 11:53:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:53:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:53:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3028
2022/01/03 11:53:33 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 528
2022/01/03 11:53:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployWhenTimersAreFired (233.10s)
=== RUN   TestUndeployWithKVFailover
2022/01/03 11:53:43 clusterSetup.go:397: Waiting for app: TestUndeployWithKVFailover to get un-deployed
2022/01/03 11:53:43 clusterSetup.go:405: App: TestUndeployWithKVFailover got un-deployed
2022/01/03 11:53:43 eventingSetup.go:46: No eventing-con process running
2022/01/03 11:53:43 eventingSetup.go:418: Function: TestUndeployWithKVFailover delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployWithKVFailover not found"
}
2022/01/03 11:53:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:53:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:53:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:53:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:53:56 eventingSetup.go:125: Deploying app: TestUndeployWithKVFailover. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:53:57 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWithKVFailover stored in temp store"
}
2022/01/03 11:53:57 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 11:54:04 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:54:09 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:54:14 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:54:19 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:54:24 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 11:54:29 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 164
2022/01/03 11:54:34 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 164
2022/01/03 11:54:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 11:54:34 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2022/01/03 11:54:34 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 11:54:39 Rebalance progress: 29.16666666666666
2022/01/03 11:54:44 Rebalance progress: 29.16666666666666
2022/01/03 11:54:49 Rebalance progress: 100
2022/01/03 11:54:49 Failing over: [127.0.0.1:19003]
2022/01/03 11:54:59 Function: TestUndeployWithKVFailover update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 11:55:59 Removing node(s): [] from the cluster
2022/01/03 11:56:04 Rebalance progress: 29.16666666666666
2022/01/03 11:56:09 Rebalance progress: 29.16666666666666
2022/01/03 11:56:14 Rebalance progress: 100
2022/01/03 11:56:19 Waiting for app: TestUndeployWithKVFailover to get un-deployed
2022/01/03 11:56:19 App: TestUndeployWithKVFailover got un-deployed
2022/01/03 11:56:19 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:56:24 Waiting for app: TestUndeployWithKVFailover to get un-deployed
2022/01/03 11:56:24 App: TestUndeployWithKVFailover got un-deployed
2022/01/03 11:56:24 No eventing-con process running
2022/01/03 11:56:25 Function: TestUndeployWithKVFailover delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWithKVFailover deleting in background"
}
2022/01/03 11:56:26 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:56:36 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 11:56:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:56:38 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:56:48 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/03 11:56:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployWithKVFailover (194.74s)
=== RUN   TestBucketFlushWhileFnDeployed
2022/01/03 11:56:58 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2022/01/03 11:56:58 App: TestBucketFlushWhileFnDeployed got un-deployed
2022/01/03 11:56:58 No eventing-con process running
2022/01/03 11:56:58 Function: TestBucketFlushWhileFnDeployed delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketFlushWhileFnDeployed not found"
}
2022/01/03 11:56:59 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:57:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:57:06 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:57:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:57:11 Deploying app: TestBucketFlushWhileFnDeployed. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:57:12 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketFlushWhileFnDeployed stored in temp store"
}
2022/01/03 11:57:17 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2022/01/03 11:57:22 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2022/01/03 11:57:27 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2022/01/03 11:57:32 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2022/01/03 11:57:32 App: TestBucketFlushWhileFnDeployed got deployed
2022/01/03 11:57:32 Starting bucket ops to source bucket
2022/01/03 11:57:52 Waiting for dst bucket item count to get to: 20000 curr count: 8266
2022/01/03 11:57:52 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2022/01/03 11:57:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:57:55 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:58:05 Waiting for dst bucket item count to get to: 0 curr count: 20000
2022/01/03 11:58:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:58:06 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:58:16 Waiting for dst bucket item count to get to: 0 curr count: 20000
2022/01/03 11:58:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:58:16 Starting bucket ops to source bucket
2022/01/03 11:58:29 Waiting for dst bucket item count to get to: 10000 curr count: 2205
2022/01/03 11:58:34 Waiting for dst bucket item count to get to: 10000 curr count: 2205
2022/01/03 11:58:34 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 11:58:34 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 11:58:40 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2022/01/03 11:58:45 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2022/01/03 11:58:50 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2022/01/03 11:58:55 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2022/01/03 11:58:55 App: TestBucketFlushWhileFnDeployed got un-deployed
2022/01/03 11:58:55 No eventing-con process running
2022/01/03 11:58:55 Function: TestBucketFlushWhileFnDeployed delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketFlushWhileFnDeployed deleting in background"
}
2022/01/03 11:58:56 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:59:06 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/03 11:59:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:59:08 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:59:18 Waiting for dst bucket item count to get to: 0 curr count: 5418
2022/01/03 11:59:23 Waiting for dst bucket item count to get to: 0 curr count: 418
2022/01/03 11:59:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBucketFlushWhileFnDeployed (155.15s)
=== RUN   TestTimerOverwrite
2022/01/03 11:59:33 Waiting for app: TestTimerOverwrite to get un-deployed
2022/01/03 11:59:33 App: TestTimerOverwrite got un-deployed
2022/01/03 11:59:33 No eventing-con process running
2022/01/03 11:59:33 Function: TestTimerOverwrite delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerOverwrite not found"
}
2022/01/03 11:59:34 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:59:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:59:41 Context: Bucket flush, response code: 200 dump: 
2022/01/03 11:59:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 11:59:46 Deploying app: TestTimerOverwrite. Item count src bucket: 0 dst bucket: 0
2022/01/03 11:59:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverwrite stored in temp store"
}
2022/01/03 11:59:52 Waiting for app: TestTimerOverwrite to get deployed
2022/01/03 11:59:57 Waiting for app: TestTimerOverwrite to get deployed
2022/01/03 12:00:02 Waiting for app: TestTimerOverwrite to get deployed
2022/01/03 12:00:07 Waiting for app: TestTimerOverwrite to get deployed
2022/01/03 12:00:07 App: TestTimerOverwrite got deployed
2022/01/03 12:00:17 Starting bucket ops to source bucket
2022/01/03 12:00:26 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 12:00:31 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 12:00:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 12:00:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 12:00:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 12:00:51 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 12:00:56 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 12:01:01 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 12:01:06 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 12:01:11 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 12:01:16 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 12:01:21 Waiting for dst bucket item count to get to: 5000 curr count: 51
2022/01/03 12:01:26 Waiting for dst bucket item count to get to: 5000 curr count: 51
2022/01/03 12:01:26 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 12:01:36 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:01:41 Waiting for app: TestTimerOverwrite to get un-deployed
2022/01/03 12:01:46 Waiting for app: TestTimerOverwrite to get un-deployed
2022/01/03 12:01:51 Waiting for app: TestTimerOverwrite to get un-deployed
2022/01/03 12:01:56 Waiting for app: TestTimerOverwrite to get un-deployed
2022/01/03 12:01:56 App: TestTimerOverwrite got un-deployed
2022/01/03 12:01:56 No eventing-con process running
2022/01/03 12:01:56 Function: TestTimerOverwrite delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverwrite deleting in background"
}
2022/01/03 12:01:57 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:02:07 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/03 12:02:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:02:09 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:02:19 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 12:02:24 Waiting for dst bucket item count to get to: 0 curr count: 2526
2022/01/03 12:02:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerOverwrite (181.45s)
=== RUN   TestUndeployBackdoorDuringBootstrap
2022/01/03 12:02:29 Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2022/01/03 12:02:29 Removing node(s): [] from the cluster
2022/01/03 12:02:34 Rebalance progress: 100
2022/01/03 12:02:34 Failing over: [127.0.0.1:19003]
2022/01/03 12:02:40 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2022/01/03 12:02:40 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2022/01/03 12:02:40 No eventing-con process running
2022/01/03 12:02:40 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployBackdoorDuringBootstrap not found"
}
2022/01/03 12:02:41 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:02:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:02:48 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:02:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:02:53 Deploying app: TestUndeployBackdoorDuringBootstrap. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:02:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployBackdoorDuringBootstrap stored in temp store"
}
2022/01/03 12:02:54 Starting bucket ops to source bucket
2022/01/03 12:03:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:03:04 Context: Post to set retry counter, response code: 200 dump: {
 "code": 0
}
2022/01/03 12:03:04 set retry counter, response &{[123 10 32 34 99 111 100 101 34 58 32 48 10 125] }
2022/01/03 12:04:09 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2022/01/03 12:04:09 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2022/01/03 12:04:09 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:04:09 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployBackdoorDuringBootstrap deleting in background"
}
2022/01/03 12:04:14 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2022/01/03 12:04:14 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2022/01/03 12:04:14 No eventing-con process running
2022/01/03 12:04:14 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployBackdoorDuringBootstrap not found"
}
2022/01/03 12:04:15 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:04:25 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 12:04:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:04:27 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:04:37 Waiting for dst bucket item count to get to: 0 curr count: 3634
2022/01/03 12:04:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:04:37 Removing node(s): [] from the cluster
2022/01/03 12:04:42 Rebalance progress: 100
--- PASS: TestUndeployBackdoorDuringBootstrap (137.80s)
=== RUN   TestOnUpdateSrcMutation
2022/01/03 12:04:52 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2022/01/03 12:04:52 App: TestOnUpdateSrcMutation got un-deployed
2022/01/03 12:04:52 No eventing-con process running
2022/01/03 12:04:52 Function: TestOnUpdateSrcMutation delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateSrcMutation not found"
}
2022/01/03 12:04:53 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:04:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:05:00 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:05:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:05:05 Deploying app: TestOnUpdateSrcMutation. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:05:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutation stored in temp store"
}
2022/01/03 12:05:06 Starting bucket ops to source bucket
2022/01/03 12:05:33 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 12:05:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:05:38 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2022/01/03 12:05:44 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2022/01/03 12:05:49 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2022/01/03 12:05:54 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2022/01/03 12:05:54 App: TestOnUpdateSrcMutation got un-deployed
2022/01/03 12:05:54 No eventing-con process running
2022/01/03 12:05:54 Function: TestOnUpdateSrcMutation delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutation deleting in background"
}
2022/01/03 12:05:55 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:06:05 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/03 12:06:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:06:07 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:06:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateSrcMutation (89.60s)
=== RUN   TestOnDeleteSrcMutation
2022/01/03 12:06:22 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2022/01/03 12:06:22 App: TestOnDeleteSrcMutation got un-deployed
2022/01/03 12:06:22 No eventing-con process running
2022/01/03 12:06:22 Function: TestOnDeleteSrcMutation delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteSrcMutation not found"
}
2022/01/03 12:06:23 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:06:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:06:30 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:06:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:06:35 Deploying app: TestOnDeleteSrcMutation. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:06:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutation stored in temp store"
}
2022/01/03 12:06:36 Starting bucket ops to source bucket
2022/01/03 12:07:04 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 12:07:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:07:10 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2022/01/03 12:07:15 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2022/01/03 12:07:20 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2022/01/03 12:07:25 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2022/01/03 12:07:25 App: TestOnDeleteSrcMutation got un-deployed
2022/01/03 12:07:25 No eventing-con process running
2022/01/03 12:07:25 Function: TestOnDeleteSrcMutation delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutation deleting in background"
}
2022/01/03 12:07:26 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:07:36 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 12:07:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:07:38 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:07:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteSrcMutation (91.12s)
=== RUN   TestOnUpdateSrcMutationWithTimer
2022/01/03 12:07:53 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2022/01/03 12:07:53 App: TestOnUpdateSrcMutationWithTimer got un-deployed
2022/01/03 12:07:53 No eventing-con process running
2022/01/03 12:07:53 Function: TestOnUpdateSrcMutationWithTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateSrcMutationWithTimer not found"
}
2022/01/03 12:07:54 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:07:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:08:01 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:08:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:08:06 Deploying app: TestOnUpdateSrcMutationWithTimer. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:08:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutationWithTimer stored in temp store"
}
2022/01/03 12:08:07 Starting bucket ops to source bucket
2022/01/03 12:08:44 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 12:08:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:08:49 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2022/01/03 12:08:54 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2022/01/03 12:08:59 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2022/01/03 12:09:04 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2022/01/03 12:09:04 App: TestOnUpdateSrcMutationWithTimer got un-deployed
2022/01/03 12:09:04 No eventing-con process running
2022/01/03 12:09:04 Function: TestOnUpdateSrcMutationWithTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutationWithTimer deleting in background"
}
2022/01/03 12:09:05 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:09:15 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/03 12:09:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:09:17 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:09:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateSrcMutationWithTimer (99.44s)
=== RUN   TestOnDeleteSrcMutationsWithTimer
2022/01/03 12:09:32 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2022/01/03 12:09:32 App: TestOnDeleteSrcMutationsWithTimer got un-deployed
2022/01/03 12:09:32 No eventing-con process running
2022/01/03 12:09:32 Function: TestOnDeleteSrcMutationsWithTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteSrcMutationsWithTimer not found"
}
2022/01/03 12:09:33 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:09:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:09:40 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:09:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:09:45 Deploying app: TestOnDeleteSrcMutationsWithTimer. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:09:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutationsWithTimer stored in temp store"
}
2022/01/03 12:09:46 Starting bucket ops to source bucket
2022/01/03 12:10:25 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 12:10:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:10:30 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2022/01/03 12:10:35 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2022/01/03 12:10:40 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2022/01/03 12:10:45 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2022/01/03 12:10:45 App: TestOnDeleteSrcMutationsWithTimer got un-deployed
2022/01/03 12:10:45 No eventing-con process running
2022/01/03 12:10:45 Function: TestOnDeleteSrcMutationsWithTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutationsWithTimer deleting in background"
}
2022/01/03 12:10:47 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:10:57 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 12:10:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:10:59 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:11:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteSrcMutationsWithTimer (101.57s)
=== RUN   TestInterHandlerRecursion
2022/01/03 12:11:14 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 12:11:14 App: TestInterHandlerRecursion_source_bucket_update_op got un-deployed
2022/01/03 12:11:14 No eventing-con process running
2022/01/03 12:11:14 Function: TestInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_source_bucket_update_op not found"
}
2022/01/03 12:11:15 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:11:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:11:22 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:11:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:11:32 Waiting for app: TestInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/03 12:11:32 App: TestInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2022/01/03 12:11:32 No eventing-con process running
2022/01/03 12:11:32 Function: TestInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2022/01/03 12:11:33 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:11:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:11:40 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:11:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:11:45 Deploying app: TestInterHandlerRecursion_source_bucket_update_op. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:11:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op stored in temp store"
}
2022/01/03 12:11:46 response body {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op stored in temp store"
} err 
2022/01/03 12:11:51 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/03 12:11:56 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/03 12:12:01 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/03 12:12:06 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/03 12:12:06 App: TestInterHandlerRecursion_source_bucket_update_op got deployed
2022/01/03 12:12:06 Deploying app: TestInterHandlerRecursion_src_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:12:06 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_FUNCTION_RECURSION",
 "code": 50,
 "description": "Inter handler recursion error"
}
2022/01/03 12:12:06 response body {
 "name": "ERR_INTER_FUNCTION_RECURSION",
 "code": 50,
 "description": "Inter handler recursion error"
} err 
2022/01/03 12:12:11 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 12:12:16 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 12:12:21 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 12:12:26 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 12:12:26 App: TestInterHandlerRecursion_source_bucket_update_op got un-deployed
2022/01/03 12:12:26 No eventing-con process running
2022/01/03 12:12:26 Function: TestInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op deleting in background"
}
2022/01/03 12:12:28 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:12:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:12:34 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:12:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:12:44 Waiting for app: TestInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/03 12:12:44 App: TestInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2022/01/03 12:12:44 No eventing-con process running
2022/01/03 12:12:44 Function: TestInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2022/01/03 12:12:46 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:12:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:12:53 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:12:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterHandlerRecursion (113.85s)
=== RUN   TestInterBucketRecursion
2022/01/03 12:13:03 Deploying app: TestInterBucketRecursion_function1. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:13:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 stored in temp store"
}
2022/01/03 12:13:04 response body {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 stored in temp store"
} err 
2022/01/03 12:13:04 Deploying app: TestInterBucketRecursion_function2. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:13:04 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestInterBucketRecursion_function2 causes a cycle involving functions: [TestInterBucketRecursion_function1], hence deployment is disallowed"
}
2022/01/03 12:13:09 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2022/01/03 12:13:14 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2022/01/03 12:13:19 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2022/01/03 12:13:24 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2022/01/03 12:13:24 App: TestInterBucketRecursion_function1 got deployed
2022/01/03 12:13:29 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2022/01/03 12:13:34 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2022/01/03 12:13:39 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2022/01/03 12:13:44 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2022/01/03 12:13:44 App: TestInterBucketRecursion_function1 got un-deployed
2022/01/03 12:13:44 No eventing-con process running
2022/01/03 12:13:44 Function: TestInterBucketRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 deleting in background"
}
2022/01/03 12:13:45 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:13:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:13:52 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:13:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:14:02 Waiting for app: TestInterBucketRecursion_function2 to get un-deployed
2022/01/03 12:14:02 App: TestInterBucketRecursion_function2 got un-deployed
2022/01/03 12:14:02 No eventing-con process running
2022/01/03 12:14:02 Function: TestInterBucketRecursion_function2 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterBucketRecursion_function2 not found"
}
2022/01/03 12:14:03 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:14:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:14:10 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:14:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterBucketRecursion (77.66s)
=== RUN   TestLargeHandler
2022/01/03 12:14:15 Changed force_compress value to false
2022/01/03 12:14:15 Deploying app: TestLargeHandler_function. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:14:15 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_APPCODE_SIZE",
 "code": 39,
 "description": "Function: TestLargeHandler_function handler Code size is more than 131072. Code Size: 131768"
}
2022/01/03 12:14:15 Changed force_compress value to true
2022/01/03 12:14:15 Deploying app: TestLargeHandler_function. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:14:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestLargeHandler_function stored in temp store"
}
2022/01/03 12:14:22 Waiting for app: TestLargeHandler_function to get deployed
2022/01/03 12:14:27 Waiting for app: TestLargeHandler_function to get deployed
2022/01/03 12:14:32 Waiting for app: TestLargeHandler_function to get deployed
2022/01/03 12:14:37 Waiting for app: TestLargeHandler_function to get deployed
2022/01/03 12:14:37 App: TestLargeHandler_function got deployed
2022/01/03 12:14:43 Waiting for app: TestLargeHandler_function to get un-deployed
2022/01/03 12:14:48 Waiting for app: TestLargeHandler_function to get un-deployed
2022/01/03 12:14:53 Waiting for app: TestLargeHandler_function to get un-deployed
2022/01/03 12:14:58 Waiting for app: TestLargeHandler_function to get un-deployed
2022/01/03 12:14:58 App: TestLargeHandler_function got un-deployed
2022/01/03 12:14:58 No eventing-con process running
2022/01/03 12:14:58 Function: TestLargeHandler_function delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestLargeHandler_function deleting in background"
}
2022/01/03 12:14:59 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:15:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:15:06 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:15:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestLargeHandler (55.35s)
=== RUN   TestAllowInterHandlerRecursion
2022/01/03 12:15:21 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 12:15:21 App: TestAllowInterHandlerRecursion_source_bucket_update_op got un-deployed
2022/01/03 12:15:21 No eventing-con process running
2022/01/03 12:15:21 Function: TestAllowInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op not found"
}
2022/01/03 12:15:22 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:15:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:15:29 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:15:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:15:39 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/03 12:15:39 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2022/01/03 12:15:39 No eventing-con process running
2022/01/03 12:15:39 Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2022/01/03 12:15:40 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:15:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:15:47 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:15:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:15:52 Deploying app: TestAllowInterHandlerRecursion_source_bucket_update_op. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:15:53 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op stored in temp store"
}
2022/01/03 12:15:53 response body {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op stored in temp store"
} err 
2022/01/03 12:15:58 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/03 12:16:03 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/03 12:16:08 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/03 12:16:13 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/03 12:16:13 App: TestAllowInterHandlerRecursion_source_bucket_update_op got deployed
2022/01/03 12:16:13 Deploying app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:16:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete stored in temp store"
}
2022/01/03 12:16:14 response body {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete stored in temp store"
} err 
2022/01/03 12:16:19 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2022/01/03 12:16:24 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2022/01/03 12:16:29 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2022/01/03 12:16:34 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2022/01/03 12:16:34 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got deployed
2022/01/03 12:16:34 TestAllowInterHandlerRecursion_src_bucket_op_on_delete is deployed
2022/01/03 12:16:39 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 12:16:44 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 12:16:49 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 12:16:54 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 12:16:55 App: TestAllowInterHandlerRecursion_source_bucket_update_op got un-deployed
2022/01/03 12:16:55 No eventing-con process running
2022/01/03 12:16:55 Function: TestAllowInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op deleting in background"
}
2022/01/03 12:16:57 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:17:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:17:04 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:17:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:17:14 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/03 12:17:19 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/03 12:17:24 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/03 12:17:29 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/03 12:17:29 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2022/01/03 12:17:29 No eventing-con process running
2022/01/03 12:17:29 Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete deleting in background"
}
2022/01/03 12:17:30 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:17:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:17:37 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:17:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAllowInterHandlerRecursion (151.35s)
=== RUN   TestAllowInterBucketRecursion
2022/01/03 12:17:47 Deploying app: TestAllowInterBucketRecursion_function1. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:17:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 stored in temp store"
}
2022/01/03 12:17:48 response body {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 stored in temp store"
} err 
2022/01/03 12:17:53 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2022/01/03 12:17:58 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2022/01/03 12:18:03 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2022/01/03 12:18:08 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2022/01/03 12:18:08 App: TestAllowInterBucketRecursion_function1 got deployed
2022/01/03 12:18:08 Deploying app: TestAllowInterBucketRecursion_function2. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:18:09 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 stored in temp store"
}
2022/01/03 12:18:09 response body {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 stored in temp store"
} err 
2022/01/03 12:18:14 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2022/01/03 12:18:19 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2022/01/03 12:18:24 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2022/01/03 12:18:29 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2022/01/03 12:18:29 App: TestAllowInterBucketRecursion_function2 got deployed
2022/01/03 12:18:29 TestAllowInterBucketRecursion_function2 is deployed
2022/01/03 12:18:35 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2022/01/03 12:18:40 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2022/01/03 12:18:45 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2022/01/03 12:18:50 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2022/01/03 12:18:50 App: TestAllowInterBucketRecursion_function1 got un-deployed
2022/01/03 12:18:50 No eventing-con process running
2022/01/03 12:18:50 Function: TestAllowInterBucketRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 deleting in background"
}
2022/01/03 12:18:51 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:18:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:18:58 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:19:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:19:09 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2022/01/03 12:19:14 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2022/01/03 12:19:19 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2022/01/03 12:19:24 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2022/01/03 12:19:24 App: TestAllowInterBucketRecursion_function2 got un-deployed
2022/01/03 12:19:24 No eventing-con process running
2022/01/03 12:19:24 Function: TestAllowInterBucketRecursion_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 deleting in background"
}
2022/01/03 12:19:25 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:19:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:19:32 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:19:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAllowInterBucketRecursion (115.00s)
=== RUN   TestInterBucketRecursion2
2022/01/03 12:19:43 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:19:49 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:19:55 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:20:01 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:20:06 Deploying app: TestInterBucketRecursion2_function1. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:20:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function1 stored in temp store"
}
2022/01/03 12:20:12 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2022/01/03 12:20:17 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2022/01/03 12:20:22 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2022/01/03 12:20:27 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2022/01/03 12:20:27 App: TestInterBucketRecursion2_function1 got deployed
2022/01/03 12:20:27 Deploying app: TestInterBucketRecursion2_function2. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:20:29 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function2 stored in temp store"
}
2022/01/03 12:20:34 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2022/01/03 12:20:39 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2022/01/03 12:20:44 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2022/01/03 12:20:49 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2022/01/03 12:20:49 App: TestInterBucketRecursion2_function2 got deployed
2022/01/03 12:20:49 Deploying app: TestInterBucketRecursion2_function3. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:20:50 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function3 stored in temp store"
}
2022/01/03 12:20:55 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2022/01/03 12:21:00 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2022/01/03 12:21:05 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2022/01/03 12:21:10 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2022/01/03 12:21:10 App: TestInterBucketRecursion2_function3 got deployed
2022/01/03 12:21:10 Deploying app: TestInterBucketRecursion2_function4. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:21:10 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestInterBucketRecursion2_function4 causes a cycle involving functions: [TestInterBucketRecursion2_function1 TestInterBucketRecursion2_function2 TestInterBucketRecursion2_function3], hence deployment is disallowed"
}
2022/01/03 12:21:15 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2022/01/03 12:21:20 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2022/01/03 12:21:25 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2022/01/03 12:21:30 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2022/01/03 12:21:30 App: TestInterBucketRecursion2_function1 got un-deployed
2022/01/03 12:21:30 No eventing-con process running
2022/01/03 12:21:30 Function: TestInterBucketRecursion2_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function1 deleting in background"
}
2022/01/03 12:21:31 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:21:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:21:38 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:21:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:21:48 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2022/01/03 12:21:53 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2022/01/03 12:21:58 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2022/01/03 12:22:03 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2022/01/03 12:22:03 App: TestInterBucketRecursion2_function2 got un-deployed
2022/01/03 12:22:03 No eventing-con process running
2022/01/03 12:22:03 Function: TestInterBucketRecursion2_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function2 deleting in background"
}
2022/01/03 12:22:05 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:22:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:22:12 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:22:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:22:22 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2022/01/03 12:22:27 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2022/01/03 12:22:32 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2022/01/03 12:22:37 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2022/01/03 12:22:37 App: TestInterBucketRecursion2_function3 got un-deployed
2022/01/03 12:22:37 No eventing-con process running
2022/01/03 12:22:37 Function: TestInterBucketRecursion2_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function3 deleting in background"
}
2022/01/03 12:22:38 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:22:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:22:45 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:22:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:22:55 Waiting for app: TestInterBucketRecursion2_function4 to get un-deployed
2022/01/03 12:22:55 App: TestInterBucketRecursion2_function4 got un-deployed
2022/01/03 12:22:55 No eventing-con process running
2022/01/03 12:22:55 Function: TestInterBucketRecursion2_function4 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterBucketRecursion2_function4 not found"
}
2022/01/03 12:22:56 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:23:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:23:03 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:23:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterBucketRecursion2 (213.15s)
=== RUN   TestBucketDeleteWithRebOut
2022/01/03 12:23:15 Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2022/01/03 12:23:20 Rebalance progress: 100

VB distribution across eventing nodes and their workers::

2022/01/03 12:23:23 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 12:23:38 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 12:23:53 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 12:24:08 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 12:24:23 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 12:24:38 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 12:24:53 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 12:25:08 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 12:25:23 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 12:25:38 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 12:25:53 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:50} {Name:#primary Bucket:hello-world Completion:100}]

DCP Stream statuses:

vbucket curr owner:


2022/01/03 12:26:08 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:26:08 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 12:26:08 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 12:26:13 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:

vbucket curr owner:


2022/01/03 12:26:14 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:26:14 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 12:26:14 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 12:26:19 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:

vbucket curr owner:


2022/01/03 12:26:19 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:26:24 clusterSetup.go:397: Waiting for app: TestBucketDeleteWithRebOut to get un-deployed
2022/01/03 12:26:24 clusterSetup.go:405: App: TestBucketDeleteWithRebOut got un-deployed
2022/01/03 12:26:24 eventingSetup.go:46: No eventing-con process running
2022/01/03 12:26:24 eventingSetup.go:418: Function: TestBucketDeleteWithRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketDeleteWithRebOut not found"
}
2022/01/03 12:26:25 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:26:30 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:26:32 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:26:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:26:42 eventingSetup.go:125: Deploying app: TestBucketDeleteWithRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:26:43 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteWithRebOut stored in temp store"
}
2022/01/03 12:26:48 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2022/01/03 12:26:53 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2022/01/03 12:26:58 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2022/01/03 12:27:03 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2022/01/03 12:27:03 clusterSetup.go:354: App: TestBucketDeleteWithRebOut got deployed

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9303	Node UUID: cd95b133223436c07acef5d0efc6c0b9
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [342-455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [456-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [570-682]
Producer node: 127.0.0.1:9302	Node UUID: edcfc9f70b745f275e2b458181f5201b
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 114
	v: [228-341]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [0-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [114-227]
Producer node: 172.31.2.134:9300	Node UUID: eba7d358554213e092d4a31eec3dccd5
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [911-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [683-796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [797-910]


2022/01/03 12:27:03 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:27:03 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 12:27:08 Rebalance progress: 29.16666666666666
2022/01/03 12:27:13 Rebalance progress: 29.16666666666666
2022/01/03 12:27:18 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: edcfc9f70b745f275e2b458181f5201b
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [0-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [114-227]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 114
	v: [228-341]
Producer node: 172.31.2.134:9300	Node UUID: eba7d358554213e092d4a31eec3dccd5
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [911-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [683-796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [797-910]
Producer node: 127.0.0.1:9303	Node UUID: cd95b133223436c07acef5d0efc6c0b9
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [342-455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [456-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [570-682]


2022/01/03 12:27:18 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:27:18 handler_test.go:1674: Deleting source bucket: default
2022/01/03 12:27:20 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 12:27:20 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 12:27:25 Rebalance progress: 29.16666666666666
2022/01/03 12:27:30 Rebalance progress: 29.16666666666666
2022/01/03 12:27:35 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 904
	vb list dump: [0-9, 11-24, 26-28, 30-35, 37-44, 46-48, 50-55, 57-58, 60-79, 81-92, 94-95, 98-112, 114-119, 121-125, 127-128, 130-157, 159-178, 180-181, 183-187, 189-196, 198, 200-209, 211-217, 219, 222-226, 228, 230-233, 235-252, 254-264, 266-276, 279-280, 282-286, 288-304, 307-312, 314-326, 328-335, 337-343, 345-355, 357-358, 360-364, 366-378, 380-385, 387-391, 394-400, 402-407, 409-411, 413-417, 419-439, 441, 443-444, 446-460, 462-467, 469-471, 473-478, 481-483, 485-488, 491-498, 500, 503, 505-509, 511-580, 582, 584-604, 606-607, 610-616, 618, 620-621, 623, 625-630, 632-667, 669-671, 673-676, 678-687, 689-692, 694-697, 699-703, 705-723, 725-739, 742-751, 753, 755-761, 763-764, 766, 768-794, 796-798, 800-824, 826-836, 838-844, 846, 848-850, 853-869, 871-887, 890, 893-901, 903, 905-915, 917-919, 921-931, 933-939, 941-947, 949-950, 952-959, 961-967, 971-982, 984-1020, 1022-1023]
	stream status: stopped
	len: 120
	vb list dump: [10, 25, 29, 36, 45, 49, 56, 59, 80, 93, 96-97, 113, 120, 126, 129, 158, 179, 182, 188, 197, 199, 210, 218, 220-221, 227, 229, 234, 253, 265, 277-278, 281, 287, 305-306, 313, 327, 336, 344, 356, 359, 365, 379, 386, 392-393, 401, 408, 412, 418, 440, 442, 445, 461, 468, 472, 479-480, 484, 489-490, 499, 501-502, 504, 510, 581, 583, 605, 608-609, 617, 619, 622, 624, 631, 668, 672, 677, 688, 693, 698, 704, 724, 740-741, 752, 754, 762, 765, 767, 795, 799, 825, 837, 845, 847, 851-852, 870, 888-889, 891-892, 902, 904, 916, 920, 932, 940, 948, 951, 960, 968-970, 983, 1021]

vbucket curr owner:
Producer node: 172.31.2.134:9300	Node UUID: eba7d358554213e092d4a31eec3dccd5
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 101
	v: [911-915, 917-919, 921-931, 933-939, 941-947, 949-950, 952-959, 961-967, 971-982, 984-1020, 1022-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 101
	v: [683-687, 689-692, 694-697, 699-703, 705-723, 725-739, 742-751, 753, 755-761, 763-764, 766, 768-794, 796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 100
	v: [797-798, 800-824, 826-836, 838-844, 846, 848-850, 853-869, 871-887, 890, 893-901, 903, 905-910]
Producer node: 127.0.0.1:9303	Node UUID: cd95b133223436c07acef5d0efc6c0b9
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 99
	v: [342-343, 345-355, 357-358, 360-364, 366-378, 380-385, 387-391, 394-400, 402-407, 409-411, 413-417, 419-439, 441, 443-444, 446-455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 101
	v: [456-460, 462-467, 469-471, 473-478, 481-483, 485-488, 491-498, 500, 503, 505-509, 511-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 100
	v: [570-580, 582, 584-604, 606-607, 610-616, 618, 620-621, 623, 625-630, 632-667, 669-671, 673-676, 678-682]
Producer node: 127.0.0.1:9302	Node UUID: edcfc9f70b745f275e2b458181f5201b
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 101
	v: [0-9, 11-24, 26-28, 30-35, 37-44, 46-48, 50-55, 57-58, 60-79, 81-92, 94-95, 98-112]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 100
	v: [114-119, 121-125, 127-128, 130-157, 159-178, 180-181, 183-187, 189-196, 198, 200-209, 211-217, 219, 222-226]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 101
	v: [228, 230-233, 235-252, 254-264, 266-276, 279-280, 282-286, 288-304, 307-312, 314-326, 328-335, 337-341]


2022/01/03 12:27:36 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:27:41 eventingSetup.go:719: Waiting for function: TestBucketDeleteWithRebOut status to change to undeployed
2022/01/03 12:27:41 eventingSetup.go:727: Function: TestBucketDeleteWithRebOut status changed to undeployed
2022/01/03 12:27:46 clusterSetup.go:397: Waiting for app: TestBucketDeleteWithRebOut to get un-deployed
2022/01/03 12:27:46 clusterSetup.go:405: App: TestBucketDeleteWithRebOut got un-deployed
2022/01/03 12:27:46 eventingSetup.go:46: No eventing-con process running
2022/01/03 12:27:46 eventingSetup.go:418: Function: TestBucketDeleteWithRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteWithRebOut deleting in background"
}
2022/01/03 12:27:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:27:52 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:27:54 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:27:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:27:59 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2022/01/03 12:27:59 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 12:28:04 Rebalance progress: 100
--- PASS: TestBucketDeleteWithRebOut (296.74s)
=== RUN   TestN1QLRecursion
2022/01/03 12:28:07 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 12:28:07 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2022/01/03 12:28:07 Removing node(s): [] from the cluster
2022/01/03 12:28:12 Rebalance progress: 100
2022/01/03 12:28:18 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:28:25 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:28:30 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:28:35 Deploying app: TestN1QLRecursion_function1. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:28:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 stored in temp store"
}
2022/01/03 12:28:37 response body {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 stored in temp store"
} err 
2022/01/03 12:28:42 Waiting for app: TestN1QLRecursion_function1 to get deployed
2022/01/03 12:28:47 Waiting for app: TestN1QLRecursion_function1 to get deployed
2022/01/03 12:28:52 Waiting for app: TestN1QLRecursion_function1 to get deployed
2022/01/03 12:28:57 Waiting for app: TestN1QLRecursion_function1 to get deployed
2022/01/03 12:28:57 App: TestN1QLRecursion_function1 got deployed
2022/01/03 12:28:57 TestN1QLRecursion_function1 is deployed
2022/01/03 12:28:57 Deploying app: TestN1QLRecursion_function3. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:28:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 stored in temp store"
}
2022/01/03 12:28:58 response body {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 stored in temp store"
} err 
2022/01/03 12:29:03 Waiting for app: TestN1QLRecursion_function3 to get deployed
2022/01/03 12:29:08 Waiting for app: TestN1QLRecursion_function3 to get deployed
2022/01/03 12:29:13 Waiting for app: TestN1QLRecursion_function3 to get deployed
2022/01/03 12:29:18 Waiting for app: TestN1QLRecursion_function3 to get deployed
2022/01/03 12:29:18 App: TestN1QLRecursion_function3 got deployed
2022/01/03 12:29:18 TestN1QLRecursion_function3 is deployed
2022/01/03 12:29:18 Deploying app: TestN1QLRecursion_function2. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:29:18 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestN1QLRecursion_function2 causes a cycle involving functions: [TestN1QLRecursion_function3 TestN1QLRecursion_function1], hence deployment is disallowed"
}
2022/01/03 12:29:18 response body {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestN1QLRecursion_function2 causes a cycle involving functions: [TestN1QLRecursion_function3 TestN1QLRecursion_function1], hence deployment is disallowed"
} err 
2022/01/03 12:29:18 Success: TestN1QLRecursion_function2 is not deployed
2022/01/03 12:29:23 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2022/01/03 12:29:28 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2022/01/03 12:29:33 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2022/01/03 12:29:38 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2022/01/03 12:29:38 App: TestN1QLRecursion_function1 got un-deployed
2022/01/03 12:29:38 No eventing-con process running
2022/01/03 12:29:38 Function: TestN1QLRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 deleting in background"
}
2022/01/03 12:29:40 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:29:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:29:47 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:29:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:29:57 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2022/01/03 12:30:02 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2022/01/03 12:30:07 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2022/01/03 12:30:12 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2022/01/03 12:30:12 App: TestN1QLRecursion_function3 got un-deployed
2022/01/03 12:30:12 No eventing-con process running
2022/01/03 12:30:12 Function: TestN1QLRecursion_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 deleting in background"
}
2022/01/03 12:30:14 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:30:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:30:21 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:30:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:30:27 Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/03 12:30:32 Rebalance progress: 100
--- PASS: TestN1QLRecursion (145.67s)
=== RUN   TestN1QLAllowRecursion
2022/01/03 12:30:32 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 12:30:33 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2022/01/03 12:30:33 Removing node(s): [] from the cluster
2022/01/03 12:30:38 Rebalance progress: 100
2022/01/03 12:30:44 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:30:50 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:30:56 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:31:01 Deploying app: TestN1QLAllowRecursion_function1. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:31:02 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 stored in temp store"
}
2022/01/03 12:31:02 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 stored in temp store"
} err 
2022/01/03 12:31:07 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2022/01/03 12:31:12 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2022/01/03 12:31:17 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2022/01/03 12:31:22 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2022/01/03 12:31:22 App: TestN1QLAllowRecursion_function1 got deployed
2022/01/03 12:31:22 TestN1QLAllowRecursion_function1 is deployed
2022/01/03 12:31:22 Deploying app: TestN1QLAllowRecursion_function3. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:31:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 stored in temp store"
}
2022/01/03 12:31:23 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 stored in temp store"
} err 
2022/01/03 12:31:28 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2022/01/03 12:31:34 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2022/01/03 12:31:39 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2022/01/03 12:31:44 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2022/01/03 12:31:44 App: TestN1QLAllowRecursion_function3 got deployed
2022/01/03 12:31:44 TestN1QLAllowRecursion_function3 is deployed
2022/01/03 12:31:44 Deploying app: TestN1QLAllowRecursion_function2. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:31:45 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 stored in temp store"
}
2022/01/03 12:31:45 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 stored in temp store"
} err 
2022/01/03 12:31:50 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2022/01/03 12:31:55 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2022/01/03 12:32:00 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2022/01/03 12:32:05 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2022/01/03 12:32:05 App: TestN1QLAllowRecursion_function2 got deployed
2022/01/03 12:32:05 Success: TestN1QLAllowRecursion_function2 is deployed after allow_interbucket_recursion
2022/01/03 12:32:10 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2022/01/03 12:32:15 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2022/01/03 12:32:20 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2022/01/03 12:32:25 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2022/01/03 12:32:25 App: TestN1QLAllowRecursion_function1 got un-deployed
2022/01/03 12:32:25 No eventing-con process running
2022/01/03 12:32:25 Function: TestN1QLAllowRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 deleting in background"
}
2022/01/03 12:32:27 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:32:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:32:34 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:32:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:32:44 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2022/01/03 12:32:49 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2022/01/03 12:32:54 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2022/01/03 12:32:59 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2022/01/03 12:32:59 App: TestN1QLAllowRecursion_function2 got un-deployed
2022/01/03 12:32:59 No eventing-con process running
2022/01/03 12:32:59 Function: TestN1QLAllowRecursion_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 deleting in background"
}
2022/01/03 12:33:01 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:33:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:33:08 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:33:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:33:18 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2022/01/03 12:33:23 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2022/01/03 12:33:28 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2022/01/03 12:33:33 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2022/01/03 12:33:33 App: TestN1QLAllowRecursion_function3 got un-deployed
2022/01/03 12:33:33 No eventing-con process running
2022/01/03 12:33:33 Function: TestN1QLAllowRecursion_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 deleting in background"
}
2022/01/03 12:33:35 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:33:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:33:42 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:33:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:33:48 Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/03 12:33:53 Rebalance progress: 100
--- PASS: TestN1QLAllowRecursion (200.78s)
=== RUN   TestOnDeleteExpiryBucketOp
2022/01/03 12:33:53 Sleeping for some time
2022/01/03 12:34:03 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2022/01/03 12:34:03 App: TestOnDeleteExpiryBucketOp got un-deployed
2022/01/03 12:34:03 No eventing-con process running
2022/01/03 12:34:03 Function: TestOnDeleteExpiryBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteExpiryBucketOp not found"
}
2022/01/03 12:34:05 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:34:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:34:12 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:34:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:34:17 Deploying app: TestOnDeleteExpiryBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:34:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteExpiryBucketOp stored in temp store"
}
2022/01/03 12:34:18 Starting bucket ops to source bucket
2022/01/03 12:35:07 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 12:35:12 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 12:35:17 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2022/01/03 12:35:17 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 12:35:17 Starting bucket ops to source bucket
2022/01/03 12:35:18 Starting bucket ops to source bucket
2022/01/03 12:36:24 Waiting for dst bucket item count to get to: 7000 curr count: 5000
2022/01/03 12:36:29 Waiting for dst bucket item count to get to: 7000 curr count: 6000
2022/01/03 12:36:29 src & dst bucket item count matched up. src bucket count: 7000 dst bucket count: 7000
2022/01/03 12:36:29 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:36:34 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2022/01/03 12:36:39 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2022/01/03 12:36:44 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2022/01/03 12:36:49 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2022/01/03 12:36:49 App: TestOnDeleteExpiryBucketOp got un-deployed
2022/01/03 12:36:49 No eventing-con process running
2022/01/03 12:36:50 Function: TestOnDeleteExpiryBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteExpiryBucketOp deleting in background"
}
2022/01/03 12:36:51 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:37:01 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/03 12:37:06 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/03 12:37:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:37:08 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:37:18 Waiting for dst bucket item count to get to: 0 curr count: 5109
2022/01/03 12:37:23 Waiting for dst bucket item count to get to: 0 curr count: 1609
2022/01/03 12:37:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteExpiryBucketOp (209.85s)
=== RUN   TestTimerOverWriteSameReference
2022/01/03 12:37:28 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2022/01/03 12:37:28 App: TestTimerOverWriteSameReference got un-deployed
2022/01/03 12:37:28 No eventing-con process running
2022/01/03 12:37:28 Function: TestTimerOverWriteSameReference delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerOverWriteSameReference not found"
}
2022/01/03 12:37:30 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:37:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:37:37 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:37:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:37:42 Deploying app: TestTimerOverWriteSameReference. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:37:43 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverWriteSameReference stored in temp store"
}
2022/01/03 12:37:48 Waiting for app: TestTimerOverWriteSameReference to get deployed
2022/01/03 12:37:53 Waiting for app: TestTimerOverWriteSameReference to get deployed
2022/01/03 12:37:58 Waiting for app: TestTimerOverWriteSameReference to get deployed
2022/01/03 12:38:03 Waiting for app: TestTimerOverWriteSameReference to get deployed
2022/01/03 12:38:03 App: TestTimerOverWriteSameReference got deployed
2022/01/03 12:38:13 Starting bucket ops to source bucket
2022/01/03 12:39:14 src & dst bucket item count matched up. src bucket count: 1 dst bucket count: 1
2022/01/03 12:39:24 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:39:29 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2022/01/03 12:39:34 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2022/01/03 12:39:39 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2022/01/03 12:39:44 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2022/01/03 12:39:44 App: TestTimerOverWriteSameReference got un-deployed
2022/01/03 12:39:44 No eventing-con process running
2022/01/03 12:39:44 Function: TestTimerOverWriteSameReference delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverWriteSameReference deleting in background"
}
2022/01/03 12:39:46 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:39:56 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/03 12:39:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:39:58 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:40:08 Waiting for dst bucket item count to get to: 0 curr count: 1
2022/01/03 12:40:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerOverWriteSameReference (164.95s)
=== RUN   TestCancelTimerBucketop
2022/01/03 12:40:13 Waiting for app: TestCancelTimerBucketop to get un-deployed
2022/01/03 12:40:13 App: TestCancelTimerBucketop got un-deployed
2022/01/03 12:40:13 No eventing-con process running
2022/01/03 12:40:13 Function: TestCancelTimerBucketop delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCancelTimerBucketop not found"
}
2022/01/03 12:40:15 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:40:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:40:22 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:40:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:40:27 Deploying app: TestCancelTimerBucketop. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:40:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCancelTimerBucketop stored in temp store"
}
2022/01/03 12:40:33 Waiting for app: TestCancelTimerBucketop to get deployed
2022/01/03 12:40:38 Waiting for app: TestCancelTimerBucketop to get deployed
2022/01/03 12:40:43 Waiting for app: TestCancelTimerBucketop to get deployed
2022/01/03 12:40:48 Waiting for app: TestCancelTimerBucketop to get deployed
2022/01/03 12:40:48 App: TestCancelTimerBucketop got deployed
2022/01/03 12:40:48 Starting bucket ops to source bucket
2022/01/03 12:40:55 Starting bucket ops to source bucket
2022/01/03 12:41:57 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2022/01/03 12:41:57 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:42:02 Waiting for app: TestCancelTimerBucketop to get un-deployed
2022/01/03 12:42:08 Waiting for app: TestCancelTimerBucketop to get un-deployed
2022/01/03 12:42:13 Waiting for app: TestCancelTimerBucketop to get un-deployed
2022/01/03 12:42:18 Waiting for app: TestCancelTimerBucketop to get un-deployed
2022/01/03 12:42:18 App: TestCancelTimerBucketop got un-deployed
2022/01/03 12:42:18 No eventing-con process running
2022/01/03 12:42:18 Function: TestCancelTimerBucketop delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCancelTimerBucketop deleting in background"
}
2022/01/03 12:42:20 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:42:30 Waiting for dst bucket item count to get to: 0 curr count: 500
2022/01/03 12:42:35 Waiting for dst bucket item count to get to: 0 curr count: 500
2022/01/03 12:42:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:42:36 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:42:46 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/03 12:42:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCancelTimerBucketop (158.25s)
=== RUN   TestJSExpiryDate
2022/01/03 12:42:51 Starting bucket ops to source bucket
2022/01/03 12:43:04 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 12:43:04 Deploying app: TestJSExpiryDate. Item count src bucket: 5000 dst bucket: 0
2022/01/03 12:43:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestJSExpiryDate stored in temp store"
}
2022/01/03 12:43:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:43:36 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:43:41 Waiting for app: TestJSExpiryDate to get un-deployed
2022/01/03 12:43:46 Waiting for app: TestJSExpiryDate to get un-deployed
2022/01/03 12:43:51 Waiting for app: TestJSExpiryDate to get un-deployed
2022/01/03 12:43:56 Waiting for app: TestJSExpiryDate to get un-deployed
2022/01/03 12:43:56 App: TestJSExpiryDate got un-deployed
2022/01/03 12:43:56 No eventing-con process running
2022/01/03 12:43:56 Function: TestJSExpiryDate delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestJSExpiryDate deleting in background"
}
2022/01/03 12:43:58 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:44:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:44:05 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:44:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestJSExpiryDate (83.78s)
=== RUN   TestBinaryDoc
2022/01/03 12:44:15 Starting bucket ops to source bucket
2022/01/03 12:44:15 Deploying app: TestBinaryDoc. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:44:16 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBinaryDoc stored in temp store"
}
2022/01/03 12:44:16 Starting bucket ops to source bucket
2022/01/03 12:44:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:44:16 Deleting source bucket docs now
2022/01/03 12:44:16 Starting bucket ops to source bucket
2022/01/03 12:44:54 Waiting for dst bucket item count to get to: 32 curr count: 21
2022/01/03 12:44:59 Waiting for dst bucket item count to get to: 32 curr count: 31
2022/01/03 12:45:04 Waiting for dst bucket item count to get to: 32 curr count: 31
2022/01/03 12:45:04 src & dst bucket item count matched up. src bucket count: 32 dst bucket count: 32
2022/01/03 12:45:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:45:09 Waiting for app: TestBinaryDoc to get un-deployed
2022/01/03 12:45:14 Waiting for app: TestBinaryDoc to get un-deployed
2022/01/03 12:45:19 Waiting for app: TestBinaryDoc to get un-deployed
2022/01/03 12:45:24 Waiting for app: TestBinaryDoc to get un-deployed
2022/01/03 12:45:24 App: TestBinaryDoc got un-deployed
2022/01/03 12:45:24 No eventing-con process running
2022/01/03 12:45:24 Function: TestBinaryDoc delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBinaryDoc deleting in background"
}
2022/01/03 12:45:26 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:45:36 Waiting for dst bucket item count to get to: 0 curr count: 32
2022/01/03 12:45:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:45:37 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:45:47 Waiting for dst bucket item count to get to: 0 curr count: 16
2022/01/03 12:45:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBinaryDoc (97.38s)
=== RUN   TestConstantBindings
2022/01/03 12:45:47 Deploying app: TestConstantBindings. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:45:49 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestConstantBindings stored in temp store"
}
2022/01/03 12:45:49 Starting bucket ops to source bucket
2022/01/03 12:45:54 Waiting for dst bucket item count to get to: 6000 curr count: 0
2022/01/03 12:45:59 Waiting for dst bucket item count to get to: 6000 curr count: 0
2022/01/03 12:46:04 Waiting for dst bucket item count to get to: 6000 curr count: 0
2022/01/03 12:46:09 Waiting for dst bucket item count to get to: 6000 curr count: 0
2022/01/03 12:46:14 Waiting for dst bucket item count to get to: 6000 curr count: 3000
2022/01/03 12:46:14 src & dst bucket item count matched up. src bucket count: 6000 dst bucket count: 6000
2022/01/03 12:46:14 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:46:19 Waiting for app: TestConstantBindings to get un-deployed
2022/01/03 12:46:25 Waiting for app: TestConstantBindings to get un-deployed
2022/01/03 12:46:30 Waiting for app: TestConstantBindings to get un-deployed
2022/01/03 12:46:35 Waiting for app: TestConstantBindings to get un-deployed
2022/01/03 12:46:35 App: TestConstantBindings got un-deployed
2022/01/03 12:46:35 No eventing-con process running
2022/01/03 12:46:35 Function: TestConstantBindings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestConstantBindings deleting in background"
}
2022/01/03 12:46:36 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:46:46 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/03 12:46:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:46:48 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:46:58 Waiting for dst bucket item count to get to: 0 curr count: 4550
2022/01/03 12:47:03 Waiting for dst bucket item count to get to: 0 curr count: 1550
2022/01/03 12:47:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestConstantBindings (75.73s)
=== RUN   TestCodeInsight
2022/01/03 12:47:08 Waiting for app: TestCodeInsight to get un-deployed
2022/01/03 12:47:08 App: TestCodeInsight got un-deployed
2022/01/03 12:47:08 No eventing-con process running
2022/01/03 12:47:08 Function: TestCodeInsight delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCodeInsight not found"
}
2022/01/03 12:47:10 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:47:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:47:17 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:47:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:47:22 Starting bucket ops to source bucket
2022/01/03 12:47:22 Deploying app: TestCodeInsight. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:47:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCodeInsight stored in temp store"
}
2022/01/03 12:47:29 Waiting for app: TestCodeInsight to get deployed
2022/01/03 12:47:34 Waiting for app: TestCodeInsight to get deployed
2022/01/03 12:47:39 Waiting for app: TestCodeInsight to get deployed
2022/01/03 12:47:44 Waiting for app: TestCodeInsight to get deployed
2022/01/03 12:47:44 App: TestCodeInsight got deployed
2022/01/03 12:47:44 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2022/01/03 12:47:49 Waiting for app: TestCodeInsight to get un-deployed
2022/01/03 12:47:54 Waiting for app: TestCodeInsight to get un-deployed
2022/01/03 12:47:59 Waiting for app: TestCodeInsight to get un-deployed
2022/01/03 12:48:04 Waiting for app: TestCodeInsight to get un-deployed
2022/01/03 12:48:04 App: TestCodeInsight got un-deployed
2022/01/03 12:48:04 No eventing-con process running
2022/01/03 12:48:04 Function: TestCodeInsight delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCodeInsight deleting in background"
}
2022/01/03 12:48:06 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:48:16 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/03 12:48:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:48:18 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:48:28 Waiting for dst bucket item count to get to: 0 curr count: 500
2022/01/03 12:48:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCodeInsight (84.43s)
=== RUN   TestParserTransform
--- PASS: TestParserTransform (0.05s)
=== RUN   TestParserDetect
--- PASS: TestParserDetect (0.00s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	12898.154s

Functional tests took 3 hours, 35 minutes and 10 seconds.

N1ql tests

2022/01/03 12:48:37 Started n1ql
Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:34162->127.0.0.1:9000: read: connection reset by peer
Quota setup Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:34162->127.0.0.1:9000: read: connection reset by peer
2022/01/03 12:48:48 Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2022/01/03 12:48:49 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2022/01/03 12:48:49 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 12:48:49 Removing node(s): [] from the cluster
2022/01/03 12:48:54 Rebalance progress: 100
=== RUN   TestRecursiveMutationN1QL
2022/01/03 12:48:59 Waiting for app: TestRecursiveMutationN1QL to get un-deployed
2022/01/03 12:48:59 App: TestRecursiveMutationN1QL got un-deployed
2022/01/03 12:48:59 No eventing-con process running
2022/01/03 12:48:59 Function: TestRecursiveMutationN1QL delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestRecursiveMutationN1QL not found"
}
2022/01/03 12:49:01 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:49:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:49:08 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:49:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:49:13 Deploying app: TestRecursiveMutationN1QL. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:49:13 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Function: TestRecursiveMutationN1QL N1QL DML to source keyspace default:default"
}
--- PASS: TestRecursiveMutationN1QL (18.48s)
=== RUN   TestFlexReset1
2022/01/03 12:49:18 Waiting for app: TestFlexReset1 to get un-deployed
2022/01/03 12:49:18 App: TestFlexReset1 got un-deployed
2022/01/03 12:49:18 No eventing-con process running
2022/01/03 12:49:18 Function: TestFlexReset1 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestFlexReset1 not found"
}
2022/01/03 12:49:19 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:49:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:49:26 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:49:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:49:31 Starting bucket ops to source bucket
2022/01/03 12:49:32 Deploying app: TestFlexReset1. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:49:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset1 stored in temp store"
}
2022/01/03 12:49:38 Waiting for app: TestFlexReset1 to get deployed
2022/01/03 12:49:43 Waiting for app: TestFlexReset1 to get deployed
2022/01/03 12:49:48 Waiting for app: TestFlexReset1 to get deployed
2022/01/03 12:49:53 Waiting for app: TestFlexReset1 to get deployed
2022/01/03 12:49:53 App: TestFlexReset1 got deployed
2022/01/03 12:49:58 Waiting for dst bucket item count to get to: 1000 curr count: 885
2022/01/03 12:50:03 Waiting for dst bucket item count to get to: 1000 curr count: 885
2022/01/03 12:50:03 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2022/01/03 12:50:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:50:08 Waiting for app: TestFlexReset1 to get un-deployed
2022/01/03 12:50:13 Waiting for app: TestFlexReset1 to get un-deployed
2022/01/03 12:50:18 Waiting for app: TestFlexReset1 to get un-deployed
2022/01/03 12:50:18 App: TestFlexReset1 got un-deployed
2022/01/03 12:50:18 No eventing-con process running
2022/01/03 12:50:18 Function: TestFlexReset1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset1 deleting in background"
}
2022/01/03 12:50:20 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:50:30 Waiting for dst bucket item count to get to: 0 curr count: 685
2022/01/03 12:50:35 Waiting for dst bucket item count to get to: 0 curr count: 685
2022/01/03 12:50:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:50:37 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:50:47 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/03 12:50:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestFlexReset1 (94.29s)
=== RUN   TestFlexReset2
2022/01/03 12:50:52 Waiting for app: TestFlexReset2 to get un-deployed
2022/01/03 12:50:52 App: TestFlexReset2 got un-deployed
2022/01/03 12:50:52 No eventing-con process running
2022/01/03 12:50:52 Function: TestFlexReset2 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestFlexReset2 not found"
}
2022/01/03 12:50:54 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:50:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:51:00 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:51:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:51:05 Starting bucket ops to source bucket
2022/01/03 12:51:06 Deploying app: TestFlexReset2. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:51:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset2 stored in temp store"
}
2022/01/03 12:51:12 Waiting for app: TestFlexReset2 to get deployed
2022/01/03 12:51:17 Waiting for app: TestFlexReset2 to get deployed
2022/01/03 12:51:22 Waiting for app: TestFlexReset2 to get deployed
2022/01/03 12:51:27 Waiting for app: TestFlexReset2 to get deployed
2022/01/03 12:51:27 App: TestFlexReset2 got deployed
2022/01/03 12:51:32 Waiting for dst bucket item count to get to: 1000 curr count: 33
2022/01/03 12:51:32 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2022/01/03 12:51:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:51:37 Waiting for app: TestFlexReset2 to get un-deployed
2022/01/03 12:51:43 Waiting for app: TestFlexReset2 to get un-deployed
2022/01/03 12:51:48 Waiting for app: TestFlexReset2 to get un-deployed
2022/01/03 12:51:53 Waiting for app: TestFlexReset2 to get un-deployed
2022/01/03 12:51:53 App: TestFlexReset2 got un-deployed
2022/01/03 12:51:53 No eventing-con process running
2022/01/03 12:51:53 Function: TestFlexReset2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset2 deleting in background"
}
2022/01/03 12:51:55 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:52:05 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/03 12:52:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:52:06 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:52:16 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/03 12:52:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestFlexReset2 (89.35s)
=== RUN   TestN1QLLabelledBreak
2022/01/03 12:52:21 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2022/01/03 12:52:21 App: TestN1QLLabelledBreak got un-deployed
2022/01/03 12:52:21 No eventing-con process running
2022/01/03 12:52:21 Function: TestN1QLLabelledBreak delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLLabelledBreak not found"
}
2022/01/03 12:52:23 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:52:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:52:30 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:52:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:52:35 Deploying app: TestN1QLLabelledBreak. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:52:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLLabelledBreak stored in temp store"
}
2022/01/03 12:52:41 Waiting for app: TestN1QLLabelledBreak to get deployed
2022/01/03 12:52:46 Waiting for app: TestN1QLLabelledBreak to get deployed
2022/01/03 12:52:51 Waiting for app: TestN1QLLabelledBreak to get deployed
2022/01/03 12:52:56 Waiting for app: TestN1QLLabelledBreak to get deployed
2022/01/03 12:52:56 App: TestN1QLLabelledBreak got deployed
2022/01/03 12:52:56 Starting bucket ops to source bucket
2022/01/03 12:53:05 Waiting for dst bucket item count to get to: 10000 curr count: 0
2022/01/03 12:53:10 Waiting for dst bucket item count to get to: 10000 curr count: 303
2022/01/03 12:53:15 Waiting for dst bucket item count to get to: 10000 curr count: 303
2022/01/03 12:53:20 Waiting for dst bucket item count to get to: 10000 curr count: 3784
2022/01/03 12:53:25 Waiting for dst bucket item count to get to: 10000 curr count: 3784
2022/01/03 12:53:30 Waiting for dst bucket item count to get to: 10000 curr count: 7875
2022/01/03 12:53:35 Waiting for dst bucket item count to get to: 10000 curr count: 7875
2022/01/03 12:53:35 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 12:53:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:53:41 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2022/01/03 12:53:46 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2022/01/03 12:53:51 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2022/01/03 12:53:56 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2022/01/03 12:53:56 App: TestN1QLLabelledBreak got un-deployed
2022/01/03 12:53:56 No eventing-con process running
2022/01/03 12:53:56 Function: TestN1QLLabelledBreak delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLLabelledBreak deleting in background"
}
2022/01/03 12:53:58 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:54:08 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/03 12:54:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:54:09 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:54:19 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 12:54:24 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 12:54:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLLabelledBreak (128.13s)
=== RUN   TestN1QLUnlabelledBreak
2022/01/03 12:54:29 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2022/01/03 12:54:29 App: TestN1QLUnlabelledBreak got un-deployed
2022/01/03 12:54:29 No eventing-con process running
2022/01/03 12:54:29 Function: TestN1QLUnlabelledBreak delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLUnlabelledBreak not found"
}
2022/01/03 12:54:31 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:54:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:54:38 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:54:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:54:43 Deploying app: TestN1QLUnlabelledBreak. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:54:44 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLUnlabelledBreak stored in temp store"
}
2022/01/03 12:54:49 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2022/01/03 12:54:54 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2022/01/03 12:54:59 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2022/01/03 12:55:04 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2022/01/03 12:55:04 App: TestN1QLUnlabelledBreak got deployed
2022/01/03 12:55:04 Starting bucket ops to source bucket
2022/01/03 12:55:14 Waiting for dst bucket item count to get to: 10000 curr count: 329
2022/01/03 12:55:19 Waiting for dst bucket item count to get to: 10000 curr count: 329
2022/01/03 12:55:24 Waiting for dst bucket item count to get to: 10000 curr count: 999
2022/01/03 12:55:29 Waiting for dst bucket item count to get to: 10000 curr count: 3653
2022/01/03 12:55:34 Waiting for dst bucket item count to get to: 10000 curr count: 6577
2022/01/03 12:55:39 Waiting for dst bucket item count to get to: 10000 curr count: 8594
2022/01/03 12:55:39 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 12:55:39 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:55:44 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2022/01/03 12:55:49 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2022/01/03 12:55:54 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2022/01/03 12:55:59 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2022/01/03 12:55:59 App: TestN1QLUnlabelledBreak got un-deployed
2022/01/03 12:55:59 No eventing-con process running
2022/01/03 12:55:59 Function: TestN1QLUnlabelledBreak delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLUnlabelledBreak deleting in background"
}
2022/01/03 12:56:01 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:56:11 Waiting for dst bucket item count to get to: 0 curr count: 4585
2022/01/03 12:56:16 Waiting for dst bucket item count to get to: 0 curr count: 4585
2022/01/03 12:56:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:56:18 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:56:28 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 12:56:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLUnlabelledBreak (123.14s)
=== RUN   TestN1QLThrowStatement
2022/01/03 12:56:33 Waiting for app: TestN1QLThrowStatement to get un-deployed
2022/01/03 12:56:33 App: TestN1QLThrowStatement got un-deployed
2022/01/03 12:56:33 No eventing-con process running
2022/01/03 12:56:33 Function: TestN1QLThrowStatement delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLThrowStatement not found"
}
2022/01/03 12:56:34 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:56:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:56:41 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:56:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:56:46 Deploying app: TestN1QLThrowStatement. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:56:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLThrowStatement stored in temp store"
}
2022/01/03 12:56:52 Waiting for app: TestN1QLThrowStatement to get deployed
2022/01/03 12:56:57 Waiting for app: TestN1QLThrowStatement to get deployed
2022/01/03 12:57:02 Waiting for app: TestN1QLThrowStatement to get deployed
2022/01/03 12:57:07 Waiting for app: TestN1QLThrowStatement to get deployed
2022/01/03 12:57:07 App: TestN1QLThrowStatement got deployed
2022/01/03 12:57:07 Starting bucket ops to source bucket
2022/01/03 12:57:17 Waiting for dst bucket item count to get to: 10000 curr count: 130
2022/01/03 12:57:22 Waiting for dst bucket item count to get to: 10000 curr count: 130
2022/01/03 12:57:27 Waiting for dst bucket item count to get to: 10000 curr count: 130
2022/01/03 12:57:32 Waiting for dst bucket item count to get to: 10000 curr count: 3173
2022/01/03 12:57:37 Waiting for dst bucket item count to get to: 10000 curr count: 3173
2022/01/03 12:57:42 Waiting for dst bucket item count to get to: 10000 curr count: 7244
2022/01/03 12:57:47 Waiting for dst bucket item count to get to: 10000 curr count: 7244
2022/01/03 12:57:47 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 12:57:47 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 12:57:52 Waiting for app: TestN1QLThrowStatement to get un-deployed
2022/01/03 12:57:57 Waiting for app: TestN1QLThrowStatement to get un-deployed
2022/01/03 12:58:02 Waiting for app: TestN1QLThrowStatement to get un-deployed
2022/01/03 12:58:07 Waiting for app: TestN1QLThrowStatement to get un-deployed
2022/01/03 12:58:07 App: TestN1QLThrowStatement got un-deployed
2022/01/03 12:58:07 No eventing-con process running
2022/01/03 12:58:07 Function: TestN1QLThrowStatement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLThrowStatement deleting in background"
}
2022/01/03 12:58:09 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:58:19 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 12:58:24 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/03 12:58:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:58:26 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:58:36 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/03 12:58:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLThrowStatement (128.18s)
=== RUN   TestN1QLNestedForLoop
2022/01/03 12:58:41 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2022/01/03 12:58:41 App: TestN1QLNestedForLoop got un-deployed
2022/01/03 12:58:41 No eventing-con process running
2022/01/03 12:58:41 Function: TestN1QLNestedForLoop delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLNestedForLoop not found"
}
2022/01/03 12:58:43 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:58:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:58:49 Context: Bucket flush, response code: 200 dump: 
2022/01/03 12:58:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 12:58:54 Deploying app: TestN1QLNestedForLoop. Item count src bucket: 0 dst bucket: 0
2022/01/03 12:58:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLNestedForLoop stored in temp store"
}
2022/01/03 12:59:01 Waiting for app: TestN1QLNestedForLoop to get deployed
2022/01/03 12:59:06 Waiting for app: TestN1QLNestedForLoop to get deployed
2022/01/03 12:59:11 Waiting for app: TestN1QLNestedForLoop to get deployed
2022/01/03 12:59:16 Waiting for app: TestN1QLNestedForLoop to get deployed
2022/01/03 12:59:16 App: TestN1QLNestedForLoop got deployed
2022/01/03 12:59:16 Starting bucket ops to source bucket
2022/01/03 12:59:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 12:59:30 Waiting for dst bucket item count to get to: 5000 curr count: 190
2022/01/03 12:59:35 Waiting for dst bucket item count to get to: 5000 curr count: 190
2022/01/03 12:59:40 Waiting for dst bucket item count to get to: 5000 curr count: 2313
2022/01/03 12:59:45 Waiting for dst bucket item count to get to: 5000 curr count: 2313
2022/01/03 12:59:50 Waiting for dst bucket item count to get to: 5000 curr count: 4738
2022/01/03 12:59:55 Waiting for dst bucket item count to get to: 5000 curr count: 4738
2022/01/03 12:59:55 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 12:59:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 13:00:00 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2022/01/03 13:00:05 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2022/01/03 13:00:10 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2022/01/03 13:00:15 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2022/01/03 13:00:15 App: TestN1QLNestedForLoop got un-deployed
2022/01/03 13:00:15 No eventing-con process running
2022/01/03 13:00:15 Function: TestN1QLNestedForLoop delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLNestedForLoop deleting in background"
}
2022/01/03 13:00:17 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:00:27 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 13:00:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:00:29 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:00:39 Waiting for dst bucket item count to get to: 0 curr count: 4896
2022/01/03 13:00:44 Waiting for dst bucket item count to get to: 0 curr count: 2396
2022/01/03 13:00:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLNestedForLoop (128.07s)
=== RUN   TestN1QLAutoClose
2022/01/03 13:00:49 Waiting for app: TestN1QLAutoClose to get un-deployed
2022/01/03 13:00:49 App: TestN1QLAutoClose got un-deployed
2022/01/03 13:00:49 No eventing-con process running
2022/01/03 13:00:49 Function: TestN1QLAutoClose delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLAutoClose not found"
}
2022/01/03 13:00:51 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:00:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:00:57 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:01:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:01:02 Deploying app: TestN1QLAutoClose. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:01:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAutoClose stored in temp store"
}
2022/01/03 13:01:09 Waiting for app: TestN1QLAutoClose to get deployed
2022/01/03 13:01:14 Waiting for app: TestN1QLAutoClose to get deployed
2022/01/03 13:01:19 Waiting for app: TestN1QLAutoClose to get deployed
2022/01/03 13:01:24 Waiting for app: TestN1QLAutoClose to get deployed
2022/01/03 13:01:24 App: TestN1QLAutoClose got deployed
2022/01/03 13:01:24 Starting bucket ops to source bucket
2022/01/03 13:01:29 Waiting for dst bucket item count to get to: 500 curr count: 0
2022/01/03 13:01:34 Waiting for dst bucket item count to get to: 500 curr count: 4
2022/01/03 13:01:39 Waiting for dst bucket item count to get to: 500 curr count: 9
2022/01/03 13:01:44 Waiting for dst bucket item count to get to: 500 curr count: 18
2022/01/03 13:01:49 Waiting for dst bucket item count to get to: 500 curr count: 30
2022/01/03 13:01:54 Waiting for dst bucket item count to get to: 500 curr count: 40
2022/01/03 13:01:59 Waiting for dst bucket item count to get to: 500 curr count: 51
2022/01/03 13:02:04 Waiting for dst bucket item count to get to: 500 curr count: 62
2022/01/03 13:02:09 Waiting for dst bucket item count to get to: 500 curr count: 74
2022/01/03 13:02:14 Waiting for dst bucket item count to get to: 500 curr count: 85
2022/01/03 13:02:19 Waiting for dst bucket item count to get to: 500 curr count: 95
2022/01/03 13:02:24 Waiting for dst bucket item count to get to: 500 curr count: 104
2022/01/03 13:02:29 Waiting for dst bucket item count to get to: 500 curr count: 116
2022/01/03 13:02:34 Waiting for dst bucket item count to get to: 500 curr count: 125
2022/01/03 13:02:39 Waiting for dst bucket item count to get to: 500 curr count: 125
2022/01/03 13:02:44 Waiting for dst bucket item count to get to: 500 curr count: 137
2022/01/03 13:02:49 Waiting for dst bucket item count to get to: 500 curr count: 147
2022/01/03 13:02:54 Waiting for dst bucket item count to get to: 500 curr count: 158
2022/01/03 13:02:59 Waiting for dst bucket item count to get to: 500 curr count: 181
2022/01/03 13:03:04 Waiting for dst bucket item count to get to: 500 curr count: 181
2022/01/03 13:03:09 Waiting for dst bucket item count to get to: 500 curr count: 202
2022/01/03 13:03:14 Waiting for dst bucket item count to get to: 500 curr count: 202
2022/01/03 13:03:19 Waiting for dst bucket item count to get to: 500 curr count: 225
2022/01/03 13:03:24 Waiting for dst bucket item count to get to: 500 curr count: 225
2022/01/03 13:03:29 Waiting for dst bucket item count to get to: 500 curr count: 245
2022/01/03 13:03:34 Waiting for dst bucket item count to get to: 500 curr count: 245
2022/01/03 13:03:39 Waiting for dst bucket item count to get to: 500 curr count: 266
2022/01/03 13:03:44 Waiting for dst bucket item count to get to: 500 curr count: 266
2022/01/03 13:03:49 Waiting for dst bucket item count to get to: 500 curr count: 288
2022/01/03 13:03:54 Waiting for dst bucket item count to get to: 500 curr count: 288
2022/01/03 13:03:59 Waiting for dst bucket item count to get to: 500 curr count: 309
2022/01/03 13:04:04 Waiting for dst bucket item count to get to: 500 curr count: 309
2022/01/03 13:04:09 Waiting for dst bucket item count to get to: 500 curr count: 330
2022/01/03 13:04:14 Waiting for dst bucket item count to get to: 500 curr count: 330
2022/01/03 13:04:19 Waiting for dst bucket item count to get to: 500 curr count: 353
2022/01/03 13:04:25 Waiting for dst bucket item count to get to: 500 curr count: 353
2022/01/03 13:04:30 Waiting for dst bucket item count to get to: 500 curr count: 371
2022/01/03 13:04:35 Waiting for dst bucket item count to get to: 500 curr count: 371
2022/01/03 13:04:40 Waiting for dst bucket item count to get to: 500 curr count: 393
2022/01/03 13:04:45 Waiting for dst bucket item count to get to: 500 curr count: 393
2022/01/03 13:04:50 Waiting for dst bucket item count to get to: 500 curr count: 415
2022/01/03 13:04:55 Waiting for dst bucket item count to get to: 500 curr count: 415
2022/01/03 13:05:00 Waiting for dst bucket item count to get to: 500 curr count: 437
2022/01/03 13:05:05 Waiting for dst bucket item count to get to: 500 curr count: 437
2022/01/03 13:05:10 Waiting for dst bucket item count to get to: 500 curr count: 459
2022/01/03 13:05:15 Waiting for dst bucket item count to get to: 500 curr count: 469
2022/01/03 13:05:20 Waiting for dst bucket item count to get to: 500 curr count: 481
2022/01/03 13:05:25 Waiting for dst bucket item count to get to: 500 curr count: 491
2022/01/03 13:05:30 Waiting for dst bucket item count to get to: 500 curr count: 499
2022/01/03 13:05:30 src & dst bucket item count matched up. src bucket count: 500 dst bucket count: 500
2022/01/03 13:05:30 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 13:05:35 Waiting for app: TestN1QLAutoClose to get un-deployed
2022/01/03 13:05:40 Waiting for app: TestN1QLAutoClose to get un-deployed
2022/01/03 13:05:45 Waiting for app: TestN1QLAutoClose to get un-deployed
2022/01/03 13:05:50 Waiting for app: TestN1QLAutoClose to get un-deployed
2022/01/03 13:05:50 App: TestN1QLAutoClose got un-deployed
2022/01/03 13:05:50 No eventing-con process running
2022/01/03 13:05:50 Function: TestN1QLAutoClose delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAutoClose deleting in background"
}
2022/01/03 13:05:52 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:06:02 Waiting for dst bucket item count to get to: 0 curr count: 500
2022/01/03 13:06:07 Waiting for dst bucket item count to get to: 0 curr count: 500
2022/01/03 13:06:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:06:08 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:06:18 Waiting for dst bucket item count to get to: 0 curr count: 421
2022/01/03 13:06:23 Waiting for dst bucket item count to get to: 0 curr count: 171
2022/01/03 13:06:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLAutoClose (339.65s)
=== RUN   TestN1QLPosParams
2022/01/03 13:06:28 Waiting for app: TestN1QLPosParams to get un-deployed
2022/01/03 13:06:28 App: TestN1QLPosParams got un-deployed
2022/01/03 13:06:28 No eventing-con process running
2022/01/03 13:06:28 Function: TestN1QLPosParams delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLPosParams not found"
}
2022/01/03 13:06:30 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:06:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:06:37 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:06:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:06:42 Deploying app: TestN1QLPosParams. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:06:43 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLPosParams stored in temp store"
}
2022/01/03 13:06:48 Waiting for app: TestN1QLPosParams to get deployed
2022/01/03 13:06:53 Waiting for app: TestN1QLPosParams to get deployed
2022/01/03 13:06:58 Waiting for app: TestN1QLPosParams to get deployed
2022/01/03 13:07:03 Waiting for app: TestN1QLPosParams to get deployed
2022/01/03 13:07:03 App: TestN1QLPosParams got deployed
2022/01/03 13:07:03 Starting bucket ops to source bucket
2022/01/03 13:07:13 Waiting for dst bucket item count to get to: 5000 curr count: 623
2022/01/03 13:07:18 Waiting for dst bucket item count to get to: 5000 curr count: 623
2022/01/03 13:07:23 Waiting for dst bucket item count to get to: 5000 curr count: 1944
2022/01/03 13:07:28 Waiting for dst bucket item count to get to: 5000 curr count: 3821
2022/01/03 13:07:28 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 13:07:28 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 13:07:33 Waiting for app: TestN1QLPosParams to get un-deployed
2022/01/03 13:07:38 Waiting for app: TestN1QLPosParams to get un-deployed
2022/01/03 13:07:43 Waiting for app: TestN1QLPosParams to get un-deployed
2022/01/03 13:07:48 Waiting for app: TestN1QLPosParams to get un-deployed
2022/01/03 13:07:48 App: TestN1QLPosParams got un-deployed
2022/01/03 13:07:48 No eventing-con process running
2022/01/03 13:07:48 Function: TestN1QLPosParams delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLPosParams deleting in background"
}
2022/01/03 13:07:50 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:08:00 Waiting for dst bucket item count to get to: 0 curr count: 2840
2022/01/03 13:08:05 Waiting for dst bucket item count to get to: 0 curr count: 2840
2022/01/03 13:08:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:08:07 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:08:17 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 13:08:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLPosParams (113.16s)
=== RUN   TestN1QLExhaustConnPool
2022/01/03 13:08:22 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2022/01/03 13:08:22 App: TestN1QLExhaustConnPool got un-deployed
2022/01/03 13:08:22 No eventing-con process running
2022/01/03 13:08:22 Function: TestN1QLExhaustConnPool delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLExhaustConnPool not found"
}
2022/01/03 13:08:23 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:08:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:08:30 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:08:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:08:35 Deploying app: TestN1QLExhaustConnPool. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:08:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLExhaustConnPool stored in temp store"
}
2022/01/03 13:08:41 Waiting for app: TestN1QLExhaustConnPool to get deployed
2022/01/03 13:08:46 Waiting for app: TestN1QLExhaustConnPool to get deployed
2022/01/03 13:08:51 Waiting for app: TestN1QLExhaustConnPool to get deployed
2022/01/03 13:08:56 Waiting for app: TestN1QLExhaustConnPool to get deployed
2022/01/03 13:08:56 App: TestN1QLExhaustConnPool got deployed
2022/01/03 13:08:56 Starting bucket ops to source bucket
2022/01/03 13:09:02 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 13:09:07 Waiting for dst bucket item count to get to: 100 curr count: 56
2022/01/03 13:09:12 Waiting for dst bucket item count to get to: 100 curr count: 56
2022/01/03 13:09:12 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 13:09:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 13:09:17 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2022/01/03 13:09:22 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2022/01/03 13:09:27 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2022/01/03 13:09:32 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2022/01/03 13:09:32 App: TestN1QLExhaustConnPool got un-deployed
2022/01/03 13:09:32 No eventing-con process running
2022/01/03 13:09:32 Function: TestN1QLExhaustConnPool delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLExhaustConnPool deleting in background"
}
2022/01/03 13:09:34 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:09:44 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 13:09:49 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 13:09:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:09:50 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:10:00 Waiting for dst bucket item count to get to: 0 curr count: 80
2022/01/03 13:10:05 Waiting for dst bucket item count to get to: 0 curr count: 80
2022/01/03 13:10:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLExhaustConnPool (108.82s)
=== RUN   TestN1QLGraceSufficientTimeOut
2022/01/03 13:10:10 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2022/01/03 13:10:10 App: TestN1QLGraceSufficientTimeOut got un-deployed
2022/01/03 13:10:10 No eventing-con process running
2022/01/03 13:10:10 Function: TestN1QLGraceSufficientTimeOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLGraceSufficientTimeOut not found"
}
2022/01/03 13:10:12 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:10:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:10:19 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:10:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:10:24 Starting bucket ops to source bucket
2022/01/03 13:10:41 Starting bucket ops to source bucket
2022/01/03 13:10:58 Deploying app: TestN1QLGraceSufficientTimeOut. Item count src bucket: 30000 dst bucket: 12476
2022/01/03 13:11:00 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLGraceSufficientTimeOut stored in temp store"
}
2022/01/03 13:11:05 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2022/01/03 13:11:10 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2022/01/03 13:11:15 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2022/01/03 13:11:20 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2022/01/03 13:11:20 App: TestN1QLGraceSufficientTimeOut got deployed
2022/01/03 13:11:20 Starting bucket ops to source bucket
2022/01/03 13:11:25 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 13:11:30 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 13:11:35 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 13:11:40 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 13:11:45 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 13:11:50 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 13:11:55 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 13:12:00 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 13:12:05 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 13:12:10 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 13:12:15 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 13:12:15 src & dst bucket item count matched up. src bucket count: 30001 dst bucket count: 30001
2022/01/03 13:12:15 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 13:12:20 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2022/01/03 13:12:25 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2022/01/03 13:12:30 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2022/01/03 13:12:35 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2022/01/03 13:12:35 App: TestN1QLGraceSufficientTimeOut got un-deployed
2022/01/03 13:12:35 No eventing-con process running
2022/01/03 13:12:35 Function: TestN1QLGraceSufficientTimeOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLGraceSufficientTimeOut deleting in background"
}
2022/01/03 13:12:37 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:12:47 Waiting for dst bucket item count to get to: 0 curr count: 30000
2022/01/03 13:12:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:12:49 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:12:59 Waiting for dst bucket item count to get to: 0 curr count: 27638
2022/01/03 13:13:04 Waiting for dst bucket item count to get to: 0 curr count: 12638
2022/01/03 13:13:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLGraceSufficientTimeOut (178.30s)
=== RUN   TestN1QLQueryConsistency
2022/01/03 13:13:09 Waiting for app: n1qlquery_consistency to get un-deployed
2022/01/03 13:13:09 App: n1qlquery_consistency got un-deployed
2022/01/03 13:13:09 No eventing-con process running
2022/01/03 13:13:09 Function: n1qlquery_consistency delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: n1qlquery_consistency not found"
}
2022/01/03 13:13:11 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:13:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:13:17 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:13:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:13:22 Starting bucket ops to source bucket
2022/01/03 13:13:25 Deploying app: n1qlquery_consistency. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:13:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: n1qlquery_consistency stored in temp store"
}
2022/01/03 13:13:31 Waiting for app: n1qlquery_consistency to get deployed
2022/01/03 13:13:36 Waiting for app: n1qlquery_consistency to get deployed
2022/01/03 13:13:41 Waiting for app: n1qlquery_consistency to get deployed
2022/01/03 13:13:47 Waiting for app: n1qlquery_consistency to get deployed
2022/01/03 13:13:47 App: n1qlquery_consistency got deployed
2022/01/03 13:13:52 Waiting for dst bucket item count to get to: 5000 curr count: 191
2022/01/03 13:13:57 Waiting for dst bucket item count to get to: 5000 curr count: 2691
2022/01/03 13:13:57 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 13:13:57 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 13:14:02 Waiting for app: n1qlquery_consistency to get un-deployed
2022/01/03 13:14:07 Waiting for app: n1qlquery_consistency to get un-deployed
2022/01/03 13:14:12 Waiting for app: n1qlquery_consistency to get un-deployed
2022/01/03 13:14:17 Waiting for app: n1qlquery_consistency to get un-deployed
2022/01/03 13:14:17 App: n1qlquery_consistency got un-deployed
2022/01/03 13:14:17 No eventing-con process running
2022/01/03 13:14:17 Function: n1qlquery_consistency delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: n1qlquery_consistency deleting in background"
}
2022/01/03 13:14:19 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:14:29 Waiting for dst bucket item count to get to: 0 curr count: 4608
2022/01/03 13:14:34 Waiting for dst bucket item count to get to: 0 curr count: 2108
2022/01/03 13:14:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:14:36 Context: Bucket flush, response code: 200 dump: 
2022/01/03 13:14:46 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 13:14:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLQueryConsistency (101.76s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	1563.919s

N1ql tests took 0 hours, 26 minutes and 9 seconds.

Starting server
Starting server: attempt 1

Rebalance tests

2022/01/03 13:16:21 Started rebalance
Post "http://127.0.0.1:9000/pools/default": EOF
Quota setup Post "http://127.0.0.1:9000/pools/default": EOF
=== RUN   TestDuplicateWithEventingRebIn
2022/01/03 13:16:39 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
running apps fetch error json: cannot unmarshal number into Go value of type string
2022/01/03 13:16:44 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/01/03 13:16:44 App: TestDuplicateWithEventingRebIn got un-deployed
2022/01/03 13:16:44 No eventing-con process running
2022/01/03 13:16:44 Function: TestDuplicateWithEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingRebIn not found"
}
2022/01/03 13:16:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:16:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:16:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:16:52 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:16:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:16:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:17:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:17:02 Deploying app: TestDuplicateWithEventingRebIn. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:17:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebIn stored in temp store"
}
2022/01/03 13:17:09 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2022/01/03 13:17:14 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2022/01/03 13:17:19 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2022/01/03 13:17:24 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2022/01/03 13:17:24 App: TestDuplicateWithEventingRebIn got deployed
2022/01/03 13:17:24 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 13:17:24 Starting bucket ops to source bucket
2022/01/03 13:17:38 Removing node(s): [] from the cluster
2022/01/03 13:17:43 Rebalance progress: 0
2022/01/03 13:17:48 Rebalance progress: 0
2022/01/03 13:17:53 Rebalance progress: 25
2022/01/03 13:17:58 Rebalance progress: 25
2022/01/03 13:18:03 Rebalance progress: 25
2022/01/03 13:18:08 Rebalance progress: 97.91666666666667
2022/01/03 13:18:13 Rebalance progress: 100
2022/01/03 13:18:18 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:18:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:18:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:18:18 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2022/01/03 13:18:18 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 13:18:18 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 13:18:23 Rebalance progress: 25
2022/01/03 13:18:28 Rebalance progress: 25
2022/01/03 13:18:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:18:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:18:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:18:33 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2022/01/03 13:18:33 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 13:18:33 Waiting for src bucket item count to get to: 200000 curr count: 92165
2022/01/03 13:18:38 Waiting for src bucket item count to get to: 200000 curr count: 109115
2022/01/03 13:18:43 Waiting for src bucket item count to get to: 200000 curr count: 109115
2022/01/03 13:18:48 Waiting for src bucket item count to get to: 200000 curr count: 126026
2022/01/03 13:18:53 Waiting for src bucket item count to get to: 200000 curr count: 126026
2022/01/03 13:18:58 Waiting for src bucket item count to get to: 200000 curr count: 143046
2022/01/03 13:19:03 Waiting for src bucket item count to get to: 200000 curr count: 143046
2022/01/03 13:19:08 Waiting for src bucket item count to get to: 200000 curr count: 159947
2022/01/03 13:19:13 Waiting for src bucket item count to get to: 200000 curr count: 176868
2022/01/03 13:19:18 Waiting for src bucket item count to get to: 200000 curr count: 176868
2022/01/03 13:19:23 Waiting for src bucket item count to get to: 200000 curr count: 193837
2022/01/03 13:19:28 Waiting for src bucket item count to get to: 200000 curr count: 193837
2022/01/03 13:19:33 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 13:19:33 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 13:19:38 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/01/03 13:19:43 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/01/03 13:19:48 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/01/03 13:19:53 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/01/03 13:19:53 App: TestDuplicateWithEventingRebIn got un-deployed
2022/01/03 13:19:53 No eventing-con process running
2022/01/03 13:19:53 Function: TestDuplicateWithEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebIn deleting in background"
}
2022/01/03 13:19:55 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:20:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:20:05 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/03 13:20:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:20:07 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:20:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:20:17 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/03 13:20:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingRebIn (227.71s)
=== RUN   TestDuplicateWithEventingRebOut
2022/01/03 13:20:22 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 13:20:22 Removing node(s): [] from the cluster
2022/01/03 13:20:27 Rebalance progress: 100
2022/01/03 13:20:32 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/01/03 13:20:32 App: TestDuplicateWithEventingRebOut got un-deployed
2022/01/03 13:20:32 No eventing-con process running
2022/01/03 13:20:32 Function: TestDuplicateWithEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingRebOut not found"
}
2022/01/03 13:20:34 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:20:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:20:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:20:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:20:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:20:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:20:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:20:50 Deploying app: TestDuplicateWithEventingRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:20:52 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebOut stored in temp store"
}
2022/01/03 13:20:57 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2022/01/03 13:21:02 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2022/01/03 13:21:07 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2022/01/03 13:21:12 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2022/01/03 13:21:12 App: TestDuplicateWithEventingRebOut got deployed
2022/01/03 13:21:12 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 13:21:12 Starting bucket ops to source bucket
2022/01/03 13:21:17 Rebalance progress: 25
2022/01/03 13:21:22 Rebalance progress: 25
2022/01/03 13:21:27 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:21:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:21:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:21:27 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2022/01/03 13:21:27 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 13:21:27 Waiting for src bucket item count to get to: 200000 curr count: 12093
2022/01/03 13:21:32 Waiting for src bucket item count to get to: 200000 curr count: 28535
2022/01/03 13:21:37 Waiting for src bucket item count to get to: 200000 curr count: 28535
2022/01/03 13:21:42 Waiting for src bucket item count to get to: 200000 curr count: 45208
2022/01/03 13:21:47 Waiting for src bucket item count to get to: 200000 curr count: 45208
2022/01/03 13:21:52 Waiting for src bucket item count to get to: 200000 curr count: 61845
2022/01/03 13:21:57 Waiting for src bucket item count to get to: 200000 curr count: 61845
2022/01/03 13:22:02 Waiting for src bucket item count to get to: 200000 curr count: 61845
2022/01/03 13:22:07 Waiting for src bucket item count to get to: 200000 curr count: 78110
2022/01/03 13:22:12 Waiting for src bucket item count to get to: 200000 curr count: 78110
2022/01/03 13:22:17 Waiting for src bucket item count to get to: 200000 curr count: 94359
2022/01/03 13:22:22 Waiting for src bucket item count to get to: 200000 curr count: 94359
2022/01/03 13:22:27 Waiting for src bucket item count to get to: 200000 curr count: 111081
2022/01/03 13:22:32 Waiting for src bucket item count to get to: 200000 curr count: 111081
2022/01/03 13:22:37 Waiting for src bucket item count to get to: 200000 curr count: 127831
2022/01/03 13:22:42 Waiting for src bucket item count to get to: 200000 curr count: 127831
2022/01/03 13:22:47 Waiting for src bucket item count to get to: 200000 curr count: 144448
2022/01/03 13:22:52 Waiting for src bucket item count to get to: 200000 curr count: 144448
2022/01/03 13:22:57 Waiting for src bucket item count to get to: 200000 curr count: 160936
2022/01/03 13:23:02 Waiting for src bucket item count to get to: 200000 curr count: 160936
2022/01/03 13:23:07 Waiting for src bucket item count to get to: 200000 curr count: 177075
2022/01/03 13:23:12 Waiting for src bucket item count to get to: 200000 curr count: 177075
2022/01/03 13:23:17 Waiting for src bucket item count to get to: 200000 curr count: 193434
2022/01/03 13:23:22 Waiting for src bucket item count to get to: 200000 curr count: 193434
2022/01/03 13:23:27 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 13:23:27 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 13:23:32 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/01/03 13:23:37 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/01/03 13:23:42 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/01/03 13:23:47 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/01/03 13:23:47 App: TestDuplicateWithEventingRebOut got un-deployed
2022/01/03 13:23:47 No eventing-con process running
2022/01/03 13:23:47 Function: TestDuplicateWithEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebOut deleting in background"
}
2022/01/03 13:23:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:23:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:23:59 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/03 13:23:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:24:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:24:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:24:10 Waiting for dst bucket item count to get to: 0 curr count: 106533
2022/01/03 13:24:15 Waiting for dst bucket item count to get to: 0 curr count: 106533
2022/01/03 13:24:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingRebOut (238.74s)
=== RUN   TestDuplicateWithEventingSwapReb
2022/01/03 13:24:25 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/01/03 13:24:26 App: TestDuplicateWithEventingSwapReb got un-deployed
2022/01/03 13:24:26 No eventing-con process running
2022/01/03 13:24:26 Function: TestDuplicateWithEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingSwapReb not found"
}
2022/01/03 13:24:27 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:24:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:24:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:24:34 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:24:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:24:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:24:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:24:44 Deploying app: TestDuplicateWithEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:24:45 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingSwapReb stored in temp store"
}
2022/01/03 13:24:50 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2022/01/03 13:24:55 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2022/01/03 13:25:00 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2022/01/03 13:25:05 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2022/01/03 13:25:05 App: TestDuplicateWithEventingSwapReb got deployed
2022/01/03 13:25:05 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 13:25:05 Starting bucket ops to source bucket
2022/01/03 13:25:06 Removing node(s): [] from the cluster
2022/01/03 13:25:11 Rebalance progress: 25
2022/01/03 13:25:16 Rebalance progress: 25
2022/01/03 13:25:21 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:25:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:25:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:25:21 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2022/01/03 13:25:21 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 13:25:21 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 13:25:28 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 13:25:33 Rebalance progress: 16.66666666666667
2022/01/03 13:25:38 Rebalance progress: 16.66666666666667
2022/01/03 13:25:43 Rebalance progress: 16.66666666666667
2022/01/03 13:25:48 Rebalance progress: 16.66666666666667
2022/01/03 13:25:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:25:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:25:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:25:53 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 13:25:53 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 13:25:58 Rebalance progress: 16.66666666666667
2022/01/03 13:26:03 Rebalance progress: 16.66666666666667
2022/01/03 13:26:08 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:26:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:26:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:26:08 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 13:26:08 Waiting for src bucket item count to get to: 200000 curr count: 81740
2022/01/03 13:26:13 Waiting for src bucket item count to get to: 200000 curr count: 98407
2022/01/03 13:26:18 Waiting for src bucket item count to get to: 200000 curr count: 98407
2022/01/03 13:26:23 Waiting for src bucket item count to get to: 200000 curr count: 115060
2022/01/03 13:26:28 Waiting for src bucket item count to get to: 200000 curr count: 115060
2022/01/03 13:26:33 Waiting for src bucket item count to get to: 200000 curr count: 131470
2022/01/03 13:26:38 Waiting for src bucket item count to get to: 200000 curr count: 131470
2022/01/03 13:26:43 Waiting for src bucket item count to get to: 200000 curr count: 148099
2022/01/03 13:26:48 Waiting for src bucket item count to get to: 200000 curr count: 148099
2022/01/03 13:26:53 Waiting for src bucket item count to get to: 200000 curr count: 164662
2022/01/03 13:26:58 Waiting for src bucket item count to get to: 200000 curr count: 164662
2022/01/03 13:27:03 Waiting for src bucket item count to get to: 200000 curr count: 180776
2022/01/03 13:27:08 Waiting for src bucket item count to get to: 200000 curr count: 180776
2022/01/03 13:27:13 Waiting for src bucket item count to get to: 200000 curr count: 197713
2022/01/03 13:27:18 Waiting for src bucket item count to get to: 200000 curr count: 197713
2022/01/03 13:27:23 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 13:27:23 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 13:27:28 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/01/03 13:27:33 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/01/03 13:27:38 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/01/03 13:27:43 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/01/03 13:27:43 App: TestDuplicateWithEventingSwapReb got un-deployed
2022/01/03 13:27:43 No eventing-con process running
2022/01/03 13:27:43 Function: TestDuplicateWithEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingSwapReb deleting in background"
}
2022/01/03 13:27:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:27:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:27:55 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/03 13:27:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:27:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:28:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:28:07 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/03 13:28:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingSwapReb (231.20s)
=== RUN   TestDuplicateWithKVRebIn
2022/01/03 13:28:17 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/01/03 13:28:17 App: TestDuplicateWithKVRebIn got un-deployed
2022/01/03 13:28:17 No eventing-con process running
2022/01/03 13:28:17 Function: TestDuplicateWithKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVRebIn not found"
}
2022/01/03 13:28:18 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:28:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:28:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:28:25 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:28:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:28:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:28:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:28:35 Deploying app: TestDuplicateWithKVRebIn. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:28:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebIn stored in temp store"
}
2022/01/03 13:28:41 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2022/01/03 13:28:46 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2022/01/03 13:28:51 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2022/01/03 13:28:56 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2022/01/03 13:28:56 App: TestDuplicateWithKVRebIn got deployed
2022/01/03 13:28:56 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 13:28:56 Starting bucket ops to source bucket
2022/01/03 13:28:57 Removing node(s): [] from the cluster
2022/01/03 13:29:02 Rebalance progress: 16.66666666666667
2022/01/03 13:29:07 Rebalance progress: 16.66666666666667
2022/01/03 13:29:12 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:29:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:29:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:29:12 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 13:29:12 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 13:29:17 Rebalance progress: 16.66666666666667
2022/01/03 13:29:22 Rebalance progress: 16.66666666666667
2022/01/03 13:29:27 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:29:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:29:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:29:27 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 13:29:27 Waiting for src bucket item count to get to: 200000 curr count: 36165
2022/01/03 13:29:32 Waiting for src bucket item count to get to: 200000 curr count: 52165
2022/01/03 13:29:37 Waiting for src bucket item count to get to: 200000 curr count: 52165
2022/01/03 13:29:42 Waiting for src bucket item count to get to: 200000 curr count: 68341
2022/01/03 13:29:47 Waiting for src bucket item count to get to: 200000 curr count: 68341
2022/01/03 13:29:52 Waiting for src bucket item count to get to: 200000 curr count: 83518
2022/01/03 13:29:57 Waiting for src bucket item count to get to: 200000 curr count: 83518
2022/01/03 13:30:02 Waiting for src bucket item count to get to: 200000 curr count: 99887
2022/01/03 13:30:07 Waiting for src bucket item count to get to: 200000 curr count: 99887
2022/01/03 13:30:12 Waiting for src bucket item count to get to: 200000 curr count: 116189
2022/01/03 13:30:17 Waiting for src bucket item count to get to: 200000 curr count: 116189
2022/01/03 13:30:22 Waiting for src bucket item count to get to: 200000 curr count: 132762
2022/01/03 13:30:27 Waiting for src bucket item count to get to: 200000 curr count: 132762
2022/01/03 13:30:32 Waiting for src bucket item count to get to: 200000 curr count: 149619
2022/01/03 13:30:37 Waiting for src bucket item count to get to: 200000 curr count: 149619
2022/01/03 13:30:42 Waiting for src bucket item count to get to: 200000 curr count: 149619
2022/01/03 13:30:47 Waiting for src bucket item count to get to: 200000 curr count: 165873
2022/01/03 13:30:52 Waiting for src bucket item count to get to: 200000 curr count: 165873
2022/01/03 13:30:57 Waiting for src bucket item count to get to: 200000 curr count: 181223
2022/01/03 13:31:02 Waiting for src bucket item count to get to: 200000 curr count: 181223
2022/01/03 13:31:07 Waiting for src bucket item count to get to: 200000 curr count: 197569
2022/01/03 13:31:12 Waiting for src bucket item count to get to: 200000 curr count: 197569
2022/01/03 13:31:17 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 13:31:17 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 13:31:23 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/01/03 13:31:28 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/01/03 13:31:33 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/01/03 13:31:38 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/01/03 13:31:38 App: TestDuplicateWithKVRebIn got un-deployed
2022/01/03 13:31:38 No eventing-con process running
2022/01/03 13:31:38 Function: TestDuplicateWithKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebIn deleting in background"
}
2022/01/03 13:31:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:31:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:31:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:31:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:31:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:31:56 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/03 13:31:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVRebIn (229.48s)
=== RUN   TestDuplicateWithKVRebOut
2022/01/03 13:32:01 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 13:32:01 Removing node(s): [] from the cluster
2022/01/03 13:32:06 Rebalance progress: 100
2022/01/03 13:32:11 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/01/03 13:32:11 App: TestDuplicateWithKVRebOut got un-deployed
2022/01/03 13:32:11 No eventing-con process running
2022/01/03 13:32:11 Function: TestDuplicateWithKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVRebOut not found"
}
2022/01/03 13:32:13 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:32:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:32:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:32:20 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:32:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:32:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:32:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:32:30 Deploying app: TestDuplicateWithKVRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:32:31 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebOut stored in temp store"
}
2022/01/03 13:32:36 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2022/01/03 13:32:41 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2022/01/03 13:32:46 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2022/01/03 13:32:51 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2022/01/03 13:32:51 App: TestDuplicateWithKVRebOut got deployed
2022/01/03 13:32:51 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 13:32:51 Starting bucket ops to source bucket
2022/01/03 13:32:56 Rebalance progress: 16.66666666666667
2022/01/03 13:33:01 Rebalance progress: 16.66666666666667
2022/01/03 13:33:06 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:33:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:33:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:33:06 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 13:33:06 Waiting for src bucket item count to get to: 200000 curr count: 12899
2022/01/03 13:33:11 Waiting for src bucket item count to get to: 200000 curr count: 29319
2022/01/03 13:33:16 Waiting for src bucket item count to get to: 200000 curr count: 29319
2022/01/03 13:33:21 Waiting for src bucket item count to get to: 200000 curr count: 45815
2022/01/03 13:33:26 Waiting for src bucket item count to get to: 200000 curr count: 45815
2022/01/03 13:33:31 Waiting for src bucket item count to get to: 200000 curr count: 62119
2022/01/03 13:33:36 Waiting for src bucket item count to get to: 200000 curr count: 62119
2022/01/03 13:33:41 Waiting for src bucket item count to get to: 200000 curr count: 62119
2022/01/03 13:33:46 Waiting for src bucket item count to get to: 200000 curr count: 78029
2022/01/03 13:33:51 Waiting for src bucket item count to get to: 200000 curr count: 78029
2022/01/03 13:33:56 Waiting for src bucket item count to get to: 200000 curr count: 94398
2022/01/03 13:34:01 Waiting for src bucket item count to get to: 200000 curr count: 94398
2022/01/03 13:34:06 Waiting for src bucket item count to get to: 200000 curr count: 110941
2022/01/03 13:34:11 Waiting for src bucket item count to get to: 200000 curr count: 110941
2022/01/03 13:34:16 Waiting for src bucket item count to get to: 200000 curr count: 127711
2022/01/03 13:34:21 Waiting for src bucket item count to get to: 200000 curr count: 127711
2022/01/03 13:34:26 Waiting for src bucket item count to get to: 200000 curr count: 144464
2022/01/03 13:34:31 Waiting for src bucket item count to get to: 200000 curr count: 144464
2022/01/03 13:34:36 Waiting for src bucket item count to get to: 200000 curr count: 161175
2022/01/03 13:34:41 Waiting for src bucket item count to get to: 200000 curr count: 161175
2022/01/03 13:34:46 Waiting for src bucket item count to get to: 200000 curr count: 177285
2022/01/03 13:34:51 Waiting for src bucket item count to get to: 200000 curr count: 177285
2022/01/03 13:34:56 Waiting for src bucket item count to get to: 200000 curr count: 193691
2022/01/03 13:35:01 Waiting for src bucket item count to get to: 200000 curr count: 193691
2022/01/03 13:35:06 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 13:35:06 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 13:35:11 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/01/03 13:35:16 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/01/03 13:35:21 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/01/03 13:35:26 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/01/03 13:35:26 App: TestDuplicateWithKVRebOut got un-deployed
2022/01/03 13:35:26 No eventing-con process running
2022/01/03 13:35:27 Function: TestDuplicateWithKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebOut deleting in background"
}
2022/01/03 13:35:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:35:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:35:38 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/03 13:35:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:35:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:35:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:35:50 Waiting for dst bucket item count to get to: 0 curr count: 30582
2022/01/03 13:35:55 Waiting for dst bucket item count to get to: 0 curr count: 30582
2022/01/03 13:35:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVRebOut (238.88s)
=== RUN   TestDuplicateWithKVSwapReb
2022/01/03 13:36:05 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2022/01/03 13:36:05 App: TestDuplicateWithKVSwapReb got un-deployed
2022/01/03 13:36:05 No eventing-con process running
2022/01/03 13:36:05 Function: TestDuplicateWithKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVSwapReb not found"
}
2022/01/03 13:36:07 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:36:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:36:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:36:14 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:36:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:36:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:36:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:36:24 Deploying app: TestDuplicateWithKVSwapReb. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:36:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVSwapReb stored in temp store"
}
2022/01/03 13:36:30 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2022/01/03 13:36:35 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2022/01/03 13:36:40 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2022/01/03 13:36:45 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2022/01/03 13:36:45 App: TestDuplicateWithKVSwapReb got deployed
2022/01/03 13:36:45 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 13:36:45 Starting bucket ops to source bucket
2022/01/03 13:36:45 Removing node(s): [] from the cluster
2022/01/03 13:36:50 Rebalance progress: 16.66666666666667
2022/01/03 13:36:55 Rebalance progress: 16.66666666666667
2022/01/03 13:37:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:37:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:37:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:37:00 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 13:37:00 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/03 13:37:00 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 13:37:05 Rebalance progress: 16.66666666666667
2022/01/03 13:37:10 Rebalance progress: 16.66666666666667
2022/01/03 13:37:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:37:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:37:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:37:15 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 13:37:15 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 13:37:20 Rebalance progress: 16.66666666666667
2022/01/03 13:37:25 Rebalance progress: 16.66666666666667
2022/01/03 13:37:30 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:37:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:37:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:37:31 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 13:37:31 Waiting for src bucket item count to get to: 200000 curr count: 71155
2022/01/03 13:37:36 Waiting for src bucket item count to get to: 200000 curr count: 71155
2022/01/03 13:37:41 Waiting for src bucket item count to get to: 200000 curr count: 86361
2022/01/03 13:37:46 Waiting for src bucket item count to get to: 200000 curr count: 86361
2022/01/03 13:37:51 Waiting for src bucket item count to get to: 200000 curr count: 102930
2022/01/03 13:37:56 Waiting for src bucket item count to get to: 200000 curr count: 102930
2022/01/03 13:38:01 Waiting for src bucket item count to get to: 200000 curr count: 119733
2022/01/03 13:38:06 Waiting for src bucket item count to get to: 200000 curr count: 119733
2022/01/03 13:38:11 Waiting for src bucket item count to get to: 200000 curr count: 136665
2022/01/03 13:38:16 Waiting for src bucket item count to get to: 200000 curr count: 136665
2022/01/03 13:38:21 Waiting for src bucket item count to get to: 200000 curr count: 136665
2022/01/03 13:38:26 Waiting for src bucket item count to get to: 200000 curr count: 153513
2022/01/03 13:38:31 Waiting for src bucket item count to get to: 200000 curr count: 153513
2022/01/03 13:38:36 Waiting for src bucket item count to get to: 200000 curr count: 169943
2022/01/03 13:38:41 Waiting for src bucket item count to get to: 200000 curr count: 169943
2022/01/03 13:38:46 Waiting for src bucket item count to get to: 200000 curr count: 185331
2022/01/03 13:38:51 Waiting for src bucket item count to get to: 200000 curr count: 185331
2022/01/03 13:38:56 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 13:38:56 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 13:39:01 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2022/01/03 13:39:06 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2022/01/03 13:39:11 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2022/01/03 13:39:16 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2022/01/03 13:39:16 App: TestDuplicateWithKVSwapReb got un-deployed
2022/01/03 13:39:16 No eventing-con process running
2022/01/03 13:39:16 Function: TestDuplicateWithKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVSwapReb deleting in background"
}
2022/01/03 13:39:18 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:39:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:39:28 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/03 13:39:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:39:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:39:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:39:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVSwapReb (219.33s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpOneByOne
2022/01/03 13:39:44 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 13:39:44 App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/01/03 13:39:44 No eventing-con process running
2022/01/03 13:39:44 Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne not found"
}
2022/01/03 13:39:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:39:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:39:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:39:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:39:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:39:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:40:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:40:03 Deploying app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:40:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2022/01/03 13:40:09 Starting bucket ops to source bucket
2022/01/03 13:40:14 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/03 13:40:19 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/03 13:40:24 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/03 13:40:24 App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:40:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:40:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:40:24 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 13:40:24 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 13:40:24 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 13:40:29 Rebalance progress: 16.66666666666667
2022/01/03 13:40:34 Rebalance progress: 16.66666666666667
2022/01/03 13:40:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:40:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:40:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:40:39 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 13:40:39 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 13:40:40 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 13:40:45 Rebalance progress: 16.66666666666667
2022/01/03 13:40:50 Rebalance progress: 16.66666666666667
2022/01/03 13:40:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:40:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:40:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:40:55 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 13:40:55 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 13:41:00 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 13:41:05 Rebalance progress: 12.5
2022/01/03 13:41:10 Rebalance progress: 12.5
2022/01/03 13:41:15 Rebalance progress: 12.5
2022/01/03 13:41:20 Rebalance progress: 58.984375
2022/01/03 13:41:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:41:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:41:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:41:25 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 13:41:30 Rebalance progress: 12.5
2022/01/03 13:41:35 Rebalance progress: 12.5
2022/01/03 13:41:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:41:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:41:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:41:40 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 13:41:45 Rebalance progress: 12.5
2022/01/03 13:41:50 Rebalance progress: 12.5
2022/01/03 13:41:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:41:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:41:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:41:55 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/03 13:42:01 Rebalance progress: 12.5
2022/01/03 13:42:06 Rebalance progress: 12.5
2022/01/03 13:42:11 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:42:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:42:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:42:16 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 13:42:21 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 13:42:26 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 13:42:31 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 13:42:31 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/01/03 13:42:31 eventingSetup.go:46: No eventing-con process running
2022/01/03 13:42:31 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2022/01/03 13:42:33 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:42:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:42:43 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12154
2022/01/03 13:42:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12154
2022/01/03 13:42:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:42:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:42:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:42:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpOneByOne (199.95s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce
2022/01/03 13:43:04 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/01/03 13:43:04 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got un-deployed
2022/01/03 13:43:04 eventingSetup.go:46: No eventing-con process running
2022/01/03 13:43:04 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce not found"
}
2022/01/03 13:43:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:43:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:43:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:43:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:43:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:43:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:43:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:43:23 eventingSetup.go:125: Deploying app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:43:24 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce stored in temp store"
}
2022/01/03 13:43:29 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 13:43:34 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2022/01/03 13:43:39 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2022/01/03 13:43:44 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2022/01/03 13:43:44 clusterSetup.go:354: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:43:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:43:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:43:44 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 13:43:44 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 13:43:45 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 13:43:45 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 13:43:50 Rebalance progress: 12.5
2022/01/03 13:43:55 Rebalance progress: 12.5
2022/01/03 13:44:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:44:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:44:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:44:00 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2022/01/03 13:44:05 Rebalance progress: 12.5
2022/01/03 13:44:10 Rebalance progress: 12.5
2022/01/03 13:44:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:44:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:44:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:44:20 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/01/03 13:44:25 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/01/03 13:44:30 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/01/03 13:44:35 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/01/03 13:44:35 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got un-deployed
2022/01/03 13:44:35 eventingSetup.go:46: No eventing-con process running
2022/01/03 13:44:35 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce deleting in background"
}
2022/01/03 13:44:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:44:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:44:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4585
2022/01/03 13:44:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:44:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:44:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:44:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4585
2022/01/03 13:44:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce (124.40s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings
2022/01/03 13:45:09 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 13:45:09 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got un-deployed
2022/01/03 13:45:09 eventingSetup.go:46: No eventing-con process running
2022/01/03 13:45:09 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings not found"
}
2022/01/03 13:45:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:45:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:45:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:45:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:45:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:45:22 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:45:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:45:27 eventingSetup.go:125: Deploying app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:45:28 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings stored in temp store"
}
2022/01/03 13:45:33 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 13:45:38 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2022/01/03 13:45:43 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2022/01/03 13:45:48 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2022/01/03 13:45:48 clusterSetup.go:354: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:45:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:45:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:45:48 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 13:45:49 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 13:45:54 Rebalance progress: 12.5
2022/01/03 13:45:59 Rebalance progress: 12.5
2022/01/03 13:46:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:46:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:46:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:46:04 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 13:46:04 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 13:46:09 Rebalance progress: 12.5
2022/01/03 13:46:14 Rebalance progress: 12.5
2022/01/03 13:46:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:46:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:46:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:46:19 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 13:46:19 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 13:46:25 Rebalance progress: 12.5
2022/01/03 13:46:30 Rebalance progress: 12.5
2022/01/03 13:46:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:46:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:46:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:46:35 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 13:46:40 Rebalance progress: 12.5
2022/01/03 13:46:45 Rebalance progress: 12.5
2022/01/03 13:46:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:46:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:46:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:46:50 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 13:46:55 Rebalance progress: 12.5
2022/01/03 13:47:00 Rebalance progress: 12.5
2022/01/03 13:47:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:47:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:47:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:47:05 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/03 13:47:10 Rebalance progress: 12.5
2022/01/03 13:47:15 Rebalance progress: 12.5
2022/01/03 13:47:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:47:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:47:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:47:25 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 13:47:30 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 13:47:35 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 13:47:40 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 13:47:40 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got un-deployed
2022/01/03 13:47:40 eventingSetup.go:46: No eventing-con process running
2022/01/03 13:47:40 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings deleting in background"
}
2022/01/03 13:47:42 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:47:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:47:52 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10643
2022/01/03 13:47:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10643
2022/01/03 13:47:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:47:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:48:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:48:09 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10639
2022/01/03 13:48:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings (189.92s)
=== RUN   TestEventingSwapRebOnUpdateBucketOp
2022/01/03 13:48:19 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/01/03 13:48:19 clusterSetup.go:405: App: TestEventingSwapRebOnUpdateBucketOp got un-deployed
2022/01/03 13:48:19 eventingSetup.go:46: No eventing-con process running
2022/01/03 13:48:19 eventingSetup.go:418: Function: TestEventingSwapRebOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebOnUpdateBucketOp not found"
}
2022/01/03 13:48:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:48:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:48:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:48:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:48:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:48:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:48:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:48:32 eventingSetup.go:125: Deploying app: TestEventingSwapRebOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:48:33 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebOnUpdateBucketOp stored in temp store"
}
2022/01/03 13:48:38 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 13:48:43 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2022/01/03 13:48:48 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2022/01/03 13:48:53 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2022/01/03 13:48:53 clusterSetup.go:354: App: TestEventingSwapRebOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:48:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:48:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:48:53 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 13:48:54 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 13:48:59 Rebalance progress: 12.5
2022/01/03 13:49:04 Rebalance progress: 12.5
2022/01/03 13:49:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:49:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:49:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:49:09 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 13:49:09 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 13:49:14 Rebalance progress: 12.5
2022/01/03 13:49:19 Rebalance progress: 12.5
2022/01/03 13:49:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:49:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:49:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:49:24 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 13:49:29 Rebalance progress: 12.5
2022/01/03 13:49:34 Rebalance progress: 12.5
2022/01/03 13:49:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:49:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:49:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:49:44 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/01/03 13:49:49 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/01/03 13:49:54 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/01/03 13:49:59 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/01/03 13:49:59 clusterSetup.go:405: App: TestEventingSwapRebOnUpdateBucketOp got un-deployed
2022/01/03 13:49:59 eventingSetup.go:46: No eventing-con process running
2022/01/03 13:49:59 eventingSetup.go:418: Function: TestEventingSwapRebOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebOnUpdateBucketOp deleting in background"
}
2022/01/03 13:50:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:50:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:50:11 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6084
2022/01/03 13:50:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6084
2022/01/03 13:50:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:50:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:50:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:50:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6084
2022/01/03 13:50:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebOnUpdateBucketOp (139.31s)
=== RUN   TestMetaRollbackWithEventingReb
2022/01/03 13:50:33 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 13:50:33 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 13:50:38 Rebalance progress: 100
2022/01/03 13:50:43 Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/01/03 13:50:43 App: TestMetaRollbackWithEventingReb got un-deployed
2022/01/03 13:50:43 No eventing-con process running
2022/01/03 13:50:43 Function: TestMetaRollbackWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaRollbackWithEventingReb not found"
}
2022/01/03 13:50:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:50:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:50:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:50:52 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:50:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:50:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:50:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:50:57 Deploying app: TestMetaRollbackWithEventingReb. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:50:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaRollbackWithEventingReb stored in temp store"
}
2022/01/03 13:51:03 Starting bucket ops to source bucket
2022/01/03 13:51:08 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2022/01/03 13:51:13 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2022/01/03 13:51:18 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2022/01/03 13:51:18 App: TestMetaRollbackWithEventingReb got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:51:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:51:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:51:18 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 13:51:18 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 13:51:23 Rebalance progress: 12.5
2022/01/03 13:51:28 Rebalance progress: 12.5
2022/01/03 13:51:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:51:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:51:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:51:33 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2022/01/03 13:51:33 bucketOps.go:134: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2022/01/03 13:51:38 Rebalance progress: 12.5
2022/01/03 13:51:43 Rebalance progress: 12.5
2022/01/03 13:51:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:51:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:51:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:51:54 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/01/03 13:51:59 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/01/03 13:52:04 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/01/03 13:52:09 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/01/03 13:52:09 clusterSetup.go:405: App: TestMetaRollbackWithEventingReb got un-deployed
2022/01/03 13:52:09 eventingSetup.go:46: No eventing-con process running
2022/01/03 13:52:09 eventingSetup.go:418: Function: TestMetaRollbackWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaRollbackWithEventingReb deleting in background"
}
2022/01/03 13:52:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:52:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:52:20 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2555
2022/01/03 13:52:25 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2555
2022/01/03 13:52:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:52:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:52:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:52:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4535
2022/01/03 13:52:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaRollbackWithEventingReb (129.24s)
=== RUN   TestMetaPartialRollbackWithEventingReb
2022/01/03 13:52:42 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 13:52:43 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 13:52:48 Rebalance progress: 100
2022/01/03 13:52:53 Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/01/03 13:52:53 App: TestMetaPartialRollbackWithEventingReb got un-deployed
2022/01/03 13:52:53 No eventing-con process running
2022/01/03 13:52:53 Function: TestMetaPartialRollbackWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaPartialRollbackWithEventingReb not found"
}
2022/01/03 13:52:54 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:52:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:52:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:53:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:53:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:53:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:53:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:53:06 Deploying app: TestMetaPartialRollbackWithEventingReb. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:53:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaPartialRollbackWithEventingReb stored in temp store"
}
2022/01/03 13:53:12 Starting bucket ops to source bucket
2022/01/03 13:53:17 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2022/01/03 13:53:22 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2022/01/03 13:53:27 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2022/01/03 13:53:27 App: TestMetaPartialRollbackWithEventingReb got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:53:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:53:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:53:27 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 13:53:28 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 13:53:33 Rebalance progress: 12.5
2022/01/03 13:53:38 Rebalance progress: 12.5
2022/01/03 13:53:43 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:53:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:53:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:53:43 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2022/01/03 13:53:43 bucketOps.go:65: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaPartialRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2022/01/03 13:53:48 Rebalance progress: 12.5
2022/01/03 13:53:53 Rebalance progress: 12.5
2022/01/03 13:53:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:53:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:53:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:53:58 bucketOps.go:65: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaPartialRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2022/01/03 13:54:03 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/01/03 13:54:08 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/01/03 13:54:13 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/01/03 13:54:18 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/01/03 13:54:18 clusterSetup.go:405: App: TestMetaPartialRollbackWithEventingReb got un-deployed
2022/01/03 13:54:18 eventingSetup.go:46: No eventing-con process running
2022/01/03 13:54:18 eventingSetup.go:418: Function: TestMetaPartialRollbackWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaPartialRollbackWithEventingReb deleting in background"
}
2022/01/03 13:54:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:54:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:54:30 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 205
2022/01/03 13:54:35 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 205
2022/01/03 13:54:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:54:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:54:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:54:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 38116
2022/01/03 13:54:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaPartialRollbackWithEventingReb (129.43s)
=== RUN   TestEventingRebMultipleHandlersOneByOne
2022/01/03 13:54:57 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/01/03 13:54:57 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got un-deployed
2022/01/03 13:54:57 eventingSetup.go:46: No eventing-con process running
2022/01/03 13:54:57 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op not found"
}
2022/01/03 13:54:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:55:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:55:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:55:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:55:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:55:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:55:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:55:15 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:55:16 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:55:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:55:16 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:55:17 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update stored in temp store"
}
2022/01/03 13:55:22 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 13:55:27 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2022/01/03 13:55:33 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2022/01/03 13:55:38 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2022/01/03 13:55:38 clusterSetup.go:354: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got deployed
2022/01/03 13:55:43 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2022/01/03 13:55:48 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2022/01/03 13:55:53 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2022/01/03 13:55:53 clusterSetup.go:354: App: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:55:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:55:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:55:53 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 13:55:53 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 13:55:58 Rebalance progress: 12.5
2022/01/03 13:56:03 Rebalance progress: 12.5
2022/01/03 13:56:08 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:56:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:56:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:56:08 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 13:56:08 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 13:56:13 Rebalance progress: 12.5
2022/01/03 13:56:18 Rebalance progress: 12.5
2022/01/03 13:56:23 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:56:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:56:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:56:23 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 13:56:24 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 13:56:29 Rebalance progress: 12.5
2022/01/03 13:56:34 Rebalance progress: 12.5
2022/01/03 13:56:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:56:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:56:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:56:39 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 13:56:44 Rebalance progress: 12.5
2022/01/03 13:56:49 Rebalance progress: 12.5
2022/01/03 13:56:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:56:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:56:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:56:54 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 13:56:59 Rebalance progress: 12.5
2022/01/03 13:57:04 Rebalance progress: 12.5
2022/01/03 13:57:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:57:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:57:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:57:09 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/03 13:57:14 Rebalance progress: 12.5
2022/01/03 13:57:19 Rebalance progress: 12.5
2022/01/03 13:57:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:57:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:57:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:57:29 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/01/03 13:57:34 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/01/03 13:57:39 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/01/03 13:57:44 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/01/03 13:57:45 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got un-deployed
2022/01/03 13:57:45 eventingSetup.go:46: No eventing-con process running
2022/01/03 13:57:45 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op deleting in background"
}
2022/01/03 13:57:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:57:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:57:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12164
2022/01/03 13:57:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:57:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:58:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:58:09 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12164
2022/01/03 13:58:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:58:14 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2022/01/03 13:58:19 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2022/01/03 13:58:24 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2022/01/03 13:58:29 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2022/01/03 13:58:29 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update got un-deployed
2022/01/03 13:58:29 eventingSetup.go:46: No eventing-con process running
2022/01/03 13:58:29 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update deleting in background"
}
2022/01/03 13:58:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:58:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:58:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:58:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:58:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:58:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultipleHandlersOneByOne (236.22s)
=== RUN   TestEventingRebMultipleHandlersAllAtOnce
2022/01/03 13:58:53 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2022/01/03 13:58:53 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got un-deployed
2022/01/03 13:58:53 eventingSetup.go:46: No eventing-con process running
2022/01/03 13:58:53 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op not found"
}
2022/01/03 13:58:55 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:59:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:59:00 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 13:59:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:59:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:59:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:59:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:59:11 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:59:12 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:59:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 13:59:13 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 13:59:14 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update stored in temp store"
}
2022/01/03 13:59:19 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 13:59:24 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2022/01/03 13:59:29 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2022/01/03 13:59:34 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2022/01/03 13:59:34 clusterSetup.go:354: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got deployed
2022/01/03 13:59:39 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2022/01/03 13:59:44 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2022/01/03 13:59:49 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2022/01/03 13:59:49 clusterSetup.go:354: App: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:59:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 13:59:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 13:59:49 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 13:59:49 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 13:59:50 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 13:59:50 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 13:59:55 Rebalance progress: 12.5
2022/01/03 14:00:00 Rebalance progress: 12.5
2022/01/03 14:00:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:00:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:00:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:00:05 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2022/01/03 14:00:10 Rebalance progress: 12.5
2022/01/03 14:00:15 Rebalance progress: 12.5
2022/01/03 14:00:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:00:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:00:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:00:25 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2022/01/03 14:00:30 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2022/01/03 14:00:35 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2022/01/03 14:00:40 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2022/01/03 14:00:40 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got un-deployed
2022/01/03 14:00:40 eventingSetup.go:46: No eventing-con process running
2022/01/03 14:00:40 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op deleting in background"
}
2022/01/03 14:00:43 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:00:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:00:53 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6125
2022/01/03 14:00:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6125
2022/01/03 14:00:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:01:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:01:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:01:10 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 424
2022/01/03 14:01:15 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 424
2022/01/03 14:01:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:01:20 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2022/01/03 14:01:25 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2022/01/03 14:01:30 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2022/01/03 14:01:35 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2022/01/03 14:01:35 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update got un-deployed
2022/01/03 14:01:35 eventingSetup.go:46: No eventing-con process running
2022/01/03 14:01:35 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update deleting in background"
}
2022/01/03 14:01:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:01:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:01:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:01:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:01:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:01:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultipleHandlersAllAtOnce (185.88s)
=== RUN   TestEventingSwapRebMultipleHandlers
2022/01/03 14:01:59 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/01/03 14:01:59 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got un-deployed
2022/01/03 14:01:59 eventingSetup.go:46: No eventing-con process running
2022/01/03 14:01:59 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update not found"
}
2022/01/03 14:02:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:02:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:02:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:02:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:02:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:02:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:02:17 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/01/03 14:02:17 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got un-deployed
2022/01/03 14:02:17 eventingSetup.go:46: No eventing-con process running
2022/01/03 14:02:17 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op not found"
}
2022/01/03 14:02:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:02:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:02:24 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:02:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:02:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:02:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:02:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:02:31 eventingSetup.go:125: Deploying app: TestEventingSwapRebMultipleHandlersbucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 14:02:32 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:02:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:02:32 eventingSetup.go:125: Deploying app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/01/03 14:02:33 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op stored in temp store"
}
2022/01/03 14:02:38 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 14:02:43 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2022/01/03 14:02:48 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2022/01/03 14:02:53 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2022/01/03 14:02:53 clusterSetup.go:354: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got deployed
2022/01/03 14:02:58 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2022/01/03 14:03:03 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2022/01/03 14:03:08 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2022/01/03 14:03:08 clusterSetup.go:354: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:03:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:03:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:03:08 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 14:03:09 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 14:03:14 Rebalance progress: 12.5
2022/01/03 14:03:19 Rebalance progress: 12.5
2022/01/03 14:03:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:03:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:03:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:03:24 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 14:03:24 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 14:03:29 Rebalance progress: 12.5
2022/01/03 14:03:34 Rebalance progress: 12.5
2022/01/03 14:03:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:03:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:03:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:03:39 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 14:03:44 Rebalance progress: 12.5
2022/01/03 14:03:49 Rebalance progress: 12.5
2022/01/03 14:03:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:03:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:03:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:03:59 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/01/03 14:04:05 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/01/03 14:04:10 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/01/03 14:04:15 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/01/03 14:04:15 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got un-deployed
2022/01/03 14:04:15 eventingSetup.go:46: No eventing-con process running
2022/01/03 14:04:15 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update deleting in background"
}
2022/01/03 14:04:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:04:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:04:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7625
2022/01/03 14:04:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:04:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:04:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:04:40 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1132
2022/01/03 14:04:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1132
2022/01/03 14:04:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:04:50 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/01/03 14:04:55 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/01/03 14:05:00 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/01/03 14:05:05 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/01/03 14:05:05 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got un-deployed
2022/01/03 14:05:05 eventingSetup.go:46: No eventing-con process running
2022/01/03 14:05:05 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op deleting in background"
}
2022/01/03 14:05:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:05:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:05:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:05:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:05:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:05:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebMultipleHandlers (210.11s)
=== RUN   TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne
2022/01/03 14:05:29 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 14:05:29 clusterSetup.go:405: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/01/03 14:05:29 eventingSetup.go:46: No eventing-con process running
2022/01/03 14:05:29 eventingSetup.go:418: Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne not found"
}
2022/01/03 14:05:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:05:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:05:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:05:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:05:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:05:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:05:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:05:47 eventingSetup.go:125: Deploying app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2022/01/03 14:05:49 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2022/01/03 14:05:54 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 14:05:59 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/03 14:06:04 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/03 14:06:09 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/03 14:06:09 clusterSetup.go:354: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:06:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:06:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:06:09 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 14:06:09 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 14:06:29 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:06:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:06:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:07:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:07:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:07:00 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 14:07:05 Rebalance progress: 12.5
2022/01/03 14:07:10 Rebalance progress: 12.5
2022/01/03 14:07:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:07:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:07:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:07:15 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 14:07:15 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 14:07:20 Rebalance progress: 12.5
2022/01/03 14:07:25 Rebalance progress: 12.5
2022/01/03 14:07:30 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:07:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:07:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:07:30 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 14:07:35 Rebalance progress: 12.5
2022/01/03 14:07:40 Rebalance progress: 12.5
2022/01/03 14:07:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:07:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:07:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:07:50 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 14:07:55 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 14:08:00 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 14:08:05 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 14:08:05 clusterSetup.go:405: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/01/03 14:08:05 eventingSetup.go:46: No eventing-con process running
2022/01/03 14:08:05 eventingSetup.go:418: Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2022/01/03 14:08:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:08:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:08:17 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11149
2022/01/03 14:08:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:08:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:08:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:08:29 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11149
2022/01/03 14:08:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne (190.01s)
=== RUN   TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne
2022/01/03 14:08:39 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 14:08:39 clusterSetup.go:405: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/01/03 14:08:39 eventingSetup.go:46: No eventing-con process running
2022/01/03 14:08:39 eventingSetup.go:418: Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne not found"
}
2022/01/03 14:08:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:08:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:08:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:08:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:08:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:08:52 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:08:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:08:57 eventingSetup.go:125: Deploying app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2022/01/03 14:08:59 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2022/01/03 14:09:04 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 14:09:09 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/03 14:09:14 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/03 14:09:19 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/03 14:09:19 clusterSetup.go:354: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:09:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:09:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:09:19 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 14:09:19 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 14:09:39 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:09:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:09:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:09:50 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:09:50 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:09:50 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 14:09:50 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 14:10:10 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:10:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:10:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:10:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:10:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:10:21 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 14:10:21 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 14:10:41 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:10:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:10:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:10:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:10:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:10:52 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 14:10:53 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 14:11:13 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:11:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:11:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:11:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:11:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:11:23 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 14:11:24 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 14:11:44 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:11:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:11:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:11:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:11:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:11:55 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 14:12:00 Rebalance progress: 12.5
2022/01/03 14:12:05 Rebalance progress: 12.5
2022/01/03 14:12:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:12:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:12:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:12:10 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 14:12:10 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 14:12:15 Rebalance progress: 12.5
2022/01/03 14:12:20 Rebalance progress: 12.5
2022/01/03 14:12:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:12:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:12:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:12:25 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 14:12:30 Rebalance progress: 12.5
2022/01/03 14:12:35 Rebalance progress: 12.5
2022/01/03 14:12:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:12:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:12:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:12:46 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 14:12:51 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 14:12:56 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 14:13:01 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 14:13:01 clusterSetup.go:405: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/01/03 14:13:01 eventingSetup.go:46: No eventing-con process running
2022/01/03 14:13:01 eventingSetup.go:418: Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2022/01/03 14:13:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:13:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:13:13 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 21675
2022/01/03 14:13:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 21675
2022/01/03 14:13:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:13:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:13:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:13:24 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne (295.48s)
=== RUN   TestEventingFailoverOnUpdateBucketOp
2022/01/03 14:13:34 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2022/01/03 14:13:34 clusterSetup.go:405: App: TestEventingFailoverOnUpdateBucketOp got un-deployed
2022/01/03 14:13:34 eventingSetup.go:46: No eventing-con process running
2022/01/03 14:13:34 eventingSetup.go:418: Function: TestEventingFailoverOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingFailoverOnUpdateBucketOp not found"
}
2022/01/03 14:13:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:13:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:13:41 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:13:43 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:13:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:13:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:13:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:13:53 eventingSetup.go:125: Deploying app: TestEventingFailoverOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/03 14:13:54 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingFailoverOnUpdateBucketOp stored in temp store"
}
2022/01/03 14:13:59 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 14:14:04 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2022/01/03 14:14:09 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2022/01/03 14:14:14 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2022/01/03 14:14:14 clusterSetup.go:354: App: TestEventingFailoverOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:14:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:14:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:14:14 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 14:14:14 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 14:14:19 Rebalance progress: 12.5
2022/01/03 14:14:24 Rebalance progress: 12.5
2022/01/03 14:14:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:14:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:14:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:14:29 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:14:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:14:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:14:39 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 14:14:44 Rebalance progress: 12.5
2022/01/03 14:14:49 Rebalance progress: 12.5
2022/01/03 14:14:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:14:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:14:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:14:54 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 14:14:55 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 14:15:00 Rebalance progress: 12.5
2022/01/03 14:15:05 Rebalance progress: 12.5
2022/01/03 14:15:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:15:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:15:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:15:10 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 14:15:15 Rebalance progress: 12.5
2022/01/03 14:15:20 Rebalance progress: 12.5
2022/01/03 14:15:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:15:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:15:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:15:30 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2022/01/03 14:15:35 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2022/01/03 14:15:40 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2022/01/03 14:15:40 clusterSetup.go:405: App: TestEventingFailoverOnUpdateBucketOp got un-deployed
2022/01/03 14:15:40 eventingSetup.go:46: No eventing-con process running
2022/01/03 14:15:40 eventingSetup.go:418: Function: TestEventingFailoverOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingFailoverOnUpdateBucketOp deleting in background"
}
2022/01/03 14:15:42 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:15:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:15:52 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8570
2022/01/03 14:15:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8570
2022/01/03 14:15:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:15:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:16:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:16:09 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8570
2022/01/03 14:16:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingFailoverOnUpdateBucketOp (164.29s)
=== RUN   TestEventingKVRebalanceOnUpdateBucketOp
2022/01/03 14:16:19 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/01/03 14:16:19 clusterSetup.go:405: App: TestEventingKVRebalanceOnUpdateBucketOp got un-deployed
2022/01/03 14:16:19 eventingSetup.go:46: No eventing-con process running
2022/01/03 14:16:19 eventingSetup.go:418: Function: TestEventingKVRebalanceOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingKVRebalanceOnUpdateBucketOp not found"
}
2022/01/03 14:16:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:16:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:16:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:16:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:16:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:16:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:16:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:16:37 eventingSetup.go:125: Deploying app: TestEventingKVRebalanceOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/03 14:16:38 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingKVRebalanceOnUpdateBucketOp stored in temp store"
}
2022/01/03 14:16:43 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 14:16:48 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2022/01/03 14:16:53 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2022/01/03 14:16:58 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2022/01/03 14:16:58 clusterSetup.go:354: App: TestEventingKVRebalanceOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:16:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:16:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:16:58 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing,kv to the cluster
2022/01/03 14:16:59 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 14:17:04 Rebalance progress: 12.5
2022/01/03 14:17:09 Rebalance progress: 12.5
2022/01/03 14:17:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:17:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:17:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:17:14 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing,kv to the cluster
2022/01/03 14:17:14 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 14:17:19 Rebalance progress: 12.5
2022/01/03 14:17:24 Rebalance progress: 12.5
2022/01/03 14:17:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:17:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:17:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:17:29 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 14:17:34 Rebalance progress: 12.5
2022/01/03 14:17:39 Rebalance progress: 12.5
2022/01/03 14:17:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:17:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:17:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:17:49 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/01/03 14:17:54 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/01/03 14:17:59 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/01/03 14:18:04 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/01/03 14:18:04 clusterSetup.go:405: App: TestEventingKVRebalanceOnUpdateBucketOp got un-deployed
2022/01/03 14:18:04 eventingSetup.go:46: No eventing-con process running
2022/01/03 14:18:04 eventingSetup.go:418: Function: TestEventingKVRebalanceOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingKVRebalanceOnUpdateBucketOp deleting in background"
}
2022/01/03 14:18:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:18:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:18:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6059
2022/01/03 14:18:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:18:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:18:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:18:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6059
2022/01/03 14:18:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingKVRebalanceOnUpdateBucketOp (139.12s)
=== RUN   TestEventingRebInWithOps
2022/01/03 14:18:38 clusterSetup.go:397: Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/01/03 14:18:38 clusterSetup.go:405: App: TestEventingRebInWithOps got un-deployed
2022/01/03 14:18:38 eventingSetup.go:46: No eventing-con process running
2022/01/03 14:18:38 eventingSetup.go:418: Function: TestEventingRebInWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebInWithOps not found"
}
2022/01/03 14:18:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:18:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:18:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:18:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:18:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:18:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:18:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:18:56 eventingSetup.go:125: Deploying app: TestEventingRebInWithOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 14:18:57 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithOps stored in temp store"
}
2022/01/03 14:19:02 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2022/01/03 14:19:07 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2022/01/03 14:19:12 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2022/01/03 14:19:17 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2022/01/03 14:19:17 clusterSetup.go:354: App: TestEventingRebInWithOps got deployed
2022/01/03 14:19:17 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 14:19:17 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 14:19:18 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 14:19:23 Rebalance progress: 12.5
2022/01/03 14:19:28 Rebalance progress: 12.5
2022/01/03 14:19:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:19:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:19:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:19:33 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 14:19:38 Rebalance progress: 12.5
2022/01/03 14:19:43 Rebalance progress: 12.5
2022/01/03 14:19:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:19:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:19:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:19:48 Waiting for src bucket item count to get to: 200000 curr count: 33555
2022/01/03 14:19:53 Waiting for src bucket item count to get to: 200000 curr count: 49666
2022/01/03 14:19:58 Waiting for src bucket item count to get to: 200000 curr count: 49666
2022/01/03 14:20:03 Waiting for src bucket item count to get to: 200000 curr count: 66144
2022/01/03 14:20:08 Waiting for src bucket item count to get to: 200000 curr count: 66144
2022/01/03 14:20:13 Waiting for src bucket item count to get to: 200000 curr count: 81433
2022/01/03 14:20:18 Waiting for src bucket item count to get to: 200000 curr count: 81433
2022/01/03 14:20:23 Waiting for src bucket item count to get to: 200000 curr count: 97723
2022/01/03 14:20:28 Waiting for src bucket item count to get to: 200000 curr count: 97723
2022/01/03 14:20:33 Waiting for src bucket item count to get to: 200000 curr count: 97723
2022/01/03 14:20:38 Waiting for src bucket item count to get to: 200000 curr count: 114252
2022/01/03 14:20:43 Waiting for src bucket item count to get to: 200000 curr count: 114252
2022/01/03 14:20:48 Waiting for src bucket item count to get to: 200000 curr count: 130681
2022/01/03 14:20:53 Waiting for src bucket item count to get to: 200000 curr count: 130681
2022/01/03 14:20:58 Waiting for src bucket item count to get to: 200000 curr count: 147195
2022/01/03 14:21:03 Waiting for src bucket item count to get to: 200000 curr count: 147195
2022/01/03 14:21:08 Waiting for src bucket item count to get to: 200000 curr count: 163566
2022/01/03 14:21:13 Waiting for src bucket item count to get to: 200000 curr count: 163566
2022/01/03 14:21:18 Waiting for src bucket item count to get to: 200000 curr count: 178707
2022/01/03 14:21:23 Waiting for src bucket item count to get to: 200000 curr count: 178707
2022/01/03 14:21:28 Waiting for src bucket item count to get to: 200000 curr count: 194943
2022/01/03 14:21:33 Waiting for src bucket item count to get to: 200000 curr count: 194943
2022/01/03 14:21:38 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 14:21:38 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 14:21:38 Starting bucket ops to source bucket
2022/01/03 14:25:23 Waiting for dst bucket item count to get to: 0 curr count: 16603
2022/01/03 14:25:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:25:23 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 14:25:28 Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/01/03 14:25:33 Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/01/03 14:25:38 Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/01/03 14:25:43 Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/01/03 14:25:43 App: TestEventingRebInWithOps got un-deployed
2022/01/03 14:25:43 No eventing-con process running
2022/01/03 14:25:43 Function: TestEventingRebInWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithOps deleting in background"
}
2022/01/03 14:25:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:25:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:25:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:25:52 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:25:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:25:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebInWithOps (449.22s)
=== RUN   TestEventingRebOutWithOps
2022/01/03 14:26:02 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 14:26:02 Removing node(s): [] from the cluster
2022/01/03 14:26:07 Rebalance progress: 100
2022/01/03 14:26:12 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/01/03 14:26:12 App: TestEventingRebOutWithOps got un-deployed
2022/01/03 14:26:12 No eventing-con process running
2022/01/03 14:26:12 Function: TestEventingRebOutWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebOutWithOps not found"
}
2022/01/03 14:26:14 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:26:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:26:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:26:21 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:26:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:26:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:26:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:26:31 Deploying app: TestEventingRebOutWithOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 14:26:32 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithOps stored in temp store"
}
2022/01/03 14:26:37 Waiting for app: TestEventingRebOutWithOps to get deployed
2022/01/03 14:26:42 Waiting for app: TestEventingRebOutWithOps to get deployed
2022/01/03 14:26:47 Waiting for app: TestEventingRebOutWithOps to get deployed
2022/01/03 14:26:52 Waiting for app: TestEventingRebOutWithOps to get deployed
2022/01/03 14:26:52 App: TestEventingRebOutWithOps got deployed
2022/01/03 14:26:52 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 14:26:52 Starting bucket ops to source bucket
2022/01/03 14:26:57 Rebalance progress: 12.5
2022/01/03 14:27:02 Rebalance progress: 12.5
2022/01/03 14:27:07 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:27:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:27:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:27:07 Waiting for src bucket item count to get to: 200000 curr count: 10913
2022/01/03 14:27:12 Waiting for src bucket item count to get to: 200000 curr count: 27191
2022/01/03 14:27:17 Waiting for src bucket item count to get to: 200000 curr count: 27191
2022/01/03 14:27:22 Waiting for src bucket item count to get to: 200000 curr count: 43513
2022/01/03 14:27:27 Waiting for src bucket item count to get to: 200000 curr count: 43513
2022/01/03 14:27:32 Waiting for src bucket item count to get to: 200000 curr count: 59693
2022/01/03 14:27:37 Waiting for src bucket item count to get to: 200000 curr count: 59693
2022/01/03 14:27:42 Waiting for src bucket item count to get to: 200000 curr count: 59693
2022/01/03 14:27:47 Waiting for src bucket item count to get to: 200000 curr count: 75128
2022/01/03 14:27:52 Waiting for src bucket item count to get to: 200000 curr count: 75128
2022/01/03 14:27:57 Waiting for src bucket item count to get to: 200000 curr count: 91317
2022/01/03 14:28:02 Waiting for src bucket item count to get to: 200000 curr count: 91317
2022/01/03 14:28:07 Waiting for src bucket item count to get to: 200000 curr count: 107764
2022/01/03 14:28:12 Waiting for src bucket item count to get to: 200000 curr count: 107764
2022/01/03 14:28:17 Waiting for src bucket item count to get to: 200000 curr count: 124297
2022/01/03 14:28:22 Waiting for src bucket item count to get to: 200000 curr count: 124297
2022/01/03 14:28:27 Waiting for src bucket item count to get to: 200000 curr count: 140903
2022/01/03 14:28:32 Waiting for src bucket item count to get to: 200000 curr count: 140903
2022/01/03 14:28:37 Waiting for src bucket item count to get to: 200000 curr count: 157505
2022/01/03 14:28:42 Waiting for src bucket item count to get to: 200000 curr count: 157505
2022/01/03 14:28:47 Waiting for src bucket item count to get to: 200000 curr count: 172976
2022/01/03 14:28:52 Waiting for src bucket item count to get to: 200000 curr count: 172976
2022/01/03 14:28:57 Waiting for src bucket item count to get to: 200000 curr count: 188851
2022/01/03 14:29:02 Waiting for src bucket item count to get to: 200000 curr count: 188851
2022/01/03 14:29:07 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 14:29:07 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 14:29:07 Starting bucket ops to source bucket
2022/01/03 14:32:52 Waiting for dst bucket item count to get to: 0 curr count: 14766
2022/01/03 14:32:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:32:52 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 14:32:58 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/01/03 14:33:03 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/01/03 14:33:08 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/01/03 14:33:13 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/01/03 14:33:13 App: TestEventingRebOutWithOps got un-deployed
2022/01/03 14:33:13 No eventing-con process running
2022/01/03 14:33:13 Function: TestEventingRebOutWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithOps deleting in background"
}
2022/01/03 14:33:14 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:33:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:33:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:33:21 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:33:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:33:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebOutWithOps (449.17s)
=== RUN   TestEventingSwapRebWithOps
2022/01/03 14:33:36 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/01/03 14:33:36 App: TestEventingSwapRebWithOps got un-deployed
2022/01/03 14:33:36 No eventing-con process running
2022/01/03 14:33:36 Function: TestEventingSwapRebWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebWithOps not found"
}
2022/01/03 14:33:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:33:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:33:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:33:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:33:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:33:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:33:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:33:55 Deploying app: TestEventingSwapRebWithOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 14:33:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithOps stored in temp store"
}
2022/01/03 14:34:01 Waiting for app: TestEventingSwapRebWithOps to get deployed
2022/01/03 14:34:06 Waiting for app: TestEventingSwapRebWithOps to get deployed
2022/01/03 14:34:11 Waiting for app: TestEventingSwapRebWithOps to get deployed
2022/01/03 14:34:16 Waiting for app: TestEventingSwapRebWithOps to get deployed
2022/01/03 14:34:16 App: TestEventingSwapRebWithOps got deployed
2022/01/03 14:34:16 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 14:34:16 Starting bucket ops to source bucket
2022/01/03 14:34:16 Removing node(s): [] from the cluster
2022/01/03 14:34:21 Rebalance progress: 12.5
2022/01/03 14:34:26 Rebalance progress: 12.5
2022/01/03 14:34:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:34:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:34:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:34:31 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 14:34:32 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 14:34:37 Rebalance progress: 12.5
2022/01/03 14:34:42 Rebalance progress: 12.5
2022/01/03 14:34:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:34:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:34:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:34:47 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 14:34:52 Rebalance progress: 12.5
2022/01/03 14:34:57 Rebalance progress: 12.5
2022/01/03 14:35:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:35:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:35:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:35:02 Waiting for src bucket item count to get to: 200000 curr count: 67629
2022/01/03 14:35:07 Waiting for src bucket item count to get to: 200000 curr count: 67629
2022/01/03 14:35:12 Waiting for src bucket item count to get to: 200000 curr count: 82132
2022/01/03 14:35:17 Waiting for src bucket item count to get to: 200000 curr count: 82132
2022/01/03 14:35:22 Waiting for src bucket item count to get to: 200000 curr count: 98793
2022/01/03 14:35:27 Waiting for src bucket item count to get to: 200000 curr count: 98793
2022/01/03 14:35:32 Waiting for src bucket item count to get to: 200000 curr count: 115191
2022/01/03 14:35:37 Waiting for src bucket item count to get to: 200000 curr count: 115191
2022/01/03 14:35:42 Waiting for src bucket item count to get to: 200000 curr count: 131213
2022/01/03 14:35:47 Waiting for src bucket item count to get to: 200000 curr count: 131213
2022/01/03 14:35:52 Waiting for src bucket item count to get to: 200000 curr count: 147435
2022/01/03 14:35:57 Waiting for src bucket item count to get to: 200000 curr count: 147435
2022/01/03 14:36:02 Waiting for src bucket item count to get to: 200000 curr count: 147435
2022/01/03 14:36:07 Waiting for src bucket item count to get to: 200000 curr count: 163637
2022/01/03 14:36:12 Waiting for src bucket item count to get to: 200000 curr count: 163637
2022/01/03 14:36:17 Waiting for src bucket item count to get to: 200000 curr count: 178276
2022/01/03 14:36:22 Waiting for src bucket item count to get to: 200000 curr count: 178276
2022/01/03 14:36:27 Waiting for src bucket item count to get to: 200000 curr count: 194527
2022/01/03 14:36:32 Waiting for src bucket item count to get to: 200000 curr count: 194527
2022/01/03 14:36:37 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 14:36:37 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 14:36:37 Starting bucket ops to source bucket
2022/01/03 14:40:22 Waiting for dst bucket item count to get to: 0 curr count: 13637
2022/01/03 14:40:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:40:22 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 14:40:27 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/01/03 14:40:32 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/01/03 14:40:37 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/01/03 14:40:42 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/01/03 14:40:42 App: TestEventingSwapRebWithOps got un-deployed
2022/01/03 14:40:42 No eventing-con process running
2022/01/03 14:40:42 Function: TestEventingSwapRebWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithOps deleting in background"
}
2022/01/03 14:40:44 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:40:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:40:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:40:50 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:40:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:40:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebWithOps (449.25s)
=== RUN   TestKVRebInWithOps
2022/01/03 14:41:05 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/01/03 14:41:05 App: TestKVRebInWithOps got un-deployed
2022/01/03 14:41:05 No eventing-con process running
2022/01/03 14:41:05 Function: TestKVRebInWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebInWithOps not found"
}
2022/01/03 14:41:07 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:41:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:41:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:41:14 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:41:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:41:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:41:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:41:24 Deploying app: TestKVRebInWithOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 14:41:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithOps stored in temp store"
}
2022/01/03 14:41:30 Waiting for app: TestKVRebInWithOps to get deployed
2022/01/03 14:41:35 Waiting for app: TestKVRebInWithOps to get deployed
2022/01/03 14:41:40 Waiting for app: TestKVRebInWithOps to get deployed
2022/01/03 14:41:45 Waiting for app: TestKVRebInWithOps to get deployed
2022/01/03 14:41:45 App: TestKVRebInWithOps got deployed
2022/01/03 14:41:45 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 14:41:45 Starting bucket ops to source bucket
2022/01/03 14:41:45 Removing node(s): [] from the cluster
2022/01/03 14:41:50 Rebalance progress: 12.5
2022/01/03 14:41:55 Rebalance progress: 12.5
2022/01/03 14:42:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:42:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:42:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:42:00 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 14:42:05 Rebalance progress: 12.5
2022/01/03 14:42:10 Rebalance progress: 12.5
2022/01/03 14:42:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:42:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:42:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:42:16 Waiting for src bucket item count to get to: 200000 curr count: 36889
2022/01/03 14:42:21 Waiting for src bucket item count to get to: 200000 curr count: 52981
2022/01/03 14:42:26 Waiting for src bucket item count to get to: 200000 curr count: 52981
2022/01/03 14:42:31 Waiting for src bucket item count to get to: 200000 curr count: 69035
2022/01/03 14:42:36 Waiting for src bucket item count to get to: 200000 curr count: 69035
2022/01/03 14:42:41 Waiting for src bucket item count to get to: 200000 curr count: 83928
2022/01/03 14:42:46 Waiting for src bucket item count to get to: 200000 curr count: 83928
2022/01/03 14:42:51 Waiting for src bucket item count to get to: 200000 curr count: 100114
2022/01/03 14:42:56 Waiting for src bucket item count to get to: 200000 curr count: 100114
2022/01/03 14:43:01 Waiting for src bucket item count to get to: 200000 curr count: 100114
2022/01/03 14:43:06 Waiting for src bucket item count to get to: 200000 curr count: 116726
2022/01/03 14:43:11 Waiting for src bucket item count to get to: 200000 curr count: 116726
2022/01/03 14:43:16 Waiting for src bucket item count to get to: 200000 curr count: 133378
2022/01/03 14:43:21 Waiting for src bucket item count to get to: 200000 curr count: 133378
2022/01/03 14:43:26 Waiting for src bucket item count to get to: 200000 curr count: 149873
2022/01/03 14:43:31 Waiting for src bucket item count to get to: 200000 curr count: 149873
2022/01/03 14:43:36 Waiting for src bucket item count to get to: 200000 curr count: 166437
2022/01/03 14:43:41 Waiting for src bucket item count to get to: 200000 curr count: 166437
2022/01/03 14:43:46 Waiting for src bucket item count to get to: 200000 curr count: 181324
2022/01/03 14:43:51 Waiting for src bucket item count to get to: 200000 curr count: 181324
2022/01/03 14:43:56 Waiting for src bucket item count to get to: 200000 curr count: 197774
2022/01/03 14:44:01 Waiting for src bucket item count to get to: 200000 curr count: 197774
2022/01/03 14:44:06 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 14:44:06 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 14:44:06 Starting bucket ops to source bucket
2022/01/03 14:47:50 Waiting for dst bucket item count to get to: 0 curr count: 11211
2022/01/03 14:47:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:47:50 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 14:47:55 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/01/03 14:48:00 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/01/03 14:48:05 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/01/03 14:48:10 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/01/03 14:48:11 App: TestKVRebInWithOps got un-deployed
2022/01/03 14:48:11 No eventing-con process running
2022/01/03 14:48:11 Function: TestKVRebInWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithOps deleting in background"
}
2022/01/03 14:48:12 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:48:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:48:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:48:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:48:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:48:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebInWithOps (448.62s)
=== RUN   TestKVRebOutWithOps
2022/01/03 14:48:29 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 14:48:29 Removing node(s): [] from the cluster
2022/01/03 14:48:34 Rebalance progress: 100
2022/01/03 14:48:39 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/01/03 14:48:39 App: TestKVRebOutWithOps got un-deployed
2022/01/03 14:48:39 No eventing-con process running
2022/01/03 14:48:39 Function: TestKVRebOutWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebOutWithOps not found"
}
2022/01/03 14:48:41 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:48:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:48:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:48:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:48:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:48:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:48:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:48:58 Deploying app: TestKVRebOutWithOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 14:48:59 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithOps stored in temp store"
}
2022/01/03 14:49:04 Waiting for app: TestKVRebOutWithOps to get deployed
2022/01/03 14:49:09 Waiting for app: TestKVRebOutWithOps to get deployed
2022/01/03 14:49:14 Waiting for app: TestKVRebOutWithOps to get deployed
2022/01/03 14:49:19 Waiting for app: TestKVRebOutWithOps to get deployed
2022/01/03 14:49:19 App: TestKVRebOutWithOps got deployed
2022/01/03 14:49:19 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 14:49:19 Starting bucket ops to source bucket
2022/01/03 14:49:24 Rebalance progress: 12.5
2022/01/03 14:49:29 Rebalance progress: 12.5
2022/01/03 14:49:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:49:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:49:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:49:34 Waiting for src bucket item count to get to: 200000 curr count: 15753
2022/01/03 14:49:39 Waiting for src bucket item count to get to: 200000 curr count: 15753
2022/01/03 14:49:44 Waiting for src bucket item count to get to: 200000 curr count: 31805
2022/01/03 14:49:49 Waiting for src bucket item count to get to: 200000 curr count: 31805
2022/01/03 14:49:54 Waiting for src bucket item count to get to: 200000 curr count: 48256
2022/01/03 14:49:59 Waiting for src bucket item count to get to: 200000 curr count: 48256
2022/01/03 14:50:04 Waiting for src bucket item count to get to: 200000 curr count: 64400
2022/01/03 14:50:09 Waiting for src bucket item count to get to: 200000 curr count: 64400
2022/01/03 14:50:14 Waiting for src bucket item count to get to: 200000 curr count: 64400
2022/01/03 14:50:19 Waiting for src bucket item count to get to: 200000 curr count: 79345
2022/01/03 14:50:24 Waiting for src bucket item count to get to: 200000 curr count: 79345
2022/01/03 14:50:29 Waiting for src bucket item count to get to: 200000 curr count: 95607
2022/01/03 14:50:34 Waiting for src bucket item count to get to: 200000 curr count: 111984
2022/01/03 14:50:39 Waiting for src bucket item count to get to: 200000 curr count: 111984
2022/01/03 14:50:44 Waiting for src bucket item count to get to: 200000 curr count: 128314
2022/01/03 14:50:49 Waiting for src bucket item count to get to: 200000 curr count: 128314
2022/01/03 14:50:54 Waiting for src bucket item count to get to: 200000 curr count: 144679
2022/01/03 14:50:59 Waiting for src bucket item count to get to: 200000 curr count: 144679
2022/01/03 14:51:04 Waiting for src bucket item count to get to: 200000 curr count: 161313
2022/01/03 14:51:09 Waiting for src bucket item count to get to: 200000 curr count: 161313
2022/01/03 14:51:14 Waiting for src bucket item count to get to: 200000 curr count: 176641
2022/01/03 14:51:19 Waiting for src bucket item count to get to: 200000 curr count: 176641
2022/01/03 14:51:24 Waiting for src bucket item count to get to: 200000 curr count: 192993
2022/01/03 14:51:29 Waiting for src bucket item count to get to: 200000 curr count: 192993
2022/01/03 14:51:34 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 14:51:34 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 14:51:34 Starting bucket ops to source bucket
2022/01/03 14:55:20 Waiting for dst bucket item count to get to: 0 curr count: 9816
2022/01/03 14:55:25 Waiting for dst bucket item count to get to: 0 curr count: 9816
2022/01/03 14:55:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:55:25 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 14:55:30 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/01/03 14:55:35 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/01/03 14:55:40 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/01/03 14:55:45 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/01/03 14:55:45 App: TestKVRebOutWithOps got un-deployed
2022/01/03 14:55:45 No eventing-con process running
2022/01/03 14:55:45 Function: TestKVRebOutWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithOps deleting in background"
}
2022/01/03 14:55:47 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:55:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:55:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:55:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:55:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:55:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOutWithOps (454.44s)
=== RUN   TestKVSwapRebWithOps
2022/01/03 14:56:08 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/01/03 14:56:08 App: TestKVSwapRebWithOps got un-deployed
2022/01/03 14:56:08 No eventing-con process running
2022/01/03 14:56:08 Function: TestKVSwapRebWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVSwapRebWithOps not found"
}
2022/01/03 14:56:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:56:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:56:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 14:56:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:56:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:56:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:56:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 14:56:27 Deploying app: TestKVSwapRebWithOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 14:56:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithOps stored in temp store"
}
2022/01/03 14:56:33 Waiting for app: TestKVSwapRebWithOps to get deployed
2022/01/03 14:56:38 Waiting for app: TestKVSwapRebWithOps to get deployed
2022/01/03 14:56:43 Waiting for app: TestKVSwapRebWithOps to get deployed
2022/01/03 14:56:48 Waiting for app: TestKVSwapRebWithOps to get deployed
2022/01/03 14:56:48 App: TestKVSwapRebWithOps got deployed
2022/01/03 14:56:48 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 14:56:48 Starting bucket ops to source bucket
2022/01/03 14:56:48 Removing node(s): [] from the cluster
2022/01/03 14:56:54 Rebalance progress: 12.5
2022/01/03 14:56:59 Rebalance progress: 12.5
2022/01/03 14:57:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:57:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:57:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:57:04 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/03 14:57:04 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 14:57:09 Rebalance progress: 12.5
2022/01/03 14:57:14 Rebalance progress: 12.5
2022/01/03 14:57:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:57:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:57:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:57:19 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 14:57:24 Rebalance progress: 12.5
2022/01/03 14:57:29 Rebalance progress: 12.5
2022/01/03 14:57:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:57:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 14:57:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 14:57:34 Waiting for src bucket item count to get to: 200000 curr count: 64250
2022/01/03 14:57:39 Waiting for src bucket item count to get to: 200000 curr count: 64250
2022/01/03 14:57:44 Waiting for src bucket item count to get to: 200000 curr count: 79409
2022/01/03 14:57:49 Waiting for src bucket item count to get to: 200000 curr count: 79409
2022/01/03 14:57:54 Waiting for src bucket item count to get to: 200000 curr count: 95781
2022/01/03 14:57:59 Waiting for src bucket item count to get to: 200000 curr count: 95781
2022/01/03 14:58:04 Waiting for src bucket item count to get to: 200000 curr count: 112403
2022/01/03 14:58:09 Waiting for src bucket item count to get to: 200000 curr count: 112403
2022/01/03 14:58:14 Waiting for src bucket item count to get to: 200000 curr count: 129075
2022/01/03 14:58:19 Waiting for src bucket item count to get to: 200000 curr count: 129075
2022/01/03 14:58:24 Waiting for src bucket item count to get to: 200000 curr count: 145854
2022/01/03 14:58:29 Waiting for src bucket item count to get to: 200000 curr count: 145854
2022/01/03 14:58:34 Waiting for src bucket item count to get to: 200000 curr count: 162439
2022/01/03 14:58:39 Waiting for src bucket item count to get to: 200000 curr count: 162439
2022/01/03 14:58:45 Waiting for src bucket item count to get to: 200000 curr count: 177681
2022/01/03 14:58:50 Waiting for src bucket item count to get to: 200000 curr count: 177681
2022/01/03 14:58:55 Waiting for src bucket item count to get to: 200000 curr count: 177681
2022/01/03 14:59:00 Waiting for src bucket item count to get to: 200000 curr count: 193872
2022/01/03 14:59:05 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 14:59:05 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 14:59:05 Starting bucket ops to source bucket
2022/01/03 15:02:49 Waiting for dst bucket item count to get to: 0 curr count: 9126
2022/01/03 15:02:54 Waiting for dst bucket item count to get to: 0 curr count: 9126
2022/01/03 15:02:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:02:54 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 15:02:59 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/01/03 15:03:05 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/01/03 15:03:10 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/01/03 15:03:15 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/01/03 15:03:15 App: TestKVSwapRebWithOps got un-deployed
2022/01/03 15:03:15 No eventing-con process running
2022/01/03 15:03:15 Function: TestKVSwapRebWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithOps deleting in background"
}
2022/01/03 15:03:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:03:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:03:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:03:23 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:03:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:03:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebWithOps (449.67s)
=== RUN   TestEventingRebInWithTimers
2022/01/03 15:03:38 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/01/03 15:03:38 App: TestEventingRebInWithTimers got un-deployed
2022/01/03 15:03:38 No eventing-con process running
2022/01/03 15:03:38 Function: TestEventingRebInWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebInWithTimers not found"
}
2022/01/03 15:03:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:03:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:03:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:03:47 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:03:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:03:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:03:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:03:57 Deploying app: TestEventingRebInWithTimers. Item count src bucket: 0 dst bucket: 0
2022/01/03 15:03:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithTimers stored in temp store"
}
2022/01/03 15:04:03 Waiting for app: TestEventingRebInWithTimers to get deployed
2022/01/03 15:04:08 Waiting for app: TestEventingRebInWithTimers to get deployed
2022/01/03 15:04:13 Waiting for app: TestEventingRebInWithTimers to get deployed
2022/01/03 15:04:18 Waiting for app: TestEventingRebInWithTimers to get deployed
2022/01/03 15:04:18 App: TestEventingRebInWithTimers got deployed
2022/01/03 15:04:18 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 15:04:18 Starting bucket ops to source bucket
2022/01/03 15:04:18 Removing node(s): [] from the cluster
2022/01/03 15:04:23 Rebalance progress: 12.5
2022/01/03 15:04:28 Rebalance progress: 12.5
2022/01/03 15:04:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:04:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:04:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:04:33 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 15:04:39 Rebalance progress: 12.5
2022/01/03 15:04:44 Rebalance progress: 12.5
2022/01/03 15:04:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:04:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:04:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:04:49 Waiting for src bucket item count to get to: 50000 curr count: 29261
2022/01/03 15:04:54 Waiting for src bucket item count to get to: 50000 curr count: 39082
2022/01/03 15:04:59 Waiting for src bucket item count to get to: 50000 curr count: 39082
2022/01/03 15:05:09 Waiting for dst bucket item count to get to: 50000 curr count: 29277
2022/01/03 15:05:14 Waiting for dst bucket item count to get to: 50000 curr count: 29277
2022/01/03 15:05:19 Waiting for dst bucket item count to get to: 50000 curr count: 43322
2022/01/03 15:05:24 Waiting for dst bucket item count to get to: 50000 curr count: 43322
2022/01/03 15:05:24 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 15:05:24 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 15:05:24 Starting bucket ops to source bucket
2022/01/03 15:06:33 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:06:38 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:06:43 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:06:48 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:06:53 Waiting for dst bucket item count to get to: 0 curr count: 41099
2022/01/03 15:06:58 Waiting for dst bucket item count to get to: 0 curr count: 31837
2022/01/03 15:07:03 Waiting for dst bucket item count to get to: 0 curr count: 31837
2022/01/03 15:07:08 Waiting for dst bucket item count to get to: 0 curr count: 16891
2022/01/03 15:07:13 Waiting for dst bucket item count to get to: 0 curr count: 16891
2022/01/03 15:07:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:07:13 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 15:07:18 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/01/03 15:07:23 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/01/03 15:07:28 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/01/03 15:07:33 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/01/03 15:07:33 App: TestEventingRebInWithTimers got un-deployed
2022/01/03 15:07:33 No eventing-con process running
2022/01/03 15:07:34 Function: TestEventingRebInWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithTimers deleting in background"
}
2022/01/03 15:07:35 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:07:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:07:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:07:42 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:07:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:07:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebInWithTimers (258.82s)
=== RUN   TestEventingRebOutWithTimers
2022/01/03 15:07:52 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 15:07:52 Removing node(s): [] from the cluster
2022/01/03 15:07:57 Rebalance progress: 100
2022/01/03 15:08:02 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/01/03 15:08:02 App: TestEventingRebOutWithTimers got un-deployed
2022/01/03 15:08:02 No eventing-con process running
2022/01/03 15:08:02 Function: TestEventingRebOutWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebOutWithTimers not found"
}
2022/01/03 15:08:04 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:08:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:08:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:08:11 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:08:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:08:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:08:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:08:21 Deploying app: TestEventingRebOutWithTimers. Item count src bucket: 0 dst bucket: 0
2022/01/03 15:08:22 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithTimers stored in temp store"
}
2022/01/03 15:08:27 Waiting for app: TestEventingRebOutWithTimers to get deployed
2022/01/03 15:08:32 Waiting for app: TestEventingRebOutWithTimers to get deployed
2022/01/03 15:08:37 Waiting for app: TestEventingRebOutWithTimers to get deployed
2022/01/03 15:08:42 Waiting for app: TestEventingRebOutWithTimers to get deployed
2022/01/03 15:08:42 App: TestEventingRebOutWithTimers got deployed
2022/01/03 15:08:42 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 15:08:42 Starting bucket ops to source bucket
2022/01/03 15:08:47 Rebalance progress: 12.5
2022/01/03 15:08:52 Rebalance progress: 12.5
2022/01/03 15:08:57 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:08:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:08:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:08:57 Waiting for src bucket item count to get to: 50000 curr count: 9770
2022/01/03 15:09:02 Waiting for src bucket item count to get to: 50000 curr count: 23753
2022/01/03 15:09:07 Waiting for src bucket item count to get to: 50000 curr count: 23753
2022/01/03 15:09:12 Waiting for src bucket item count to get to: 50000 curr count: 35649
2022/01/03 15:09:17 Waiting for src bucket item count to get to: 50000 curr count: 35649
2022/01/03 15:09:22 Waiting for src bucket item count to get to: 50000 curr count: 46147
2022/01/03 15:09:27 Waiting for src bucket item count to get to: 50000 curr count: 46147
2022/01/03 15:09:32 Waiting for src bucket item count to get to: 50000 curr count: 46147
2022/01/03 15:09:42 Waiting for dst bucket item count to get to: 50000 curr count: 36427
2022/01/03 15:09:47 Waiting for dst bucket item count to get to: 50000 curr count: 36427
2022/01/03 15:09:47 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 15:09:47 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 15:09:47 Starting bucket ops to source bucket
2022/01/03 15:10:57 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:11:02 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:11:07 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:11:12 Waiting for dst bucket item count to get to: 0 curr count: 49989
2022/01/03 15:11:17 Waiting for dst bucket item count to get to: 0 curr count: 49989
2022/01/03 15:11:22 Waiting for dst bucket item count to get to: 0 curr count: 34943
2022/01/03 15:11:27 Waiting for dst bucket item count to get to: 0 curr count: 34943
2022/01/03 15:11:32 Waiting for dst bucket item count to get to: 0 curr count: 17499
2022/01/03 15:11:37 Waiting for dst bucket item count to get to: 0 curr count: 17499
2022/01/03 15:11:42 Waiting for dst bucket item count to get to: 0 curr count: 5039
2022/01/03 15:11:47 Waiting for dst bucket item count to get to: 0 curr count: 5039
2022/01/03 15:11:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:11:47 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 15:11:52 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/01/03 15:11:57 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/01/03 15:12:02 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/01/03 15:12:07 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/01/03 15:12:07 App: TestEventingRebOutWithTimers got un-deployed
2022/01/03 15:12:07 No eventing-con process running
2022/01/03 15:12:07 Function: TestEventingRebOutWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithTimers deleting in background"
}
2022/01/03 15:12:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:12:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:12:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:12:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:12:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:12:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebOutWithTimers (273.49s)
=== RUN   TestEventingSwapRebWithTimers
2022/01/03 15:12:30 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/01/03 15:12:30 App: TestEventingSwapRebWithTimers got un-deployed
2022/01/03 15:12:30 No eventing-con process running
2022/01/03 15:12:30 Function: TestEventingSwapRebWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebWithTimers not found"
}
2022/01/03 15:12:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:12:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:12:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:12:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:12:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:12:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:12:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:12:49 Deploying app: TestEventingSwapRebWithTimers. Item count src bucket: 0 dst bucket: 0
2022/01/03 15:12:50 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithTimers stored in temp store"
}
2022/01/03 15:12:55 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2022/01/03 15:13:00 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2022/01/03 15:13:05 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2022/01/03 15:13:10 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2022/01/03 15:13:10 App: TestEventingSwapRebWithTimers got deployed
2022/01/03 15:13:10 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 15:13:10 Starting bucket ops to source bucket
2022/01/03 15:13:10 Removing node(s): [] from the cluster
2022/01/03 15:13:15 Rebalance progress: 12.5
2022/01/03 15:13:20 Rebalance progress: 12.5
2022/01/03 15:13:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:13:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:13:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:13:25 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 15:13:26 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 15:13:31 Rebalance progress: 12.5
2022/01/03 15:13:36 Rebalance progress: 12.5
2022/01/03 15:13:41 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:13:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:13:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:13:41 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 15:13:46 Rebalance progress: 12.5
2022/01/03 15:13:51 Rebalance progress: 12.5
2022/01/03 15:13:56 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:13:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:13:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:13:56 Waiting for src bucket item count to get to: 50000 curr count: 46127
2022/01/03 15:14:06 Waiting for dst bucket item count to get to: 50000 curr count: 39980
2022/01/03 15:14:11 Waiting for dst bucket item count to get to: 50000 curr count: 39980
2022/01/03 15:14:16 Waiting for dst bucket item count to get to: 50000 curr count: 49475
2022/01/03 15:14:21 Waiting for dst bucket item count to get to: 50000 curr count: 49475
2022/01/03 15:14:21 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 15:14:21 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 15:14:21 Starting bucket ops to source bucket
2022/01/03 15:15:30 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:15:35 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:15:40 Waiting for dst bucket item count to get to: 0 curr count: 49686
2022/01/03 15:15:45 Waiting for dst bucket item count to get to: 0 curr count: 49686
2022/01/03 15:15:50 Waiting for dst bucket item count to get to: 0 curr count: 36546
2022/01/03 15:15:55 Waiting for dst bucket item count to get to: 0 curr count: 36546
2022/01/03 15:16:00 Waiting for dst bucket item count to get to: 0 curr count: 25838
2022/01/03 15:16:05 Waiting for dst bucket item count to get to: 0 curr count: 25838
2022/01/03 15:16:10 Waiting for dst bucket item count to get to: 0 curr count: 6516
2022/01/03 15:16:15 Waiting for dst bucket item count to get to: 0 curr count: 6516
2022/01/03 15:16:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:16:15 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 15:16:20 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/01/03 15:16:25 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/01/03 15:16:30 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/01/03 15:16:35 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/01/03 15:16:35 App: TestEventingSwapRebWithTimers got un-deployed
2022/01/03 15:16:35 No eventing-con process running
2022/01/03 15:16:35 Function: TestEventingSwapRebWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithTimers deleting in background"
}
2022/01/03 15:16:37 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:16:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:16:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:16:44 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:16:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:16:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebWithTimers (268.21s)
=== RUN   TestKVRebInWithTimers
2022/01/03 15:16:59 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/01/03 15:16:59 App: TestKVRebInWithTimers got un-deployed
2022/01/03 15:16:59 No eventing-con process running
2022/01/03 15:16:59 Function: TestKVRebInWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebInWithTimers not found"
}
2022/01/03 15:17:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:17:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:17:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:17:07 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:17:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:17:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:17:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:17:17 Deploying app: TestKVRebInWithTimers. Item count src bucket: 0 dst bucket: 0
2022/01/03 15:17:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithTimers stored in temp store"
}
2022/01/03 15:17:23 Waiting for app: TestKVRebInWithTimers to get deployed
2022/01/03 15:17:28 Waiting for app: TestKVRebInWithTimers to get deployed
2022/01/03 15:17:33 Waiting for app: TestKVRebInWithTimers to get deployed
2022/01/03 15:17:38 Waiting for app: TestKVRebInWithTimers to get deployed
2022/01/03 15:17:38 App: TestKVRebInWithTimers got deployed
2022/01/03 15:17:38 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 15:17:38 Starting bucket ops to source bucket
2022/01/03 15:17:39 Removing node(s): [] from the cluster
2022/01/03 15:17:44 Rebalance progress: 12.5
2022/01/03 15:17:49 Rebalance progress: 12.5
2022/01/03 15:17:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:17:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:17:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:17:54 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 15:17:59 Rebalance progress: 12.5
2022/01/03 15:18:04 Rebalance progress: 12.5
2022/01/03 15:18:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:18:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:18:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:18:09 Waiting for src bucket item count to get to: 50000 curr count: 26549
2022/01/03 15:18:14 Waiting for src bucket item count to get to: 50000 curr count: 36257
2022/01/03 15:18:19 Waiting for src bucket item count to get to: 50000 curr count: 36257
2022/01/03 15:18:24 Waiting for src bucket item count to get to: 50000 curr count: 49159
2022/01/03 15:18:29 Waiting for src bucket item count to get to: 50000 curr count: 49159
2022/01/03 15:18:39 Waiting for dst bucket item count to get to: 50000 curr count: 47925
2022/01/03 15:18:44 Waiting for dst bucket item count to get to: 50000 curr count: 47925
2022/01/03 15:18:44 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 15:18:44 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 15:18:44 Starting bucket ops to source bucket
2022/01/03 15:19:53 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:19:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:20:03 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:20:08 Waiting for dst bucket item count to get to: 0 curr count: 41120
2022/01/03 15:20:13 Waiting for dst bucket item count to get to: 0 curr count: 41120
2022/01/03 15:20:18 Waiting for dst bucket item count to get to: 0 curr count: 25161
2022/01/03 15:20:23 Waiting for dst bucket item count to get to: 0 curr count: 25161
2022/01/03 15:20:28 Waiting for dst bucket item count to get to: 0 curr count: 9988
2022/01/03 15:20:33 Waiting for dst bucket item count to get to: 0 curr count: 9988
2022/01/03 15:20:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:20:33 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 15:20:38 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/01/03 15:20:43 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/01/03 15:20:48 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/01/03 15:20:53 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/01/03 15:20:53 App: TestKVRebInWithTimers got un-deployed
2022/01/03 15:20:53 No eventing-con process running
2022/01/03 15:20:53 Function: TestKVRebInWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithTimers deleting in background"
}
2022/01/03 15:20:55 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:21:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:21:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:21:02 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:21:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:21:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebInWithTimers (258.28s)
=== RUN   TestKVRebOutWithTimers
2022/01/03 15:21:12 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 15:21:12 Removing node(s): [] from the cluster
2022/01/03 15:21:18 Rebalance progress: 100
2022/01/03 15:21:23 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/01/03 15:21:23 App: TestKVRebOutWithTimers got un-deployed
2022/01/03 15:21:23 No eventing-con process running
2022/01/03 15:21:23 Function: TestKVRebOutWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebOutWithTimers not found"
}
2022/01/03 15:21:24 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:21:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:21:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:21:31 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:21:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:21:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:21:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:21:41 Deploying app: TestKVRebOutWithTimers. Item count src bucket: 0 dst bucket: 0
2022/01/03 15:21:42 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithTimers stored in temp store"
}
2022/01/03 15:21:47 Waiting for app: TestKVRebOutWithTimers to get deployed
2022/01/03 15:21:52 Waiting for app: TestKVRebOutWithTimers to get deployed
2022/01/03 15:21:57 Waiting for app: TestKVRebOutWithTimers to get deployed
2022/01/03 15:22:02 Waiting for app: TestKVRebOutWithTimers to get deployed
2022/01/03 15:22:02 App: TestKVRebOutWithTimers got deployed
2022/01/03 15:22:02 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 15:22:02 Starting bucket ops to source bucket
2022/01/03 15:22:07 Rebalance progress: 12.5
2022/01/03 15:22:12 Rebalance progress: 12.5
2022/01/03 15:22:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:22:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:22:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:22:17 Waiting for src bucket item count to get to: 50000 curr count: 9268
2022/01/03 15:22:22 Waiting for src bucket item count to get to: 50000 curr count: 22074
2022/01/03 15:22:27 Waiting for src bucket item count to get to: 50000 curr count: 22074
2022/01/03 15:22:32 Waiting for src bucket item count to get to: 50000 curr count: 34174
2022/01/03 15:22:37 Waiting for src bucket item count to get to: 50000 curr count: 34174
2022/01/03 15:22:42 Waiting for src bucket item count to get to: 50000 curr count: 44462
2022/01/03 15:22:47 Waiting for src bucket item count to get to: 50000 curr count: 44462
2022/01/03 15:22:52 Waiting for src bucket item count to get to: 50000 curr count: 44462
2022/01/03 15:23:02 Waiting for dst bucket item count to get to: 50000 curr count: 39763
2022/01/03 15:23:07 Waiting for dst bucket item count to get to: 50000 curr count: 39763
2022/01/03 15:23:07 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 15:23:07 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 15:23:07 Starting bucket ops to source bucket
2022/01/03 15:24:16 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:24:21 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:24:26 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:24:31 Waiting for dst bucket item count to get to: 0 curr count: 44264
2022/01/03 15:24:36 Waiting for dst bucket item count to get to: 0 curr count: 44264
2022/01/03 15:24:41 Waiting for dst bucket item count to get to: 0 curr count: 31918
2022/01/03 15:24:46 Waiting for dst bucket item count to get to: 0 curr count: 31918
2022/01/03 15:24:51 Waiting for dst bucket item count to get to: 0 curr count: 12152
2022/01/03 15:24:56 Waiting for dst bucket item count to get to: 0 curr count: 12152
2022/01/03 15:25:01 Waiting for dst bucket item count to get to: 0 curr count: 2750
2022/01/03 15:25:06 Waiting for dst bucket item count to get to: 0 curr count: 2750
2022/01/03 15:25:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:25:06 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 15:25:11 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/01/03 15:25:16 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/01/03 15:25:22 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/01/03 15:25:27 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/01/03 15:25:27 App: TestKVRebOutWithTimers got un-deployed
2022/01/03 15:25:27 No eventing-con process running
2022/01/03 15:25:27 Function: TestKVRebOutWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithTimers deleting in background"
}
2022/01/03 15:25:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:25:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:25:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:25:35 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:25:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:25:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOutWithTimers (273.22s)
=== RUN   TestKVSwapRebWithTimers
2022/01/03 15:25:50 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/01/03 15:25:50 App: TestKVSwapRebWithTimers got un-deployed
2022/01/03 15:25:50 No eventing-con process running
2022/01/03 15:25:50 Function: TestKVSwapRebWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVSwapRebWithTimers not found"
}
2022/01/03 15:25:52 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:25:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:25:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:25:59 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:26:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:26:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:26:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:26:09 Deploying app: TestKVSwapRebWithTimers. Item count src bucket: 0 dst bucket: 0
2022/01/03 15:26:10 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithTimers stored in temp store"
}
2022/01/03 15:26:15 Waiting for app: TestKVSwapRebWithTimers to get deployed
2022/01/03 15:26:20 Waiting for app: TestKVSwapRebWithTimers to get deployed
2022/01/03 15:26:25 Waiting for app: TestKVSwapRebWithTimers to get deployed
2022/01/03 15:26:30 Waiting for app: TestKVSwapRebWithTimers to get deployed
2022/01/03 15:26:30 App: TestKVSwapRebWithTimers got deployed
2022/01/03 15:26:30 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 15:26:30 Starting bucket ops to source bucket
2022/01/03 15:26:30 Removing node(s): [] from the cluster
2022/01/03 15:26:35 Rebalance progress: 12.5
2022/01/03 15:26:40 Rebalance progress: 12.5
2022/01/03 15:26:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:26:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:26:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:26:45 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/03 15:26:46 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 15:26:52 Rebalance progress: 12.5
2022/01/03 15:26:57 Rebalance progress: 12.5
2022/01/03 15:27:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:27:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:27:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:27:02 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 15:27:07 Rebalance progress: 12.5
2022/01/03 15:27:12 Rebalance progress: 12.5
2022/01/03 15:27:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:27:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:27:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:27:17 Waiting for src bucket item count to get to: 50000 curr count: 45856
2022/01/03 15:27:27 Waiting for dst bucket item count to get to: 50000 curr count: 43958
2022/01/03 15:27:32 Waiting for dst bucket item count to get to: 50000 curr count: 43958
2022/01/03 15:27:32 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 15:27:32 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 15:27:32 Starting bucket ops to source bucket
2022/01/03 15:28:41 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:28:46 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:28:51 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:28:56 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:29:01 Waiting for dst bucket item count to get to: 0 curr count: 41105
2022/01/03 15:29:06 Waiting for dst bucket item count to get to: 0 curr count: 41105
2022/01/03 15:29:11 Waiting for dst bucket item count to get to: 0 curr count: 18077
2022/01/03 15:29:16 Waiting for dst bucket item count to get to: 0 curr count: 18077
2022/01/03 15:29:21 Waiting for dst bucket item count to get to: 0 curr count: 5863
2022/01/03 15:29:26 Waiting for dst bucket item count to get to: 0 curr count: 5863
2022/01/03 15:29:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:29:26 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 15:29:31 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/01/03 15:29:36 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/01/03 15:29:41 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/01/03 15:29:46 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/01/03 15:29:51 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/01/03 15:29:51 App: TestKVSwapRebWithTimers got un-deployed
2022/01/03 15:29:51 No eventing-con process running
2022/01/03 15:29:51 Function: TestKVSwapRebWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithTimers deleting in background"
}
2022/01/03 15:29:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:29:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:29:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:30:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:30:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:30:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebWithTimers (264.81s)
=== RUN   TestDuplicateTimerCreationEventingRebIn
2022/01/03 15:30:15 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/03 15:30:15 App: TestDuplicateTimerCreationEventingRebIn got un-deployed
2022/01/03 15:30:15 No eventing-con process running
2022/01/03 15:30:15 Function: TestDuplicateTimerCreationEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingRebIn not found"
}
2022/01/03 15:30:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:30:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:30:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:30:23 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:30:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:30:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:30:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:30:33 Deploying app: TestDuplicateTimerCreationEventingRebIn. Item count src bucket: 0 dst bucket: 0
2022/01/03 15:30:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebIn stored in temp store"
}
2022/01/03 15:30:40 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2022/01/03 15:30:45 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2022/01/03 15:30:50 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2022/01/03 15:30:55 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2022/01/03 15:30:55 App: TestDuplicateTimerCreationEventingRebIn got deployed
2022/01/03 15:30:55 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 15:30:55 Starting bucket ops to source bucket
2022/01/03 15:30:55 Removing node(s): [] from the cluster
2022/01/03 15:31:00 Rebalance progress: 12.5
2022/01/03 15:31:05 Rebalance progress: 12.5
2022/01/03 15:31:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:31:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:31:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:31:10 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 15:31:15 Rebalance progress: 12.5
2022/01/03 15:31:20 Rebalance progress: 12.5
2022/01/03 15:31:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:31:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:31:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:31:25 Waiting for src bucket item count to get to: 50000 curr count: 30747
2022/01/03 15:31:30 Waiting for src bucket item count to get to: 50000 curr count: 41615
2022/01/03 15:31:35 Waiting for src bucket item count to get to: 50000 curr count: 41615
2022/01/03 15:31:45 Waiting for dst bucket item count to get to: 50000 curr count: 33878
2022/01/03 15:31:50 Waiting for dst bucket item count to get to: 50000 curr count: 33878
2022/01/03 15:31:55 Waiting for dst bucket item count to get to: 50000 curr count: 40729
2022/01/03 15:32:00 Waiting for dst bucket item count to get to: 50000 curr count: 40729
2022/01/03 15:32:00 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 15:32:00 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 15:32:05 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/03 15:32:10 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/03 15:32:16 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/03 15:32:21 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/03 15:32:26 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/03 15:32:31 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/03 15:32:31 App: TestDuplicateTimerCreationEventingRebIn got un-deployed
2022/01/03 15:32:31 No eventing-con process running
2022/01/03 15:32:31 Function: TestDuplicateTimerCreationEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebIn deleting in background"
}
2022/01/03 15:32:33 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:32:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:32:43 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:32:48 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:32:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:32:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:32:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:32:59 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:32:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingRebIn (174.34s)
=== RUN   TestDuplicateTimerCreationEventingRebOut
2022/01/03 15:33:04 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 15:33:04 Removing node(s): [] from the cluster
2022/01/03 15:33:09 Rebalance progress: 100
2022/01/03 15:33:15 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/01/03 15:33:15 App: TestDuplicateTimerCreationEventingRebOut got un-deployed
2022/01/03 15:33:15 No eventing-con process running
2022/01/03 15:33:15 Function: TestDuplicateTimerCreationEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingRebOut not found"
}
2022/01/03 15:33:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:33:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:33:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:33:23 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:33:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:33:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:33:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:33:33 Deploying app: TestDuplicateTimerCreationEventingRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/03 15:33:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebOut stored in temp store"
}
2022/01/03 15:33:39 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2022/01/03 15:33:44 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2022/01/03 15:33:49 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2022/01/03 15:33:54 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2022/01/03 15:33:54 App: TestDuplicateTimerCreationEventingRebOut got deployed
2022/01/03 15:33:54 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 15:33:54 Starting bucket ops to source bucket
2022/01/03 15:33:59 Rebalance progress: 12.5
2022/01/03 15:34:04 Rebalance progress: 12.5
2022/01/03 15:34:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:34:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:34:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:34:09 Waiting for src bucket item count to get to: 50000 curr count: 6199
2022/01/03 15:34:14 Waiting for src bucket item count to get to: 50000 curr count: 20399
2022/01/03 15:34:19 Waiting for src bucket item count to get to: 50000 curr count: 20399
2022/01/03 15:34:24 Waiting for src bucket item count to get to: 50000 curr count: 34239
2022/01/03 15:34:29 Waiting for src bucket item count to get to: 50000 curr count: 34239
2022/01/03 15:34:34 Waiting for src bucket item count to get to: 50000 curr count: 44827
2022/01/03 15:34:39 Waiting for src bucket item count to get to: 50000 curr count: 44827
2022/01/03 15:34:49 Waiting for dst bucket item count to get to: 50000 curr count: 30247
2022/01/03 15:34:54 Waiting for dst bucket item count to get to: 50000 curr count: 30247
2022/01/03 15:34:59 Waiting for dst bucket item count to get to: 50000 curr count: 30247
2022/01/03 15:35:04 Waiting for dst bucket item count to get to: 50000 curr count: 37241
2022/01/03 15:35:04 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 15:35:04 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 15:35:10 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/01/03 15:35:15 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/01/03 15:35:20 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/01/03 15:35:25 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/01/03 15:35:30 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/01/03 15:35:35 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/01/03 15:35:35 App: TestDuplicateTimerCreationEventingRebOut got un-deployed
2022/01/03 15:35:35 No eventing-con process running
2022/01/03 15:35:35 Function: TestDuplicateTimerCreationEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebOut deleting in background"
}
2022/01/03 15:35:37 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:35:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:35:47 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:35:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:35:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:35:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:35:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:35:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingRebOut (179.13s)
=== RUN   TestDuplicateTimerCreationEventingSwapReb
2022/01/03 15:36:08 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/01/03 15:36:08 App: TestDuplicateTimerCreationEventingSwapReb got un-deployed
2022/01/03 15:36:08 No eventing-con process running
2022/01/03 15:36:08 Function: TestDuplicateTimerCreationEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingSwapReb not found"
}
2022/01/03 15:36:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:36:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:36:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:36:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:36:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:36:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:36:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:36:27 Deploying app: TestDuplicateTimerCreationEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2022/01/03 15:36:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingSwapReb stored in temp store"
}
2022/01/03 15:36:33 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2022/01/03 15:36:38 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2022/01/03 15:36:43 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2022/01/03 15:36:48 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2022/01/03 15:36:48 App: TestDuplicateTimerCreationEventingSwapReb got deployed
2022/01/03 15:36:48 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 15:36:48 Starting bucket ops to source bucket
2022/01/03 15:36:49 Removing node(s): [] from the cluster
2022/01/03 15:36:54 Rebalance progress: 12.5
2022/01/03 15:36:59 Rebalance progress: 12.5
2022/01/03 15:37:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:37:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:37:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:37:04 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 15:37:04 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 15:37:09 Rebalance progress: 12.5
2022/01/03 15:37:14 Rebalance progress: 12.5
2022/01/03 15:37:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:37:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:37:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:37:19 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 15:37:24 Rebalance progress: 12.5
2022/01/03 15:37:29 Rebalance progress: 12.5
2022/01/03 15:37:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:37:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:37:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:37:34 Waiting for src bucket item count to get to: 50000 curr count: 48678
2022/01/03 15:37:39 Waiting for src bucket item count to get to: 50000 curr count: 48678
2022/01/03 15:37:49 Waiting for dst bucket item count to get to: 50000 curr count: 35757
2022/01/03 15:37:54 Waiting for dst bucket item count to get to: 50000 curr count: 35757
2022/01/03 15:37:59 Waiting for dst bucket item count to get to: 50000 curr count: 41880
2022/01/03 15:38:04 Waiting for dst bucket item count to get to: 50000 curr count: 41880
2022/01/03 15:38:04 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 15:38:04 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 15:38:10 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/01/03 15:38:15 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/01/03 15:38:20 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/01/03 15:38:25 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/01/03 15:38:30 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/01/03 15:38:30 App: TestDuplicateTimerCreationEventingSwapReb got un-deployed
2022/01/03 15:38:30 No eventing-con process running
2022/01/03 15:38:30 Function: TestDuplicateTimerCreationEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingSwapReb deleting in background"
}
2022/01/03 15:38:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:38:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:38:42 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:38:47 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:38:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:38:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:38:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:38:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:38:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingSwapReb (179.92s)
=== RUN   TestDuplicateTimerCreationKVRebIn
2022/01/03 15:39:08 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/01/03 15:39:08 App: TestDuplicateTimerCreationKVRebIn got un-deployed
2022/01/03 15:39:08 No eventing-con process running
2022/01/03 15:39:08 Function: TestDuplicateTimerCreationKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVRebIn not found"
}
2022/01/03 15:39:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:39:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:39:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:39:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:39:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:39:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:39:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:39:27 Deploying app: TestDuplicateTimerCreationKVRebIn. Item count src bucket: 0 dst bucket: 0
2022/01/03 15:39:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebIn stored in temp store"
}
2022/01/03 15:39:33 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2022/01/03 15:39:38 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2022/01/03 15:39:43 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2022/01/03 15:39:48 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2022/01/03 15:39:48 App: TestDuplicateTimerCreationKVRebIn got deployed
2022/01/03 15:39:48 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 15:39:48 Starting bucket ops to source bucket
2022/01/03 15:39:48 Removing node(s): [] from the cluster
2022/01/03 15:39:53 Rebalance progress: 12.5
2022/01/03 15:39:58 Rebalance progress: 12.5
2022/01/03 15:40:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:40:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:40:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:40:03 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 15:40:08 Rebalance progress: 12.5
2022/01/03 15:40:13 Rebalance progress: 12.5
2022/01/03 15:40:18 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:40:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:40:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:40:19 Waiting for src bucket item count to get to: 50000 curr count: 26273
2022/01/03 15:40:24 Waiting for src bucket item count to get to: 50000 curr count: 36723
2022/01/03 15:40:29 Waiting for src bucket item count to get to: 50000 curr count: 36723
2022/01/03 15:40:34 Waiting for src bucket item count to get to: 50000 curr count: 48351
2022/01/03 15:40:39 Waiting for src bucket item count to get to: 50000 curr count: 48351
2022/01/03 15:40:49 Waiting for dst bucket item count to get to: 50000 curr count: 38464
2022/01/03 15:40:54 Waiting for dst bucket item count to get to: 50000 curr count: 38464
2022/01/03 15:40:59 Waiting for dst bucket item count to get to: 50000 curr count: 45910
2022/01/03 15:41:04 Waiting for dst bucket item count to get to: 50000 curr count: 45910
2022/01/03 15:41:04 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 15:41:04 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 15:41:09 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/01/03 15:41:14 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/01/03 15:41:19 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/01/03 15:41:24 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/01/03 15:41:29 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/01/03 15:41:29 App: TestDuplicateTimerCreationKVRebIn got un-deployed
2022/01/03 15:41:29 No eventing-con process running
2022/01/03 15:41:29 Function: TestDuplicateTimerCreationKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebIn deleting in background"
}
2022/01/03 15:41:31 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:41:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:41:41 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:41:46 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:41:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:41:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:41:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:41:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:41:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVRebIn (179.46s)
=== RUN   TestDuplicateTimerCreationKVRebOut
2022/01/03 15:42:03 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 15:42:04 Removing node(s): [] from the cluster
2022/01/03 15:42:09 Rebalance progress: 100
2022/01/03 15:42:14 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/01/03 15:42:14 App: TestDuplicateTimerCreationKVRebOut got un-deployed
2022/01/03 15:42:14 No eventing-con process running
2022/01/03 15:42:14 Function: TestDuplicateTimerCreationKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVRebOut not found"
}
2022/01/03 15:42:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:42:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:42:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:42:22 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:42:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:42:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:42:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:42:32 Deploying app: TestDuplicateTimerCreationKVRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/03 15:42:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebOut stored in temp store"
}
2022/01/03 15:42:38 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2022/01/03 15:42:43 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2022/01/03 15:42:48 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2022/01/03 15:42:53 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2022/01/03 15:42:53 App: TestDuplicateTimerCreationKVRebOut got deployed
2022/01/03 15:42:53 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 15:42:53 Starting bucket ops to source bucket
2022/01/03 15:42:58 Rebalance progress: 12.5
2022/01/03 15:43:03 Rebalance progress: 12.5
2022/01/03 15:43:08 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:43:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:43:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:43:08 Waiting for src bucket item count to get to: 50000 curr count: 7615
2022/01/03 15:43:13 Waiting for src bucket item count to get to: 50000 curr count: 21973
2022/01/03 15:43:18 Waiting for src bucket item count to get to: 50000 curr count: 21973
2022/01/03 15:43:23 Waiting for src bucket item count to get to: 50000 curr count: 36209
2022/01/03 15:43:28 Waiting for src bucket item count to get to: 50000 curr count: 36209
2022/01/03 15:43:33 Waiting for src bucket item count to get to: 50000 curr count: 46441
2022/01/03 15:43:38 Waiting for src bucket item count to get to: 50000 curr count: 46441
2022/01/03 15:43:48 Waiting for dst bucket item count to get to: 50000 curr count: 30614
2022/01/03 15:43:53 Waiting for dst bucket item count to get to: 50000 curr count: 30614
2022/01/03 15:43:58 Waiting for dst bucket item count to get to: 50000 curr count: 30614
2022/01/03 15:44:03 Waiting for dst bucket item count to get to: 50000 curr count: 41153
2022/01/03 15:44:08 Waiting for dst bucket item count to get to: 50000 curr count: 41153
2022/01/03 15:44:08 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 15:44:08 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 15:44:14 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/01/03 15:44:19 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/01/03 15:44:24 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/01/03 15:44:29 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/01/03 15:44:34 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/01/03 15:44:34 App: TestDuplicateTimerCreationKVRebOut got un-deployed
2022/01/03 15:44:34 No eventing-con process running
2022/01/03 15:44:34 Function: TestDuplicateTimerCreationKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebOut deleting in background"
}
2022/01/03 15:44:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:44:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:44:46 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:44:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:44:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:44:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:44:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:44:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVRebOut (179.83s)
=== RUN   TestDuplicateTimerCreationKVSwapReb
2022/01/03 15:45:08 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/01/03 15:45:08 App: TestDuplicateTimerCreationKVSwapReb got un-deployed
2022/01/03 15:45:08 No eventing-con process running
2022/01/03 15:45:08 Function: TestDuplicateTimerCreationKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVSwapReb not found"
}
2022/01/03 15:45:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:45:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:45:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:45:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:45:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:45:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:45:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:45:26 Deploying app: TestDuplicateTimerCreationKVSwapReb. Item count src bucket: 0 dst bucket: 0
2022/01/03 15:45:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVSwapReb stored in temp store"
}
2022/01/03 15:45:32 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2022/01/03 15:45:37 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2022/01/03 15:45:42 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2022/01/03 15:45:47 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2022/01/03 15:45:47 App: TestDuplicateTimerCreationKVSwapReb got deployed
2022/01/03 15:45:47 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 15:45:47 Starting bucket ops to source bucket
2022/01/03 15:45:48 Removing node(s): [] from the cluster
2022/01/03 15:45:53 Rebalance progress: 12.5
2022/01/03 15:45:58 Rebalance progress: 12.5
2022/01/03 15:46:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:46:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:46:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:46:03 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/03 15:46:03 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 15:46:08 Rebalance progress: 12.5
2022/01/03 15:46:13 Rebalance progress: 12.5
2022/01/03 15:46:18 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:46:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:46:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:46:18 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 15:46:24 Rebalance progress: 12.5
2022/01/03 15:46:29 Rebalance progress: 12.5
2022/01/03 15:46:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:46:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:46:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:46:34 Waiting for src bucket item count to get to: 50000 curr count: 49887
2022/01/03 15:46:39 Waiting for src bucket item count to get to: 50000 curr count: 49887
2022/01/03 15:46:49 Waiting for dst bucket item count to get to: 50000 curr count: 36097
2022/01/03 15:46:54 Waiting for dst bucket item count to get to: 50000 curr count: 36097
2022/01/03 15:46:59 Waiting for dst bucket item count to get to: 50000 curr count: 42091
2022/01/03 15:47:04 Waiting for dst bucket item count to get to: 50000 curr count: 42091
2022/01/03 15:47:04 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 15:47:04 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 15:47:09 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/01/03 15:47:14 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/01/03 15:47:19 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/01/03 15:47:24 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/01/03 15:47:29 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/01/03 15:47:29 App: TestDuplicateTimerCreationKVSwapReb got un-deployed
2022/01/03 15:47:29 No eventing-con process running
2022/01/03 15:47:29 Function: TestDuplicateTimerCreationKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVSwapReb deleting in background"
}
2022/01/03 15:47:31 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:47:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:47:41 Waiting for dst bucket item count to get to: 0 curr count: 44147
2022/01/03 15:47:46 Waiting for dst bucket item count to get to: 0 curr count: 44147
2022/01/03 15:47:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:47:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:47:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:47:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:47:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVSwapReb (179.99s)
=== RUN   TestDuplicateTimerFiringEventingRebIn
2022/01/03 15:48:08 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/01/03 15:48:08 App: TestDuplicateTimerFiringEventingRebIn got un-deployed
2022/01/03 15:48:08 No eventing-con process running
2022/01/03 15:48:08 Function: TestDuplicateTimerFiringEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingRebIn not found"
}
2022/01/03 15:48:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:48:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:48:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:48:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:48:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:48:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:48:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:48:26 Deploying app: TestDuplicateTimerFiringEventingRebIn. Item count src bucket: 0 dst bucket: 0
2022/01/03 15:48:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebIn stored in temp store"
}
2022/01/03 15:48:32 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2022/01/03 15:48:37 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2022/01/03 15:48:42 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2022/01/03 15:48:47 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2022/01/03 15:48:47 App: TestDuplicateTimerFiringEventingRebIn got deployed
2022/01/03 15:48:47 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 15:48:47 Starting bucket ops to source bucket
2022/01/03 15:48:48 Removing node(s): [] from the cluster
2022/01/03 15:48:53 Rebalance progress: 12.5
2022/01/03 15:48:58 Rebalance progress: 12.5
2022/01/03 15:49:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:49:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:49:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:49:03 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 15:49:08 Rebalance progress: 12.5
2022/01/03 15:49:13 Rebalance progress: 12.5
2022/01/03 15:49:18 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:49:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:49:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:49:18 Waiting for src bucket item count to get to: 50000 curr count: 26470
2022/01/03 15:49:23 Waiting for src bucket item count to get to: 50000 curr count: 37349
2022/01/03 15:49:28 Waiting for src bucket item count to get to: 50000 curr count: 37349
2022/01/03 15:49:33 Waiting for src bucket item count to get to: 50000 curr count: 49294
2022/01/03 15:49:38 Waiting for src bucket item count to get to: 50000 curr count: 49294
2022/01/03 15:49:48 Waiting for dst bucket item count to get to: 50000 curr count: 47218
2022/01/03 15:49:53 Waiting for dst bucket item count to get to: 50000 curr count: 47218
2022/01/03 15:49:53 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 15:49:53 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 15:49:58 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/01/03 15:50:03 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/01/03 15:50:08 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/01/03 15:50:14 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/01/03 15:50:19 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/01/03 15:50:19 App: TestDuplicateTimerFiringEventingRebIn got un-deployed
2022/01/03 15:50:19 No eventing-con process running
2022/01/03 15:50:19 Function: TestDuplicateTimerFiringEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebIn deleting in background"
}
2022/01/03 15:50:20 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:50:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:50:30 Waiting for dst bucket item count to get to: 0 curr count: 19593
2022/01/03 15:50:35 Waiting for dst bucket item count to get to: 0 curr count: 19593
2022/01/03 15:50:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:50:37 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:50:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:50:47 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:50:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingRebIn (169.44s)
=== RUN   TestDuplicateTimerFiringEventingRebOut
2022/01/03 15:50:52 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 15:50:52 Removing node(s): [] from the cluster
2022/01/03 15:50:57 Rebalance progress: 100
2022/01/03 15:51:02 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/01/03 15:51:02 App: TestDuplicateTimerFiringEventingRebOut got un-deployed
2022/01/03 15:51:02 No eventing-con process running
2022/01/03 15:51:02 Function: TestDuplicateTimerFiringEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingRebOut not found"
}
2022/01/03 15:51:04 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:51:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:51:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:51:11 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:51:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:51:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:51:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:51:21 Deploying app: TestDuplicateTimerFiringEventingRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/03 15:51:22 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebOut stored in temp store"
}
2022/01/03 15:51:27 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2022/01/03 15:51:32 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2022/01/03 15:51:37 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2022/01/03 15:51:42 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2022/01/03 15:51:42 App: TestDuplicateTimerFiringEventingRebOut got deployed
2022/01/03 15:51:42 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 15:51:42 Starting bucket ops to source bucket
2022/01/03 15:51:47 Rebalance progress: 12.5
2022/01/03 15:51:52 Rebalance progress: 12.5
2022/01/03 15:51:57 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:51:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:51:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:51:57 Waiting for src bucket item count to get to: 50000 curr count: 9734
2022/01/03 15:52:02 Waiting for src bucket item count to get to: 50000 curr count: 21838
2022/01/03 15:52:07 Waiting for src bucket item count to get to: 50000 curr count: 21838
2022/01/03 15:52:12 Waiting for src bucket item count to get to: 50000 curr count: 33241
2022/01/03 15:52:17 Waiting for src bucket item count to get to: 50000 curr count: 33241
2022/01/03 15:52:22 Waiting for src bucket item count to get to: 50000 curr count: 43519
2022/01/03 15:52:27 Waiting for src bucket item count to get to: 50000 curr count: 43519
2022/01/03 15:52:32 Waiting for src bucket item count to get to: 50000 curr count: 43519
2022/01/03 15:52:42 Waiting for dst bucket item count to get to: 50000 curr count: 39964
2022/01/03 15:52:47 Waiting for dst bucket item count to get to: 50000 curr count: 39964
2022/01/03 15:52:47 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 15:52:47 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 15:52:52 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/01/03 15:52:58 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/01/03 15:53:03 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/01/03 15:53:08 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/01/03 15:53:13 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/01/03 15:53:13 App: TestDuplicateTimerFiringEventingRebOut got un-deployed
2022/01/03 15:53:13 No eventing-con process running
2022/01/03 15:53:13 Function: TestDuplicateTimerFiringEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebOut deleting in background"
}
2022/01/03 15:53:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:53:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:53:25 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:53:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:53:27 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:53:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:53:37 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:53:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingRebOut (169.49s)
=== RUN   TestDuplicateTimerFiringEventingSwapReb
2022/01/03 15:53:47 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/01/03 15:53:47 App: TestDuplicateTimerFiringEventingSwapReb got un-deployed
2022/01/03 15:53:47 No eventing-con process running
2022/01/03 15:53:47 Function: TestDuplicateTimerFiringEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingSwapReb not found"
}
2022/01/03 15:53:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:53:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:53:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:53:55 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:54:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:54:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:54:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:54:05 Deploying app: TestDuplicateTimerFiringEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2022/01/03 15:54:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingSwapReb stored in temp store"
}
2022/01/03 15:54:11 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2022/01/03 15:54:16 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2022/01/03 15:54:21 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2022/01/03 15:54:26 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2022/01/03 15:54:26 App: TestDuplicateTimerFiringEventingSwapReb got deployed
2022/01/03 15:54:26 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 15:54:26 Starting bucket ops to source bucket
2022/01/03 15:54:26 Removing node(s): [] from the cluster
2022/01/03 15:54:31 Rebalance progress: 12.5
2022/01/03 15:54:36 Rebalance progress: 12.5
2022/01/03 15:54:41 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:54:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:54:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:54:42 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 15:54:42 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 15:54:47 Rebalance progress: 12.5
2022/01/03 15:54:52 Rebalance progress: 12.5
2022/01/03 15:54:57 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:54:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:54:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:54:57 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 15:55:02 Rebalance progress: 12.5
2022/01/03 15:55:07 Rebalance progress: 12.5
2022/01/03 15:55:12 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:55:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:55:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:55:17 Waiting for dst bucket item count to get to: 50000 curr count: 33188
2022/01/03 15:55:22 Waiting for dst bucket item count to get to: 50000 curr count: 33188
2022/01/03 15:55:27 Waiting for dst bucket item count to get to: 50000 curr count: 43244
2022/01/03 15:55:32 Waiting for dst bucket item count to get to: 50000 curr count: 43244
2022/01/03 15:55:32 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 15:55:32 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 15:55:37 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/01/03 15:55:42 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/01/03 15:55:47 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/01/03 15:55:52 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/01/03 15:55:58 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/01/03 15:56:03 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/01/03 15:56:03 App: TestDuplicateTimerFiringEventingSwapReb got un-deployed
2022/01/03 15:56:03 No eventing-con process running
2022/01/03 15:56:03 Function: TestDuplicateTimerFiringEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingSwapReb deleting in background"
}
2022/01/03 15:56:04 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:56:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:56:14 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:56:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:56:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:56:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:56:26 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:56:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingSwapReb (169.56s)
=== RUN   TestDuplicateTimerFiringKVRebIn
2022/01/03 15:56:36 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/01/03 15:56:36 App: TestDuplicateTimerFiringKVRebIn got un-deployed
2022/01/03 15:56:36 No eventing-con process running
2022/01/03 15:56:36 Function: TestDuplicateTimerFiringKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVRebIn not found"
}
2022/01/03 15:56:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:56:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:56:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:56:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:56:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:56:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:56:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:56:55 Deploying app: TestDuplicateTimerFiringKVRebIn. Item count src bucket: 0 dst bucket: 0
2022/01/03 15:56:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebIn stored in temp store"
}
2022/01/03 15:57:01 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2022/01/03 15:57:06 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2022/01/03 15:57:11 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2022/01/03 15:57:16 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2022/01/03 15:57:16 App: TestDuplicateTimerFiringKVRebIn got deployed
2022/01/03 15:57:16 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 15:57:16 Starting bucket ops to source bucket
2022/01/03 15:57:16 Removing node(s): [] from the cluster
2022/01/03 15:57:21 Rebalance progress: 12.5
2022/01/03 15:57:26 Rebalance progress: 12.5
2022/01/03 15:57:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:57:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:57:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:57:31 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 15:57:36 Rebalance progress: 12.5
2022/01/03 15:57:41 Rebalance progress: 12.5
2022/01/03 15:57:46 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:57:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:57:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 15:57:46 Waiting for src bucket item count to get to: 50000 curr count: 29089
2022/01/03 15:57:51 Waiting for src bucket item count to get to: 50000 curr count: 39868
2022/01/03 15:57:56 Waiting for src bucket item count to get to: 50000 curr count: 39868
2022/01/03 15:58:06 Waiting for dst bucket item count to get to: 50000 curr count: 34043
2022/01/03 15:58:11 Waiting for dst bucket item count to get to: 50000 curr count: 34043
2022/01/03 15:58:16 Waiting for dst bucket item count to get to: 50000 curr count: 41115
2022/01/03 15:58:21 Waiting for dst bucket item count to get to: 50000 curr count: 41115
2022/01/03 15:58:21 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 15:58:21 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 15:58:27 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/01/03 15:58:32 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/01/03 15:58:37 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/01/03 15:58:42 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/01/03 15:58:47 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/01/03 15:58:47 App: TestDuplicateTimerFiringKVRebIn got un-deployed
2022/01/03 15:58:47 No eventing-con process running
2022/01/03 15:58:47 Function: TestDuplicateTimerFiringKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebIn deleting in background"
}
2022/01/03 15:58:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:58:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:58:59 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 15:58:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:59:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:59:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:59:11 Waiting for dst bucket item count to get to: 0 curr count: 34842
2022/01/03 15:59:16 Waiting for dst bucket item count to get to: 0 curr count: 34842
2022/01/03 15:59:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVRebIn (169.51s)
=== RUN   TestDuplicateTimerFiringKVRebOut
2022/01/03 15:59:21 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 15:59:21 Removing node(s): [] from the cluster
2022/01/03 15:59:26 Rebalance progress: 100
2022/01/03 15:59:31 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/01/03 15:59:31 App: TestDuplicateTimerFiringKVRebOut got un-deployed
2022/01/03 15:59:31 No eventing-con process running
2022/01/03 15:59:31 Function: TestDuplicateTimerFiringKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVRebOut not found"
}
2022/01/03 15:59:33 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:59:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:59:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 15:59:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:59:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:59:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 15:59:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 15:59:50 Deploying app: TestDuplicateTimerFiringKVRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/03 15:59:51 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebOut stored in temp store"
}
2022/01/03 15:59:56 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2022/01/03 16:00:01 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2022/01/03 16:00:06 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2022/01/03 16:00:11 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2022/01/03 16:00:11 App: TestDuplicateTimerFiringKVRebOut got deployed
2022/01/03 16:00:11 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 16:00:11 Starting bucket ops to source bucket
2022/01/03 16:00:16 Rebalance progress: 12.5
2022/01/03 16:00:21 Rebalance progress: 12.5
2022/01/03 16:00:26 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:00:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:00:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:00:26 Waiting for src bucket item count to get to: 50000 curr count: 11204
2022/01/03 16:00:31 Waiting for src bucket item count to get to: 50000 curr count: 25764
2022/01/03 16:00:36 Waiting for src bucket item count to get to: 50000 curr count: 25764
2022/01/03 16:00:41 Waiting for src bucket item count to get to: 50000 curr count: 36293
2022/01/03 16:00:46 Waiting for src bucket item count to get to: 50000 curr count: 36293
2022/01/03 16:00:51 Waiting for src bucket item count to get to: 50000 curr count: 46578
2022/01/03 16:00:56 Waiting for src bucket item count to get to: 50000 curr count: 46578
2022/01/03 16:01:01 Waiting for src bucket item count to get to: 50000 curr count: 46578
2022/01/03 16:01:11 Waiting for dst bucket item count to get to: 50000 curr count: 36648
2022/01/03 16:01:16 Waiting for dst bucket item count to get to: 50000 curr count: 36648
2022/01/03 16:01:16 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 16:01:16 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 16:01:21 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/01/03 16:01:26 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/01/03 16:01:31 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/01/03 16:01:36 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/01/03 16:01:42 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/01/03 16:01:42 App: TestDuplicateTimerFiringKVRebOut got un-deployed
2022/01/03 16:01:42 No eventing-con process running
2022/01/03 16:01:42 Function: TestDuplicateTimerFiringKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebOut deleting in background"
}
2022/01/03 16:01:43 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:01:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:01:53 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 16:01:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 16:01:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:02:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:02:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:02:10 Waiting for dst bucket item count to get to: 0 curr count: 13549
2022/01/03 16:02:15 Waiting for dst bucket item count to get to: 0 curr count: 13549
2022/01/03 16:02:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVRebOut (179.57s)
=== RUN   TestDuplicateTimerFiringKVSwapReb
2022/01/03 16:02:25 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/01/03 16:02:25 App: TestDuplicateTimerFiringKVSwapReb got un-deployed
2022/01/03 16:02:25 No eventing-con process running
2022/01/03 16:02:25 Function: TestDuplicateTimerFiringKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVSwapReb not found"
}
2022/01/03 16:02:27 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:02:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:02:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:02:34 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:02:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:02:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:02:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:02:44 Deploying app: TestDuplicateTimerFiringKVSwapReb. Item count src bucket: 0 dst bucket: 0
2022/01/03 16:02:45 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVSwapReb stored in temp store"
}
2022/01/03 16:02:50 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2022/01/03 16:02:55 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2022/01/03 16:03:00 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2022/01/03 16:03:05 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2022/01/03 16:03:05 App: TestDuplicateTimerFiringKVSwapReb got deployed
2022/01/03 16:03:05 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 16:03:05 Starting bucket ops to source bucket
2022/01/03 16:03:05 Removing node(s): [] from the cluster
2022/01/03 16:03:10 Rebalance progress: 12.5
2022/01/03 16:03:15 Rebalance progress: 12.5
2022/01/03 16:03:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:03:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:03:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:03:20 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/03 16:03:21 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 16:03:26 Rebalance progress: 12.5
2022/01/03 16:03:31 Rebalance progress: 12.5
2022/01/03 16:03:36 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:03:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:03:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:03:36 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 16:03:41 Rebalance progress: 12.5
2022/01/03 16:03:46 Rebalance progress: 12.5
2022/01/03 16:03:51 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:03:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:03:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:03:56 Waiting for dst bucket item count to get to: 50000 curr count: 35045
2022/01/03 16:04:01 Waiting for dst bucket item count to get to: 50000 curr count: 35045
2022/01/03 16:04:06 Waiting for dst bucket item count to get to: 50000 curr count: 42515
2022/01/03 16:04:11 Waiting for dst bucket item count to get to: 50000 curr count: 42515
2022/01/03 16:04:11 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 16:04:11 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 16:04:16 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/01/03 16:04:21 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/01/03 16:04:26 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/01/03 16:04:31 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/01/03 16:04:37 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/01/03 16:04:37 App: TestDuplicateTimerFiringKVSwapReb got un-deployed
2022/01/03 16:04:37 No eventing-con process running
2022/01/03 16:04:37 Function: TestDuplicateTimerFiringKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVSwapReb deleting in background"
}
2022/01/03 16:04:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:04:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:04:48 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 16:04:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:04:50 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:04:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:05:00 Waiting for dst bucket item count to get to: 0 curr count: 16517
2022/01/03 16:05:05 Waiting for dst bucket item count to get to: 0 curr count: 16517
2022/01/03 16:05:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVSwapReb (170.05s)
=== RUN   TestKVRebOnUpdateBucketOpOneByOne
2022/01/03 16:05:15 Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:05:15 App: bucket_op_on_update got un-deployed
2022/01/03 16:05:15 No eventing-con process running
2022/01/03 16:05:15 Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/03 16:05:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:05:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:05:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:05:24 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:05:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:05:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:05:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:05:34 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 16:05:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/03 16:05:40 Starting bucket ops to source bucket
2022/01/03 16:05:45 Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:05:50 Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:05:55 Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:05:55 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:05:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:05:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:05:55 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 16:05:55 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 16:06:00 Rebalance progress: 12.5
2022/01/03 16:06:05 Rebalance progress: 12.5
2022/01/03 16:06:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:06:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:06:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:06:10 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/03 16:06:11 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 16:06:16 Rebalance progress: 12.5
2022/01/03 16:06:21 Rebalance progress: 12.5
2022/01/03 16:06:26 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:06:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:06:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:06:26 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2022/01/03 16:06:26 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 16:06:31 Rebalance progress: 12.5
2022/01/03 16:06:36 Rebalance progress: 12.5
2022/01/03 16:06:41 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:06:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:06:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:06:42 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 16:06:47 Rebalance progress: 12.5
2022/01/03 16:06:52 Rebalance progress: 12.5
2022/01/03 16:06:57 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:06:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:06:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:06:57 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 16:07:02 Rebalance progress: 12.5
2022/01/03 16:07:07 Rebalance progress: 12.5
2022/01/03 16:07:12 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:07:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:07:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:07:12 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/03 16:07:17 Rebalance progress: 12.5
2022/01/03 16:07:22 Rebalance progress: 12.5
2022/01/03 16:07:27 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:07:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:07:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:07:32 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:07:37 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:07:42 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:07:47 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:07:52 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:07:52 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 16:07:52 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:07:52 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/03 16:07:54 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:07:59 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:08:04 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10680
2022/01/03 16:08:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:08:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:08:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:08:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10680
2022/01/03 16:08:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOnUpdateBucketOpOneByOne (190.82s)
=== RUN   TestKVForceFailover
2022/01/03 16:08:31 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:08:31 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 16:08:31 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:08:31 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/03 16:08:33 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:08:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:08:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:08:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:08:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:08:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:08:45 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 16:08:45 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 16:08:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:08:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:08:50 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 16:08:51 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/03 16:08:51 Starting bucket ops to source bucket
2022/01/03 16:08:56 Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:09:01 Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:09:06 Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:09:11 Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:09:11 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:09:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:09:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:09:11 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
2022/01/03 16:09:31 clusterSetup.go:237: Kicking off failover recovery, type: full
2022/01/03 16:09:31 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 16:09:37 Rebalance progress: 12.5
2022/01/03 16:09:42 Rebalance progress: 12.5
2022/01/03 16:09:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:09:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:09:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:09:47 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2022/01/03 16:09:52 Rebalance progress: 12.5
2022/01/03 16:09:57 Rebalance progress: 12.5
2022/01/03 16:10:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:10:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:10:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:10:07 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:10:12 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:10:17 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:10:22 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:10:28 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:10:28 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 16:10:28 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:10:28 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/03 16:10:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:10:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:10:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:10:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:10:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:10:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7061
2022/01/03 16:10:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVForceFailover (150.12s)
=== RUN   TestKVHardFailoverRecovery
2022/01/03 16:10:56 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:10:56 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 16:10:56 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:10:56 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/03 16:10:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:11:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:11:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:11:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:11:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:11:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:11:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:11:15 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 16:11:16 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/03 16:11:21 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 16:11:26 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:11:31 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:11:36 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:11:36 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:11:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:11:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:11:36 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 16:11:36 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 16:11:41 Rebalance progress: 12.5
2022/01/03 16:11:46 Rebalance progress: 12.5
2022/01/03 16:11:51 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:11:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:11:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:11:51 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
2022/01/03 16:12:51 clusterSetup.go:237: Kicking off failover recovery, type: full
2022/01/03 16:12:57 Rebalance progress: 12.5
2022/01/03 16:13:02 Rebalance progress: 12.5
2022/01/03 16:13:07 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:13:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:13:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:13:07 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 16:13:12 Rebalance progress: 12.5
2022/01/03 16:13:17 Rebalance progress: 12.5
2022/01/03 16:13:22 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:13:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:13:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:13:27 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:13:32 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:13:37 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:13:42 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:13:47 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:13:52 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:13:52 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 16:13:52 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:13:52 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/03 16:13:54 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:13:59 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:14:04 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12064
2022/01/03 16:14:09 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12064
2022/01/03 16:14:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:14:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:14:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:14:21 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8964
2022/01/03 16:14:26 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8964
2022/01/03 16:14:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVHardFailoverRecovery (219.57s)
=== RUN   TestKVRebOnUpdateBucketOpAllAtOnce
2022/01/03 16:14:36 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:14:36 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 16:14:36 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:14:36 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/03 16:14:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:14:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:14:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:14:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:14:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:14:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:14:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:14:54 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 16:14:55 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/03 16:15:00 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 16:15:05 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:15:10 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:15:15 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:15:15 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:15:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:15:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:15:15 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 16:15:16 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/03 16:15:16 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2022/01/03 16:15:16 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 16:15:21 Rebalance progress: 12.5
2022/01/03 16:15:26 Rebalance progress: 12.5
2022/01/03 16:15:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:15:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:15:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:15:32 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2022/01/03 16:15:37 Rebalance progress: 12.5
2022/01/03 16:15:42 Rebalance progress: 12.5
2022/01/03 16:15:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:15:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:15:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:15:52 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:15:57 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:16:02 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:16:07 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:16:12 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:16:12 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 16:16:12 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:16:12 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/03 16:16:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:16:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:16:24 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4611
2022/01/03 16:16:29 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4611
2022/01/03 16:16:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:16:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:16:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:16:41 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3888
2022/01/03 16:16:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3888
2022/01/03 16:16:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOnUpdateBucketOpAllAtOnce (140.06s)
=== RUN   TestKVSwapRebOnUpdateBucketOp
2022/01/03 16:16:56 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:16:56 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 16:16:56 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:16:56 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/03 16:16:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:17:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:17:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:17:04 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:17:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:17:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:17:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:17:09 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 16:17:10 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/03 16:17:15 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 16:17:20 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:17:25 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:17:30 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:17:31 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:17:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:17:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:17:31 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 16:17:31 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 16:17:36 Rebalance progress: 12.5
2022/01/03 16:17:41 Rebalance progress: 12.5
2022/01/03 16:17:46 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:17:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:17:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:17:46 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/03 16:17:46 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 16:17:52 Rebalance progress: 12.5
2022/01/03 16:17:57 Rebalance progress: 12.5
2022/01/03 16:18:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:18:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:18:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:18:02 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 16:18:07 Rebalance progress: 12.5
2022/01/03 16:18:12 Rebalance progress: 12.5
2022/01/03 16:18:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:18:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:18:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:18:22 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:18:27 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:18:32 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:18:37 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:18:42 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:18:42 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 16:18:42 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:18:42 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/03 16:18:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:18:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:18:54 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6108
2022/01/03 16:18:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6108
2022/01/03 16:18:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:19:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:19:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:19:11 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4886
2022/01/03 16:19:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4886
2022/01/03 16:19:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:19:21 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:19:21 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 16:19:21 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:19:21 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/03 16:19:23 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:19:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:19:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:19:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:19:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:19:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebOnUpdateBucketOp (168.52s)
=== RUN   TestKVRebalanceWithMultipleHandlers
2022/01/03 16:19:44 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:19:44 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 16:19:44 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:19:44 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/03 16:19:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:19:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:19:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:19:53 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:19:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:19:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:20:03 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/03 16:20:03 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2022/01/03 16:20:03 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:20:03 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: sys_test_bucket_op not found"
}
2022/01/03 16:20:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:20:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:20:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:20:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:20:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:20:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:20:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:20:16 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 16:20:17 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:20:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:20:17 eventingSetup.go:125: Deploying app: sys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/01/03 16:20:19 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op stored in temp store"
}
2022/01/03 16:20:24 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 16:20:29 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:20:34 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:20:39 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:20:39 clusterSetup.go:354: App: bucket_op_on_update got deployed
2022/01/03 16:20:44 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/01/03 16:20:49 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/01/03 16:20:54 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/01/03 16:20:54 clusterSetup.go:354: App: sys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:20:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:20:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:20:54 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 16:20:54 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 16:20:59 Rebalance progress: 12.5
2022/01/03 16:21:04 Rebalance progress: 12.5
2022/01/03 16:21:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:21:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:21:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:21:09 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/03 16:21:10 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 16:21:15 Rebalance progress: 12.5
2022/01/03 16:21:20 Rebalance progress: 12.5
2022/01/03 16:21:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:21:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:21:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:21:25 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2022/01/03 16:21:25 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 16:21:30 Rebalance progress: 12.5
2022/01/03 16:21:35 Rebalance progress: 12.5
2022/01/03 16:21:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:21:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:21:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:21:40 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 16:21:45 Rebalance progress: 12.5
2022/01/03 16:21:50 Rebalance progress: 12.5
2022/01/03 16:21:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:21:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:21:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:21:55 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 16:22:01 Rebalance progress: 12.5
2022/01/03 16:22:06 Rebalance progress: 12.5
2022/01/03 16:22:11 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:22:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:22:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:22:11 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/03 16:22:16 Rebalance progress: 12.5
2022/01/03 16:22:21 Rebalance progress: 12.5
2022/01/03 16:22:26 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:22:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:22:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:22:31 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:22:36 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:22:41 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:22:46 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:22:51 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:22:56 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:23:01 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:23:01 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 16:23:01 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:23:01 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/03 16:23:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:23:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:23:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12191
2022/01/03 16:23:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:23:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:23:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:23:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12191
2022/01/03 16:23:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:23:33 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/03 16:23:38 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/03 16:23:43 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/03 16:23:48 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/03 16:23:53 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/03 16:23:53 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2022/01/03 16:23:53 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:23:53 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op deleting in background"
}
2022/01/03 16:23:55 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:24:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:24:00 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:24:02 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:24:07 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:24:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebalanceWithMultipleHandlers (272.54s)
=== RUN   TestKVSwapRebalanceWithMultipleHandlers
2022/01/03 16:24:17 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:24:17 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 16:24:17 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:24:17 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/03 16:24:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:24:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:24:24 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:24:25 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:24:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:24:30 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:24:35 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/03 16:24:35 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2022/01/03 16:24:35 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:24:35 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: sys_test_bucket_op not found"
}
2022/01/03 16:24:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:24:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:24:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:24:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:24:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:24:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:24:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:24:49 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 16:24:50 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:24:50 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:24:50 eventingSetup.go:125: Deploying app: sys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/01/03 16:24:51 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op stored in temp store"
}
2022/01/03 16:24:56 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 16:25:01 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:25:06 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:25:11 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:25:11 clusterSetup.go:354: App: bucket_op_on_update got deployed
2022/01/03 16:25:16 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/01/03 16:25:21 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/01/03 16:25:26 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/01/03 16:25:26 clusterSetup.go:354: App: sys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:25:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:25:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:25:26 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 16:25:27 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 16:25:32 Rebalance progress: 12.5
2022/01/03 16:25:37 Rebalance progress: 12.5
2022/01/03 16:25:42 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:25:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:25:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:25:42 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/03 16:25:42 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 16:25:47 Rebalance progress: 12.5
2022/01/03 16:25:52 Rebalance progress: 12.5
2022/01/03 16:25:57 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:25:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:25:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:25:57 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 16:26:03 Rebalance progress: 12.5
2022/01/03 16:26:08 Rebalance progress: 12.5
2022/01/03 16:26:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:26:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:26:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:26:18 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:26:23 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:26:28 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:26:33 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:26:38 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:26:38 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 16:26:38 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:26:38 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/03 16:26:42 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:26:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:26:52 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4871
2022/01/03 16:26:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4871
2022/01/03 16:26:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:26:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:27:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:27:09 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7628
2022/01/03 16:27:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:27:14 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/03 16:27:19 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/03 16:27:25 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/03 16:27:30 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/03 16:27:35 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/03 16:27:35 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2022/01/03 16:27:35 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:27:35 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op deleting in background"
}
2022/01/03 16:27:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:27:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:27:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:27:43 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:27:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:27:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebalanceWithMultipleHandlers (221.49s)
=== RUN   TestKVRebStopStartKVOpsOnUpdateBucketOpOneByOne
2022/01/03 16:27:58 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:27:58 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 16:27:58 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:27:58 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/03 16:28:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:28:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:28:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:28:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:28:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:28:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:28:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:28:17 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 16:28:18 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/03 16:28:23 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 16:28:28 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:28:33 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:28:38 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:28:38 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:28:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:28:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:28:38 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 16:28:38 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 16:28:59 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:28:59 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:28:59 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:29:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:29:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:29:09 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 16:29:14 Rebalance progress: 12.5
2022/01/03 16:29:19 Rebalance progress: 12.5
2022/01/03 16:29:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:29:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:29:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:29:24 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/03 16:29:25 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 16:29:30 Rebalance progress: 12.5
2022/01/03 16:29:35 Rebalance progress: 12.5
2022/01/03 16:29:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:29:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:29:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:29:40 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 16:29:45 Rebalance progress: 12.5
2022/01/03 16:29:50 Rebalance progress: 12.5
2022/01/03 16:29:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:29:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:29:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:30:00 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:30:05 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:30:10 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:30:15 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:30:20 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:30:20 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 16:30:20 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:30:20 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/03 16:30:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:30:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:30:32 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9170
2022/01/03 16:30:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9170
2022/01/03 16:30:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:30:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:30:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:30:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9170
2022/01/03 16:30:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebStopStartKVOpsOnUpdateBucketOpOneByOne (180.65s)
=== RUN   TestKVFailoverOnUpdateBucketOp
2022/01/03 16:30:59 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:30:59 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 16:30:59 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:30:59 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/03 16:31:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:31:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:31:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:31:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:31:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:31:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:31:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:31:18 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 16:31:19 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/03 16:31:24 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 16:31:29 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:31:34 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:31:39 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:31:39 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:31:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:31:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:31:39 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 16:31:39 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 16:31:44 Rebalance progress: 12.5
2022/01/03 16:31:49 Rebalance progress: 12.5
2022/01/03 16:31:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:31:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:31:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:31:54 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:32:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:32:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:32:04 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 16:32:09 Rebalance progress: 12.5
2022/01/03 16:32:14 Rebalance progress: 12.5
2022/01/03 16:32:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:32:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:32:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:32:19 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/03 16:32:20 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 16:32:25 Rebalance progress: 12.5
2022/01/03 16:32:30 Rebalance progress: 12.5
2022/01/03 16:32:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:32:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:32:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:32:35 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 16:32:40 Rebalance progress: 12.5
2022/01/03 16:32:45 Rebalance progress: 12.5
2022/01/03 16:32:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:32:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:32:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:32:55 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:33:00 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:33:05 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:33:10 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:33:15 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:33:20 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:33:20 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 16:33:21 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:33:21 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/03 16:33:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:33:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:33:32 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8611
2022/01/03 16:33:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8611
2022/01/03 16:33:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:33:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:33:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:33:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8610
2022/01/03 16:33:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVFailoverOnUpdateBucketOp (180.03s)
=== RUN   TestBootstrapAfterKVHardFailover
2022/01/03 16:33:54 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 16:33:54 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 16:33:59 Rebalance progress: 100
2022/01/03 16:33:59 Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:34:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:34:29 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 16:34:31 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/03 16:34:36 Removing node(s): [] from the cluster
2022/01/03 16:34:36 Starting bucket ops to source bucket
2022/01/03 16:34:41 Rebalance failed. See logs for detailed reason. You can try again.
2022/01/03 16:34:46 Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:34:51 Waiting for app: bucket_op_on_update to get deployed
2022/01/03 16:34:51 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:34:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:34:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 16:34:56 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:35:01 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:35:06 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:35:11 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:35:16 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 16:35:16 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 16:35:16 eventingSetup.go:46: No eventing-con process running
2022/01/03 16:35:16 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/03 16:35:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:35:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:35:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1506
2022/01/03 16:35:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 16:35:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 16:35:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 16:35:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBootstrapAfterKVHardFailover (105.76s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	11952.390s

Rebalance tests took 3 hours, 19 minutes and 14 seconds.

Testing Succeeded


Version: versions-03.01.2022-08.55.cfg
Build Log: make-03.01.2022-08.55.log
Server Log: logs-03.01.2022-08.55.tar.gz

Finished