Building

Started building at 2022/01/04 09:41:58
Calculating base
Updating mirror
Basing run on 7.1.0-1989 0980cdf1a
Updating tree for run 04.01.2022-09.41
gocb is at 635fa6c, changes since last good build: none
libcouchbase is at f6822fc, changes since last good build: none
indexing is at 5311754, changes since last good build: none
kv_engine is at cda4d73, changes since last good build: none
ns_server is at fadbef1, changes since last good build: none
couchstore is at 0bf3a4b, changes since last good build: none
couchdb is at fca2e6b, changes since last good build: none
testrunner is at a23e488, changes since last good build: none
Switching eventing to unstable
eventing is at 9bef59f, changes since last good build: 
 9bef59ff MB-50216: Refresh cluster info cache when validation fails
Switching eventing-ee to unstable
eventing-ee is at 80089ff, changes since last good build: none
Pulling in uncommitted change 160397 at refs/changes/97/160397/3
Total 23 (delta 15), reused 17 (delta 15)
[unstable e2b5f8fc] MB-100 : Do not fail n1ql timeout test if we are catching timeout exceptions successfully
 Author: abhijpes 
 Date: Mon Aug 30 08:24:38 2021 +0530
 1 file changed, 2 insertions(+), 2 deletions(-)
Pulling in uncommitted change 163449 at refs/changes/49/163449/1
Total 48 (delta 27), reused 39 (delta 27)
[unstable 5a40a72a] MB-100: collect data when test fails
 Author: AnkitPrabhu 
 Date: Tue Oct 12 14:02:31 2021 +0530
 1 file changed, 2 insertions(+)
Pulling in uncommitted change 166698 at refs/changes/98/166698/3
Total 4 (delta 3), reused 4 (delta 3)
[unstable a83b0403] MB-48334 : Fail rebalance unless all functions deployed on current encryption level
 Author: abhijpes 
 Date: Wed Dec 1 14:51:29 2021 +0530
 1 file changed, 9 insertions(+)
Building cmakefiles and deps
Building main product

Testing

Started testing at 2022/01/04 09:57:02
Testing mode: rebalance,n1ql,functional
Starting server
Starting server: attempt 1

Functional tests

2022/01/04 09:58:34 Started functional
Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:39014->127.0.0.1:9000: read: connection reset by peer
Quota setup Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:39014->127.0.0.1:9000: read: connection reset by peer
2022/01/04 09:58:43 Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2022/01/04 09:58:49 Error in adding nodes : , response: {"otpNode":"n_1@127.0.0.1"}
2022/01/04 09:58:49 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 09:58:54 Removing node(s): [] from the cluster
2022/01/04 09:58:59 Rebalance progress: 0
2022/01/04 09:59:04 Rebalance progress: 0
2022/01/04 09:59:09 Rebalance progress: 4.430700231481482
2022/01/04 09:59:14 Rebalance progress: 9.02416087962963
2022/01/04 09:59:19 Rebalance progress: 12.44212962962963
2022/01/04 09:59:24 Rebalance progress: 17.21643518518519
2022/01/04 09:59:29 Rebalance progress: 20.5982349537037
2022/01/04 09:59:34 Rebalance progress: 25.24594907407407
2022/01/04 09:59:39 Rebalance progress: 100
2022/01/04 09:59:42 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/04 09:59:57 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/04 10:00:12 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/04 10:00:27 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/04 10:00:42 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/04 10:00:57 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/04 10:01:12 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/04 10:01:27 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/04 10:01:42 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/04 10:01:57 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
=== RUN   TestAdvancedGetOps
2022/01/04 10:02:15 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/04 10:02:30 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/04 10:02:45 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/04 10:03:00 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/04 10:03:15 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/04 10:03:30 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/04 10:03:45 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/04 10:04:00 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/04 10:04:15 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/04 10:04:30 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/04 10:04:45 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/04 10:05:00 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/04 10:05:15 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/04 10:05:30 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/04 10:05:45 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2022/01/04 10:06:00 Deploying app: TestAdvancedGetOps. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:06:01 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedGetOps stored in temp store"
}
2022/01/04 10:06:06 Waiting for app: TestAdvancedGetOps to get deployed
2022/01/04 10:06:11 Waiting for app: TestAdvancedGetOps to get deployed
2022/01/04 10:06:16 Waiting for app: TestAdvancedGetOps to get deployed
2022/01/04 10:06:21 Waiting for app: TestAdvancedGetOps to get deployed
2022/01/04 10:06:21 App: TestAdvancedGetOps got deployed
2022/01/04 10:06:21 Starting bucket ops to source bucket
2022/01/04 10:06:26 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/04 10:06:31 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/04 10:06:36 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/04 10:06:36 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/04 10:06:36 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:06:36 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:06:41 Waiting for app: TestAdvancedGetOps to get un-deployed
2022/01/04 10:06:46 Waiting for app: TestAdvancedGetOps to get un-deployed
2022/01/04 10:06:51 Waiting for app: TestAdvancedGetOps to get un-deployed
2022/01/04 10:06:56 Waiting for app: TestAdvancedGetOps to get un-deployed
2022/01/04 10:06:56 App: TestAdvancedGetOps got un-deployed
2022/01/04 10:06:56 No eventing-con process running
2022/01/04 10:06:56 Function: TestAdvancedGetOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedGetOps deleting in background"
}
2022/01/04 10:06:58 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:07:08 Waiting for dst bucket item count to get to: 0 curr count: 66
2022/01/04 10:07:13 Waiting for dst bucket item count to get to: 0 curr count: 16
2022/01/04 10:07:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:07:15 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:07:25 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:07:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedGetOps (310.21s)
=== RUN   TestAdvancedInsertOps
2022/01/04 10:07:25 Deploying app: TestAdvancedInsertOps. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:07:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps stored in temp store"
}
2022/01/04 10:07:31 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/04 10:07:36 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/04 10:07:41 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/04 10:07:46 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/04 10:07:46 App: TestAdvancedInsertOps got deployed
2022/01/04 10:07:46 Starting bucket ops to source bucket
2022/01/04 10:07:52 Waiting for dst bucket item count to get to: 1024 curr count: 0
2022/01/04 10:07:52 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2022/01/04 10:07:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:07:52 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:07:57 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/04 10:08:02 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/04 10:08:07 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/04 10:08:12 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/04 10:08:12 App: TestAdvancedInsertOps got un-deployed
2022/01/04 10:08:12 No eventing-con process running
2022/01/04 10:08:12 Function: TestAdvancedInsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps deleting in background"
}
2022/01/04 10:08:14 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:08:24 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/04 10:08:29 Waiting for dst bucket item count to get to: 0 curr count: 512
2022/01/04 10:08:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:08:31 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:08:41 Waiting for dst bucket item count to get to: 0 curr count: 870
2022/01/04 10:08:46 Waiting for dst bucket item count to get to: 0 curr count: 870
2022/01/04 10:08:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:08:46 Testing insert operation on source bucket
2022/01/04 10:08:46 Deploying app: TestAdvancedInsertOps. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:08:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps stored in temp store"
}
2022/01/04 10:08:52 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/04 10:08:57 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/04 10:09:02 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/04 10:09:07 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/04 10:09:07 App: TestAdvancedInsertOps got deployed
2022/01/04 10:09:07 Starting bucket ops to source bucket
2022/01/04 10:09:13 Waiting for dst bucket item count to get to: 2048 curr count: 0
2022/01/04 10:09:18 Waiting for dst bucket item count to get to: 2048 curr count: 1410
2022/01/04 10:09:23 Waiting for dst bucket item count to get to: 2048 curr count: 1410
2022/01/04 10:09:23 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2022/01/04 10:09:23 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:09:23 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:09:28 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/04 10:09:33 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/04 10:09:38 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/04 10:09:43 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/04 10:09:43 App: TestAdvancedInsertOps got un-deployed
2022/01/04 10:09:43 No eventing-con process running
2022/01/04 10:09:43 Function: TestAdvancedInsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps deleting in background"
}
2022/01/04 10:09:45 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:09:55 Waiting for dst bucket item count to get to: 0 curr count: 2048
2022/01/04 10:09:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:09:56 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:10:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedInsertOps (156.62s)
=== RUN   TestAdvancedUpsertOps
2022/01/04 10:10:01 Starting bucket ops to source bucket
2022/01/04 10:10:02 Deploying app: TestAdvancedUpsertOps. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:10:03 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps stored in temp store"
}
2022/01/04 10:10:08 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/04 10:10:13 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/04 10:10:18 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/04 10:10:23 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/04 10:10:23 App: TestAdvancedUpsertOps got deployed
2022/01/04 10:10:23 Starting bucket ops to source bucket
2022/01/04 10:10:29 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/04 10:10:34 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/04 10:10:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:10:34 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:10:34 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:10:39 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/04 10:10:44 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/04 10:10:49 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/04 10:10:54 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/04 10:10:54 App: TestAdvancedUpsertOps got un-deployed
2022/01/04 10:10:54 No eventing-con process running
2022/01/04 10:10:54 Function: TestAdvancedUpsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps deleting in background"
}
2022/01/04 10:10:56 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:11:06 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/04 10:11:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:11:08 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:11:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:11:13 Testing upsert operation on source bucket
2022/01/04 10:11:13 Deploying app: TestAdvancedUpsertOps. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:11:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps stored in temp store"
}
2022/01/04 10:11:19 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/04 10:11:24 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/04 10:11:29 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/04 10:11:34 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/04 10:11:34 App: TestAdvancedUpsertOps got deployed
2022/01/04 10:11:34 Starting bucket ops to source bucket
2022/01/04 10:11:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:11:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:11:35 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:11:40 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/04 10:11:45 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/04 10:11:50 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/04 10:11:55 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/04 10:11:55 App: TestAdvancedUpsertOps got un-deployed
2022/01/04 10:11:55 No eventing-con process running
2022/01/04 10:11:55 Function: TestAdvancedUpsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps deleting in background"
}
2022/01/04 10:11:57 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:12:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:12:04 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:12:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedUpsertOps (128.01s)
=== RUN   TestAdvancedReplaceOps
2022/01/04 10:12:09 Starting bucket ops to source bucket
2022/01/04 10:12:10 Deploying app: TestAdvancedReplaceOps. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:12:11 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps stored in temp store"
}
2022/01/04 10:12:16 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/04 10:12:21 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/04 10:12:26 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/04 10:12:31 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/04 10:12:31 App: TestAdvancedReplaceOps got deployed
2022/01/04 10:12:31 Starting bucket ops to source bucket
2022/01/04 10:12:38 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/04 10:12:43 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/04 10:12:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:12:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:12:43 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:12:48 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/04 10:12:53 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/04 10:12:58 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/04 10:13:03 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/04 10:13:03 App: TestAdvancedReplaceOps got un-deployed
2022/01/04 10:13:03 No eventing-con process running
2022/01/04 10:13:03 Function: TestAdvancedReplaceOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps deleting in background"
}
2022/01/04 10:13:04 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:13:14 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/04 10:13:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:13:16 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:13:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:13:21 Testing upsert operation on source bucket
2022/01/04 10:13:21 Deploying app: TestAdvancedReplaceOps. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:13:22 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps stored in temp store"
}
2022/01/04 10:13:27 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/04 10:13:32 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/04 10:13:37 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/04 10:13:42 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/04 10:13:42 App: TestAdvancedReplaceOps got deployed
2022/01/04 10:13:42 Starting bucket ops to source bucket
2022/01/04 10:13:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:13:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:13:43 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:13:49 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/04 10:13:54 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/04 10:13:59 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/04 10:14:04 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/04 10:14:04 App: TestAdvancedReplaceOps got un-deployed
2022/01/04 10:14:04 No eventing-con process running
2022/01/04 10:14:04 Function: TestAdvancedReplaceOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps deleting in background"
}
2022/01/04 10:14:05 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:14:15 Waiting for dst bucket item count to get to: 0 curr count: 385
2022/01/04 10:14:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:14:17 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:14:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedReplaceOps (132.66s)
=== RUN   TestAdvancedDeleteOps
2022/01/04 10:14:22 Starting bucket ops to source bucket
2022/01/04 10:14:22 Deploying app: TestAdvancedDeleteOps. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:14:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps stored in temp store"
}
2022/01/04 10:14:28 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/04 10:14:33 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/04 10:14:38 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/04 10:14:43 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/04 10:14:43 App: TestAdvancedDeleteOps got deployed
2022/01/04 10:14:43 Starting bucket ops to source bucket
2022/01/04 10:14:49 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:14:54 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/04 10:14:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:14:54 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:14:54 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:14:59 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/04 10:15:04 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/04 10:15:09 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/04 10:15:14 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/04 10:15:14 App: TestAdvancedDeleteOps got un-deployed
2022/01/04 10:15:14 No eventing-con process running
2022/01/04 10:15:14 Function: TestAdvancedDeleteOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps deleting in background"
}
2022/01/04 10:15:16 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:15:26 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:15:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:15:27 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:15:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:15:32 Testing delete operation on source bucket
2022/01/04 10:15:32 Deploying app: TestAdvancedDeleteOps. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:15:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps stored in temp store"
}
2022/01/04 10:15:38 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/04 10:15:43 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/04 10:15:48 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/04 10:15:53 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/04 10:15:53 App: TestAdvancedDeleteOps got deployed
2022/01/04 10:15:53 Starting bucket ops to source bucket
2022/01/04 10:15:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:15:54 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:15:54 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:15:59 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/04 10:16:04 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/04 10:16:09 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/04 10:16:14 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/04 10:16:14 App: TestAdvancedDeleteOps got un-deployed
2022/01/04 10:16:14 No eventing-con process running
2022/01/04 10:16:14 Function: TestAdvancedDeleteOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps deleting in background"
}
2022/01/04 10:16:16 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:16:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:16:23 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:16:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedDeleteOps (125.77s)
=== RUN   TestEnoentAdvancedGet
2022/01/04 10:16:28 Deploying app: TestEnoentAdvancedGet. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:16:29 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet stored in temp store"
}
2022/01/04 10:16:34 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/04 10:16:39 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/04 10:16:44 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/04 10:16:49 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/04 10:16:49 App: TestEnoentAdvancedGet got deployed
2022/01/04 10:16:49 Starting bucket ops to source bucket
2022/01/04 10:16:54 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/04 10:16:59 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/04 10:16:59 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/04 10:16:59 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:16:59 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:17:04 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/04 10:17:09 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/04 10:17:14 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/04 10:17:19 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/04 10:17:19 App: TestEnoentAdvancedGet got un-deployed
2022/01/04 10:17:19 No eventing-con process running
2022/01/04 10:17:19 Function: TestEnoentAdvancedGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet deleting in background"
}
2022/01/04 10:17:21 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:17:31 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:17:36 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:17:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:17:38 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:17:48 Waiting for dst bucket item count to get to: 0 curr count: 64
2022/01/04 10:17:53 Waiting for dst bucket item count to get to: 0 curr count: 14
2022/01/04 10:17:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:17:53 Testing get enoent operation on source bucket
2022/01/04 10:17:53 Deploying app: TestEnoentAdvancedGet. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:17:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet stored in temp store"
}
2022/01/04 10:17:59 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/04 10:18:04 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/04 10:18:09 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/04 10:18:14 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/04 10:18:14 App: TestEnoentAdvancedGet got deployed
2022/01/04 10:18:14 Starting bucket ops to source bucket
2022/01/04 10:18:19 Waiting for dst bucket item count to get to: 200 curr count: 0
2022/01/04 10:18:24 Waiting for dst bucket item count to get to: 200 curr count: 100
2022/01/04 10:18:24 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2022/01/04 10:18:24 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:18:24 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:18:29 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/04 10:18:34 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/04 10:18:39 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/04 10:18:44 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/04 10:18:44 App: TestEnoentAdvancedGet got un-deployed
2022/01/04 10:18:44 No eventing-con process running
2022/01/04 10:18:44 Function: TestEnoentAdvancedGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet deleting in background"
}
2022/01/04 10:18:46 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:18:56 Waiting for dst bucket item count to get to: 0 curr count: 200
2022/01/04 10:18:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:18:58 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:19:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedGet (155.03s)
=== RUN   TestEnoentAdvancedReplace
2022/01/04 10:19:03 Deploying app: TestEnoentAdvancedReplace. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:19:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace stored in temp store"
}
2022/01/04 10:19:09 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/04 10:19:14 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/04 10:19:19 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/04 10:19:24 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/04 10:19:24 App: TestEnoentAdvancedReplace got deployed
2022/01/04 10:19:24 Starting bucket ops to source bucket
2022/01/04 10:19:29 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/04 10:19:34 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/04 10:19:34 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/04 10:19:34 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:19:34 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:19:39 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/04 10:19:44 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/04 10:19:49 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/04 10:19:54 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/04 10:19:54 App: TestEnoentAdvancedReplace got un-deployed
2022/01/04 10:19:54 No eventing-con process running
2022/01/04 10:19:54 Function: TestEnoentAdvancedReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace deleting in background"
}
2022/01/04 10:19:56 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:20:06 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:20:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:20:08 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:20:18 Waiting for dst bucket item count to get to: 0 curr count: 64
2022/01/04 10:20:23 Waiting for dst bucket item count to get to: 0 curr count: 14
2022/01/04 10:20:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:20:23 Testing get enoent operation on source bucket
2022/01/04 10:20:23 Deploying app: TestEnoentAdvancedReplace. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:20:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace stored in temp store"
}
2022/01/04 10:20:29 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/04 10:20:34 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/04 10:20:39 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/04 10:20:44 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/04 10:20:44 App: TestEnoentAdvancedReplace got deployed
2022/01/04 10:20:44 Starting bucket ops to source bucket
2022/01/04 10:20:49 Waiting for dst bucket item count to get to: 200 curr count: 0
2022/01/04 10:20:54 Waiting for dst bucket item count to get to: 200 curr count: 100
2022/01/04 10:20:54 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2022/01/04 10:20:54 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:20:54 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:20:59 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/04 10:21:04 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/04 10:21:09 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/04 10:21:14 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/04 10:21:14 App: TestEnoentAdvancedReplace got un-deployed
2022/01/04 10:21:14 No eventing-con process running
2022/01/04 10:21:15 Function: TestEnoentAdvancedReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace deleting in background"
}
2022/01/04 10:21:16 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:21:26 Waiting for dst bucket item count to get to: 0 curr count: 200
2022/01/04 10:21:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:21:28 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:21:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedReplace (150.01s)
=== RUN   TestEnoentAdvancedDelete
2022/01/04 10:21:33 Deploying app: TestEnoentAdvancedDelete. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:21:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete stored in temp store"
}
2022/01/04 10:21:39 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/04 10:21:44 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/04 10:21:49 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/04 10:21:54 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/04 10:21:54 App: TestEnoentAdvancedDelete got deployed
2022/01/04 10:21:54 Starting bucket ops to source bucket
2022/01/04 10:21:59 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/04 10:22:04 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/04 10:22:04 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/04 10:22:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:22:04 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:22:09 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/04 10:22:14 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/04 10:22:19 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/04 10:22:24 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/04 10:22:24 App: TestEnoentAdvancedDelete got un-deployed
2022/01/04 10:22:24 No eventing-con process running
2022/01/04 10:22:24 Function: TestEnoentAdvancedDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete deleting in background"
}
2022/01/04 10:22:26 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:22:36 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:22:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:22:38 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:22:48 Waiting for dst bucket item count to get to: 0 curr count: 65
2022/01/04 10:22:53 Waiting for dst bucket item count to get to: 0 curr count: 15
2022/01/04 10:22:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:22:53 Testing get enoent operation on source bucket
2022/01/04 10:22:53 Deploying app: TestEnoentAdvancedDelete. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:22:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete stored in temp store"
}
2022/01/04 10:22:59 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/04 10:23:04 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/04 10:23:09 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/04 10:23:14 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/04 10:23:14 App: TestEnoentAdvancedDelete got deployed
2022/01/04 10:23:14 Starting bucket ops to source bucket
2022/01/04 10:23:19 Waiting for dst bucket item count to get to: 200 curr count: 0
2022/01/04 10:23:24 Waiting for dst bucket item count to get to: 200 curr count: 100
2022/01/04 10:23:24 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2022/01/04 10:23:24 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:23:24 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:23:29 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/04 10:23:34 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/04 10:23:39 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/04 10:23:44 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/04 10:23:44 App: TestEnoentAdvancedDelete got un-deployed
2022/01/04 10:23:44 No eventing-con process running
2022/01/04 10:23:44 Function: TestEnoentAdvancedDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete deleting in background"
}
2022/01/04 10:23:46 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:23:56 Waiting for dst bucket item count to get to: 0 curr count: 200
2022/01/04 10:23:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:23:58 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:24:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedDelete (149.95s)
=== RUN   TestAdvancedInsertKeyExist
2022/01/04 10:24:03 Deploying app: TestAdvancedInsertKeyExist. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:24:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist stored in temp store"
}
2022/01/04 10:24:09 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/04 10:24:14 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/04 10:24:19 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/04 10:24:24 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/04 10:24:24 App: TestAdvancedInsertKeyExist got deployed
2022/01/04 10:24:24 Starting bucket ops to source bucket
2022/01/04 10:24:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:24:24 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:24:24 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:24:29 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/04 10:24:34 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/04 10:24:39 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/04 10:24:44 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/04 10:24:44 App: TestAdvancedInsertKeyExist got un-deployed
2022/01/04 10:24:44 No eventing-con process running
2022/01/04 10:24:44 Function: TestAdvancedInsertKeyExist delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist deleting in background"
}
2022/01/04 10:24:46 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:24:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:24:54 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:24:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:24:59 Pumping document in the destination bucket
2022/01/04 10:24:59 Starting bucket ops to source bucket
2022/01/04 10:24:59 Deploying app: TestAdvancedInsertKeyExist. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:25:00 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist stored in temp store"
}
2022/01/04 10:25:05 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/04 10:25:10 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/04 10:25:15 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/04 10:25:20 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/04 10:25:20 App: TestAdvancedInsertKeyExist got deployed
2022/01/04 10:25:20 Starting bucket ops to source bucket
2022/01/04 10:25:25 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:25:30 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:25:35 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/04 10:25:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:25:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:25:35 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:25:40 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/04 10:25:45 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/04 10:25:50 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/04 10:25:55 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/04 10:25:55 App: TestAdvancedInsertKeyExist got un-deployed
2022/01/04 10:25:55 No eventing-con process running
2022/01/04 10:25:55 Function: TestAdvancedInsertKeyExist delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist deleting in background"
}
2022/01/04 10:25:57 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:26:07 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:26:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:26:09 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:26:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedInsertKeyExist (130.75s)
=== RUN   TestExipryGet
2022/01/04 10:26:14 Deploying app: TestExipryGet. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:26:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet stored in temp store"
}
2022/01/04 10:26:20 Waiting for app: TestExipryGet to get deployed
2022/01/04 10:26:25 Waiting for app: TestExipryGet to get deployed
2022/01/04 10:26:30 Waiting for app: TestExipryGet to get deployed
2022/01/04 10:26:35 Waiting for app: TestExipryGet to get deployed
2022/01/04 10:26:35 App: TestExipryGet got deployed
2022/01/04 10:26:35 Starting bucket ops to source bucket
2022/01/04 10:27:20 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:27:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:27:20 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:27:20 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:27:25 Waiting for app: TestExipryGet to get un-deployed
2022/01/04 10:27:30 Waiting for app: TestExipryGet to get un-deployed
2022/01/04 10:27:35 Waiting for app: TestExipryGet to get un-deployed
2022/01/04 10:27:40 Waiting for app: TestExipryGet to get un-deployed
2022/01/04 10:27:40 App: TestExipryGet got un-deployed
2022/01/04 10:27:40 No eventing-con process running
2022/01/04 10:27:40 Function: TestExipryGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet deleting in background"
}
2022/01/04 10:27:42 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:27:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:27:49 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:27:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:27:54 Pumping document in the destination bucket for expiry get
2022/01/04 10:27:54 Starting bucket ops to source bucket
2022/01/04 10:27:54 Deploying app: TestExipryGet. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:27:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet stored in temp store"
}
2022/01/04 10:28:01 Waiting for app: TestExipryGet to get deployed
2022/01/04 10:28:06 Waiting for app: TestExipryGet to get deployed
2022/01/04 10:28:11 Waiting for app: TestExipryGet to get deployed
2022/01/04 10:28:16 Waiting for app: TestExipryGet to get deployed
2022/01/04 10:28:16 App: TestExipryGet got deployed
2022/01/04 10:28:16 Starting bucket ops to source bucket
2022/01/04 10:29:01 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:29:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:29:01 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:29:01 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:29:06 Waiting for app: TestExipryGet to get un-deployed
2022/01/04 10:29:11 Waiting for app: TestExipryGet to get un-deployed
2022/01/04 10:29:16 Waiting for app: TestExipryGet to get un-deployed
2022/01/04 10:29:21 Waiting for app: TestExipryGet to get un-deployed
2022/01/04 10:29:21 App: TestExipryGet got un-deployed
2022/01/04 10:29:21 No eventing-con process running
2022/01/04 10:29:21 Function: TestExipryGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet deleting in background"
}
2022/01/04 10:29:23 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:29:33 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:29:38 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/04 10:29:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:29:39 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:29:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryGet (210.83s)
=== RUN   TestExipryInsert
2022/01/04 10:29:44 Deploying app: TestExipryInsert. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:29:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert stored in temp store"
}
2022/01/04 10:29:51 Waiting for app: TestExipryInsert to get deployed
2022/01/04 10:29:56 Waiting for app: TestExipryInsert to get deployed
2022/01/04 10:30:01 Waiting for app: TestExipryInsert to get deployed
2022/01/04 10:30:06 Waiting for app: TestExipryInsert to get deployed
2022/01/04 10:30:06 App: TestExipryInsert got deployed
2022/01/04 10:30:06 Starting bucket ops to source bucket
2022/01/04 10:30:51 Waiting for dst bucket item count to get to: 0 curr count: 200
2022/01/04 10:30:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:30:51 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:30:51 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:30:56 Waiting for app: TestExipryInsert to get un-deployed
2022/01/04 10:31:01 Waiting for app: TestExipryInsert to get un-deployed
2022/01/04 10:31:06 Waiting for app: TestExipryInsert to get un-deployed
2022/01/04 10:31:11 Waiting for app: TestExipryInsert to get un-deployed
2022/01/04 10:31:11 App: TestExipryInsert got un-deployed
2022/01/04 10:31:11 No eventing-con process running
2022/01/04 10:31:11 Function: TestExipryInsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert deleting in background"
}
2022/01/04 10:31:13 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:31:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:31:20 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:31:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:31:25 Testing on the destination bucket for expiry insert
2022/01/04 10:31:25 Deploying app: TestExipryInsert. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:31:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert stored in temp store"
}
2022/01/04 10:31:31 Waiting for app: TestExipryInsert to get deployed
2022/01/04 10:31:36 Waiting for app: TestExipryInsert to get deployed
2022/01/04 10:31:41 Waiting for app: TestExipryInsert to get deployed
2022/01/04 10:31:46 Waiting for app: TestExipryInsert to get deployed
2022/01/04 10:31:46 App: TestExipryInsert got deployed
2022/01/04 10:31:46 Starting bucket ops to source bucket
2022/01/04 10:32:32 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:32:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:32:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:32:32 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:32:37 Waiting for app: TestExipryInsert to get un-deployed
2022/01/04 10:32:42 Waiting for app: TestExipryInsert to get un-deployed
2022/01/04 10:32:47 Waiting for app: TestExipryInsert to get un-deployed
2022/01/04 10:32:52 Waiting for app: TestExipryInsert to get un-deployed
2022/01/04 10:32:52 App: TestExipryInsert got un-deployed
2022/01/04 10:32:52 No eventing-con process running
2022/01/04 10:32:52 Function: TestExipryInsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert deleting in background"
}
2022/01/04 10:32:53 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:33:03 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:33:08 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/04 10:33:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:33:10 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:33:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryInsert (210.66s)
=== RUN   TestExipryReplace
2022/01/04 10:33:15 Deploying app: TestExipryReplace. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:33:16 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace stored in temp store"
}
2022/01/04 10:33:21 Waiting for app: TestExipryReplace to get deployed
2022/01/04 10:33:26 Waiting for app: TestExipryReplace to get deployed
2022/01/04 10:33:31 Waiting for app: TestExipryReplace to get deployed
2022/01/04 10:33:36 Waiting for app: TestExipryReplace to get deployed
2022/01/04 10:33:36 App: TestExipryReplace got deployed
2022/01/04 10:33:36 Starting bucket ops to source bucket
2022/01/04 10:34:22 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:34:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:34:22 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:34:22 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:34:27 Waiting for app: TestExipryReplace to get un-deployed
2022/01/04 10:34:32 Waiting for app: TestExipryReplace to get un-deployed
2022/01/04 10:34:37 Waiting for app: TestExipryReplace to get un-deployed
2022/01/04 10:34:42 Waiting for app: TestExipryReplace to get un-deployed
2022/01/04 10:34:42 App: TestExipryReplace got un-deployed
2022/01/04 10:34:42 No eventing-con process running
2022/01/04 10:34:42 Function: TestExipryReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace deleting in background"
}
2022/01/04 10:34:43 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:34:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:34:51 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:34:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:34:56 Testing on the destination bucket for expiry insert
2022/01/04 10:34:56 Deploying app: TestExipryReplace. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:34:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace stored in temp store"
}
2022/01/04 10:35:02 Waiting for app: TestExipryReplace to get deployed
2022/01/04 10:35:07 Waiting for app: TestExipryReplace to get deployed
2022/01/04 10:35:12 Waiting for app: TestExipryReplace to get deployed
2022/01/04 10:35:17 Waiting for app: TestExipryReplace to get deployed
2022/01/04 10:35:17 App: TestExipryReplace got deployed
2022/01/04 10:35:17 Starting bucket ops to source bucket
2022/01/04 10:36:02 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:36:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:36:02 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:36:02 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:36:07 Waiting for app: TestExipryReplace to get un-deployed
2022/01/04 10:36:12 Waiting for app: TestExipryReplace to get un-deployed
2022/01/04 10:36:17 Waiting for app: TestExipryReplace to get un-deployed
2022/01/04 10:36:22 Waiting for app: TestExipryReplace to get un-deployed
2022/01/04 10:36:22 App: TestExipryReplace got un-deployed
2022/01/04 10:36:22 No eventing-con process running
2022/01/04 10:36:22 Function: TestExipryReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace deleting in background"
}
2022/01/04 10:36:24 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:36:34 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:36:39 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/04 10:36:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:36:41 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:36:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryReplace (210.54s)
=== RUN   TestExipryUpsert
2022/01/04 10:36:46 Deploying app: TestExipryUpsert. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:36:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert stored in temp store"
}
2022/01/04 10:36:52 Waiting for app: TestExipryUpsert to get deployed
2022/01/04 10:36:57 Waiting for app: TestExipryUpsert to get deployed
2022/01/04 10:37:02 Waiting for app: TestExipryUpsert to get deployed
2022/01/04 10:37:07 Waiting for app: TestExipryUpsert to get deployed
2022/01/04 10:37:07 App: TestExipryUpsert got deployed
2022/01/04 10:37:07 Starting bucket ops to source bucket
2022/01/04 10:37:52 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:37:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:37:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:37:52 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:37:57 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/04 10:38:02 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/04 10:38:07 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/04 10:38:12 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/04 10:38:12 App: TestExipryUpsert got un-deployed
2022/01/04 10:38:12 No eventing-con process running
2022/01/04 10:38:12 Function: TestExipryUpsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert deleting in background"
}
2022/01/04 10:38:14 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:38:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:38:21 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:38:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:38:26 Testing on the destination bucket for expiry insert
2022/01/04 10:38:26 Deploying app: TestExipryUpsert. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:38:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert stored in temp store"
}
2022/01/04 10:38:32 Waiting for app: TestExipryUpsert to get deployed
2022/01/04 10:38:37 Waiting for app: TestExipryUpsert to get deployed
2022/01/04 10:38:42 Waiting for app: TestExipryUpsert to get deployed
2022/01/04 10:38:47 Waiting for app: TestExipryUpsert to get deployed
2022/01/04 10:38:47 App: TestExipryUpsert got deployed
2022/01/04 10:38:47 Starting bucket ops to source bucket
2022/01/04 10:39:33 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:39:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:39:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:39:33 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:39:38 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/04 10:39:43 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/04 10:39:48 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/04 10:39:53 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/04 10:39:53 App: TestExipryUpsert got un-deployed
2022/01/04 10:39:53 No eventing-con process running
2022/01/04 10:39:53 Function: TestExipryUpsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert deleting in background"
}
2022/01/04 10:39:55 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:40:05 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:40:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:40:06 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:40:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryUpsert (205.68s)
=== RUN   TestCasReplace
2022/01/04 10:40:11 Deploying app: TestCasReplace. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:40:13 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace stored in temp store"
}
2022/01/04 10:40:18 Waiting for app: TestCasReplace to get deployed
2022/01/04 10:40:23 Waiting for app: TestCasReplace to get deployed
2022/01/04 10:40:28 Waiting for app: TestCasReplace to get deployed
2022/01/04 10:40:33 Waiting for app: TestCasReplace to get deployed
2022/01/04 10:40:33 App: TestCasReplace got deployed
2022/01/04 10:40:33 Starting bucket ops to source bucket
2022/01/04 10:40:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:40:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:40:33 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:40:38 Waiting for app: TestCasReplace to get un-deployed
2022/01/04 10:40:43 Waiting for app: TestCasReplace to get un-deployed
2022/01/04 10:40:48 Waiting for app: TestCasReplace to get un-deployed
2022/01/04 10:40:53 Waiting for app: TestCasReplace to get un-deployed
2022/01/04 10:40:53 App: TestCasReplace got un-deployed
2022/01/04 10:40:53 No eventing-con process running
2022/01/04 10:40:53 Function: TestCasReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace deleting in background"
}
2022/01/04 10:40:55 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:41:05 Waiting for dst bucket item count to get to: 0 curr count: 3
2022/01/04 10:41:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:41:06 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:41:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:41:11 Testing on the destination bucket for upsert with cas
2022/01/04 10:41:11 Starting bucket ops to source bucket
2022/01/04 10:41:12 Deploying app: TestCasReplace. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:41:13 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace stored in temp store"
}
2022/01/04 10:41:18 Waiting for app: TestCasReplace to get deployed
2022/01/04 10:41:23 Waiting for app: TestCasReplace to get deployed
2022/01/04 10:41:28 Waiting for app: TestCasReplace to get deployed
2022/01/04 10:41:33 Waiting for app: TestCasReplace to get deployed
2022/01/04 10:41:33 App: TestCasReplace got deployed
2022/01/04 10:41:33 Starting bucket ops to source bucket
2022/01/04 10:41:38 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:41:43 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:41:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:41:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:41:43 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:41:48 Waiting for app: TestCasReplace to get un-deployed
2022/01/04 10:41:53 Waiting for app: TestCasReplace to get un-deployed
2022/01/04 10:41:58 Waiting for app: TestCasReplace to get un-deployed
2022/01/04 10:42:03 Waiting for app: TestCasReplace to get un-deployed
2022/01/04 10:42:03 App: TestCasReplace got un-deployed
2022/01/04 10:42:03 No eventing-con process running
2022/01/04 10:42:03 Function: TestCasReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace deleting in background"
}
2022/01/04 10:42:05 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:42:15 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:42:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:42:16 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:42:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCasReplace (130.11s)
=== RUN   TestCasDelete
2022/01/04 10:42:21 Deploying app: TestCasDelete. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:42:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete stored in temp store"
}
2022/01/04 10:42:28 Waiting for app: TestCasDelete to get deployed
2022/01/04 10:42:33 Waiting for app: TestCasDelete to get deployed
2022/01/04 10:42:38 Waiting for app: TestCasDelete to get deployed
2022/01/04 10:42:43 Waiting for app: TestCasDelete to get deployed
2022/01/04 10:42:43 App: TestCasDelete got deployed
2022/01/04 10:42:43 Starting bucket ops to source bucket
2022/01/04 10:42:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:42:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:42:43 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:42:48 Waiting for app: TestCasDelete to get un-deployed
2022/01/04 10:42:53 Waiting for app: TestCasDelete to get un-deployed
2022/01/04 10:42:58 Waiting for app: TestCasDelete to get un-deployed
2022/01/04 10:43:03 Waiting for app: TestCasDelete to get un-deployed
2022/01/04 10:43:03 App: TestCasDelete got un-deployed
2022/01/04 10:43:03 No eventing-con process running
2022/01/04 10:43:03 Function: TestCasDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete deleting in background"
}
2022/01/04 10:43:05 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:43:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:43:12 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:43:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:43:17 Testing on the destination bucket for delete with cas
2022/01/04 10:43:17 Starting bucket ops to source bucket
2022/01/04 10:43:17 Deploying app: TestCasDelete. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:43:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete stored in temp store"
}
2022/01/04 10:43:23 Waiting for app: TestCasDelete to get deployed
2022/01/04 10:43:29 Waiting for app: TestCasDelete to get deployed
2022/01/04 10:43:34 Waiting for app: TestCasDelete to get deployed
2022/01/04 10:43:39 Waiting for app: TestCasDelete to get deployed
2022/01/04 10:43:39 App: TestCasDelete got deployed
2022/01/04 10:43:39 Starting bucket ops to source bucket
2022/01/04 10:43:44 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:43:49 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/04 10:43:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:43:49 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:43:49 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 10:43:54 Waiting for app: TestCasDelete to get un-deployed
2022/01/04 10:43:59 Waiting for app: TestCasDelete to get un-deployed
2022/01/04 10:44:04 Waiting for app: TestCasDelete to get un-deployed
2022/01/04 10:44:09 Waiting for app: TestCasDelete to get un-deployed
2022/01/04 10:44:09 App: TestCasDelete got un-deployed
2022/01/04 10:44:09 No eventing-con process running
2022/01/04 10:44:09 Function: TestCasDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete deleting in background"
}
2022/01/04 10:44:11 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:44:21 Waiting for dst bucket item count to get to: 0 curr count: 89
2022/01/04 10:44:26 Waiting for dst bucket item count to get to: 0 curr count: 89
2022/01/04 10:44:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:44:27 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:44:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCasDelete (131.03s)
=== RUN   TestCountersIncrement
2022/01/04 10:44:32 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/04 10:44:39 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 10:44:39 Removing node(s): [] from the cluster
2022/01/04 10:44:44 Rebalance progress: 100
2022/01/04 10:44:44 Deploying app: TestCountersIncrement. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:44:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement stored in temp store"
}
2022/01/04 10:44:51 Waiting for app: TestCountersIncrement to get deployed
2022/01/04 10:44:56 Waiting for app: TestCountersIncrement to get deployed
2022/01/04 10:45:01 Waiting for app: TestCountersIncrement to get deployed
2022/01/04 10:45:06 Waiting for app: TestCountersIncrement to get deployed
2022/01/04 10:45:06 App: TestCountersIncrement got deployed
2022/01/04 10:45:06 Starting bucket ops to source bucket
2022/01/04 10:45:12 Waiting for dst bucket item count to get to: 1024 curr count: 0
2022/01/04 10:45:17 Waiting for dst bucket item count to get to: 1024 curr count: 512
2022/01/04 10:45:17 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2022/01/04 10:45:17 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:45:22 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/04 10:45:27 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/04 10:45:32 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/04 10:45:37 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/04 10:45:37 App: TestCountersIncrement got un-deployed
2022/01/04 10:45:37 No eventing-con process running
2022/01/04 10:45:37 Function: TestCountersIncrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement deleting in background"
}
2022/01/04 10:45:39 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:45:49 Waiting for dst bucket item count to get to: 0 curr count: 994
2022/01/04 10:45:54 Waiting for dst bucket item count to get to: 0 curr count: 481
2022/01/04 10:45:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:45:56 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:46:06 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/04 10:46:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:46:06 Deploying app: TestCountersIncrement. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:46:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement stored in temp store"
}
2022/01/04 10:46:12 Waiting for app: TestCountersIncrement to get deployed
2022/01/04 10:46:17 Waiting for app: TestCountersIncrement to get deployed
2022/01/04 10:46:22 Waiting for app: TestCountersIncrement to get deployed
2022/01/04 10:46:27 Waiting for app: TestCountersIncrement to get deployed
2022/01/04 10:46:27 App: TestCountersIncrement got deployed
2022/01/04 10:46:27 Starting bucket ops to source bucket
2022/01/04 10:46:33 Waiting for dst bucket item count to get to: 2048 curr count: 0
2022/01/04 10:46:38 Waiting for dst bucket item count to get to: 2048 curr count: 1213
2022/01/04 10:46:43 Waiting for dst bucket item count to get to: 2048 curr count: 1213
2022/01/04 10:46:43 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2022/01/04 10:46:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:46:48 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/04 10:46:53 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/04 10:46:58 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/04 10:47:03 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/04 10:47:03 App: TestCountersIncrement got un-deployed
2022/01/04 10:47:03 No eventing-con process running
2022/01/04 10:47:03 Function: TestCountersIncrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement deleting in background"
}
2022/01/04 10:47:05 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:47:15 Waiting for dst bucket item count to get to: 0 curr count: 2048
2022/01/04 10:47:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:47:17 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:47:27 Waiting for dst bucket item count to get to: 0 curr count: 1
2022/01/04 10:47:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:47:27 Removing node(s): [http://127.0.0.1:19002 http://127.0.0.1:19003] from the cluster
2022/01/04 10:47:32 Rebalance progress: 100
--- PASS: TestCountersIncrement (179.42s)
=== RUN   TestCountersDecrement
2022/01/04 10:47:32 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/04 10:47:32 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 10:47:32 Removing node(s): [] from the cluster
2022/01/04 10:47:37 Rebalance progress: 100
2022/01/04 10:47:37 Deploying app: TestCountersDecrement. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:47:39 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement stored in temp store"
}
2022/01/04 10:47:44 Waiting for app: TestCountersDecrement to get deployed
2022/01/04 10:47:49 Waiting for app: TestCountersDecrement to get deployed
2022/01/04 10:47:54 Waiting for app: TestCountersDecrement to get deployed
2022/01/04 10:47:59 Waiting for app: TestCountersDecrement to get deployed
2022/01/04 10:47:59 App: TestCountersDecrement got deployed
2022/01/04 10:47:59 Starting bucket ops to source bucket
2022/01/04 10:48:05 Waiting for dst bucket item count to get to: 1024 curr count: 0
2022/01/04 10:48:10 Waiting for dst bucket item count to get to: 1024 curr count: 290
2022/01/04 10:48:15 Waiting for dst bucket item count to get to: 1024 curr count: 802
2022/01/04 10:48:15 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2022/01/04 10:48:15 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:48:20 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/04 10:48:25 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/04 10:48:30 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/04 10:48:35 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/04 10:48:35 App: TestCountersDecrement got un-deployed
2022/01/04 10:48:35 No eventing-con process running
2022/01/04 10:48:35 Function: TestCountersDecrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement deleting in background"
}
2022/01/04 10:48:37 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:48:47 Waiting for dst bucket item count to get to: 0 curr count: 1025
2022/01/04 10:48:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:48:49 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:48:59 Waiting for dst bucket item count to get to: 0 curr count: 913
2022/01/04 10:49:04 Waiting for dst bucket item count to get to: 0 curr count: 401
2022/01/04 10:49:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:49:04 Deploying app: TestCountersDecrement. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:49:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement stored in temp store"
}
2022/01/04 10:49:10 Waiting for app: TestCountersDecrement to get deployed
2022/01/04 10:49:15 Waiting for app: TestCountersDecrement to get deployed
2022/01/04 10:49:20 Waiting for app: TestCountersDecrement to get deployed
2022/01/04 10:49:25 Waiting for app: TestCountersDecrement to get deployed
2022/01/04 10:49:25 App: TestCountersDecrement got deployed
2022/01/04 10:49:25 Starting bucket ops to source bucket
2022/01/04 10:49:31 Waiting for dst bucket item count to get to: 2048 curr count: 0
2022/01/04 10:49:36 Waiting for dst bucket item count to get to: 2048 curr count: 1024
2022/01/04 10:49:36 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2022/01/04 10:49:36 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:49:41 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/04 10:49:46 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/04 10:49:51 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/04 10:49:56 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/04 10:49:56 App: TestCountersDecrement got un-deployed
2022/01/04 10:49:56 No eventing-con process running
2022/01/04 10:49:56 Function: TestCountersDecrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement deleting in background"
}
2022/01/04 10:49:58 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:50:08 Waiting for dst bucket item count to get to: 0 curr count: 1503
2022/01/04 10:50:13 Waiting for dst bucket item count to get to: 0 curr count: 479
2022/01/04 10:50:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:50:15 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:50:25 Waiting for dst bucket item count to get to: 0 curr count: 1
2022/01/04 10:50:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:50:25 Removing node(s): [http://127.0.0.1:19002 http://127.0.0.1:19003] from the cluster
2022/01/04 10:50:30 Rebalance progress: 100
--- PASS: TestCountersDecrement (178.15s)
=== RUN   TestCacheGet
2022/01/04 10:50:30 Deploying app: TestCacheGet. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:50:31 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheGet stored in temp store"
}
2022/01/04 10:50:36 Waiting for app: TestCacheGet to get deployed
2022/01/04 10:50:41 Waiting for app: TestCacheGet to get deployed
2022/01/04 10:50:46 Waiting for app: TestCacheGet to get deployed
2022/01/04 10:50:51 Waiting for app: TestCacheGet to get deployed
2022/01/04 10:50:51 App: TestCacheGet got deployed
2022/01/04 10:50:51 Starting bucket ops to source bucket
2022/01/04 10:50:56 Waiting for dst bucket item count to get to: 20 curr count: 0
2022/01/04 10:51:01 Waiting for dst bucket item count to get to: 20 curr count: 0
2022/01/04 10:51:07 Waiting for dst bucket item count to get to: 20 curr count: 5
2022/01/04 10:51:12 Waiting for dst bucket item count to get to: 20 curr count: 5
2022/01/04 10:51:17 Waiting for dst bucket item count to get to: 20 curr count: 18
2022/01/04 10:51:22 Waiting for dst bucket item count to get to: 20 curr count: 18
2022/01/04 10:51:22 src & dst bucket item count matched up. src bucket count: 20 dst bucket count: 20
2022/01/04 10:51:22 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:51:27 Waiting for app: TestCacheGet to get un-deployed
2022/01/04 10:51:32 Waiting for app: TestCacheGet to get un-deployed
2022/01/04 10:51:37 Waiting for app: TestCacheGet to get un-deployed
2022/01/04 10:51:42 Waiting for app: TestCacheGet to get un-deployed
2022/01/04 10:51:42 App: TestCacheGet got un-deployed
2022/01/04 10:51:42 No eventing-con process running
2022/01/04 10:51:42 Function: TestCacheGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheGet deleting in background"
}
2022/01/04 10:51:44 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:51:54 Waiting for dst bucket item count to get to: 0 curr count: 20
2022/01/04 10:51:59 Waiting for dst bucket item count to get to: 0 curr count: 10
2022/01/04 10:51:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:52:00 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:52:10 Waiting for dst bucket item count to get to: 0 curr count: 16
2022/01/04 10:52:15 Waiting for dst bucket item count to get to: 0 curr count: 16
2022/01/04 10:52:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheGet (105.30s)
=== RUN   TestCacheRYOW
2022/01/04 10:52:15 Deploying app: TestCacheRYOW. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:52:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheRYOW stored in temp store"
}
2022/01/04 10:52:22 Waiting for app: TestCacheRYOW to get deployed
2022/01/04 10:52:27 Waiting for app: TestCacheRYOW to get deployed
2022/01/04 10:52:32 Waiting for app: TestCacheRYOW to get deployed
2022/01/04 10:52:37 Waiting for app: TestCacheRYOW to get deployed
2022/01/04 10:52:37 App: TestCacheRYOW got deployed
2022/01/04 10:52:37 Starting bucket ops to source bucket
2022/01/04 10:52:42 Waiting for dst bucket item count to get to: 50 curr count: 0
2022/01/04 10:52:42 src & dst bucket item count matched up. src bucket count: 50 dst bucket count: 50
2022/01/04 10:52:42 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:52:47 Waiting for app: TestCacheRYOW to get un-deployed
2022/01/04 10:52:52 Waiting for app: TestCacheRYOW to get un-deployed
2022/01/04 10:52:57 Waiting for app: TestCacheRYOW to get un-deployed
2022/01/04 10:53:02 Waiting for app: TestCacheRYOW to get un-deployed
2022/01/04 10:53:02 App: TestCacheRYOW got un-deployed
2022/01/04 10:53:02 No eventing-con process running
2022/01/04 10:53:02 Function: TestCacheRYOW delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheRYOW deleting in background"
}
2022/01/04 10:53:04 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:53:14 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/04 10:53:19 Waiting for dst bucket item count to get to: 0 curr count: 25
2022/01/04 10:53:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:53:21 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:53:31 Waiting for dst bucket item count to get to: 0 curr count: 42
2022/01/04 10:53:36 Waiting for dst bucket item count to get to: 0 curr count: 42
2022/01/04 10:53:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheRYOW (80.28s)
=== RUN   TestCacheExpiry
2022/01/04 10:53:36 Deploying app: TestCacheExpiry. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:53:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiry stored in temp store"
}
2022/01/04 10:53:42 Waiting for app: TestCacheExpiry to get deployed
2022/01/04 10:53:47 Waiting for app: TestCacheExpiry to get deployed
2022/01/04 10:53:52 Waiting for app: TestCacheExpiry to get deployed
2022/01/04 10:53:57 Waiting for app: TestCacheExpiry to get deployed
2022/01/04 10:53:57 App: TestCacheExpiry got deployed
2022/01/04 10:53:57 Starting bucket ops to source bucket
2022/01/04 10:54:02 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/04 10:54:07 Waiting for dst bucket item count to get to: 100 curr count: 19
2022/01/04 10:54:12 Waiting for dst bucket item count to get to: 100 curr count: 19
2022/01/04 10:54:17 Waiting for dst bucket item count to get to: 100 curr count: 94
2022/01/04 10:54:22 Waiting for dst bucket item count to get to: 100 curr count: 94
2022/01/04 10:54:22 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/04 10:54:22 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:54:27 Waiting for app: TestCacheExpiry to get un-deployed
2022/01/04 10:54:32 Waiting for app: TestCacheExpiry to get un-deployed
2022/01/04 10:54:37 Waiting for app: TestCacheExpiry to get un-deployed
2022/01/04 10:54:42 Waiting for app: TestCacheExpiry to get un-deployed
2022/01/04 10:54:42 App: TestCacheExpiry got un-deployed
2022/01/04 10:54:42 No eventing-con process running
2022/01/04 10:54:42 Function: TestCacheExpiry delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiry deleting in background"
}
2022/01/04 10:54:44 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:54:54 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/04 10:54:59 Waiting for dst bucket item count to get to: 0 curr count: 25
2022/01/04 10:54:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:55:01 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:55:11 Waiting for dst bucket item count to get to: 0 curr count: 97
2022/01/04 10:55:16 Waiting for dst bucket item count to get to: 0 curr count: 97
2022/01/04 10:55:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheExpiry (100.32s)
=== RUN   TestCacheExpiryCustom
2022/01/04 10:55:16 Deploying app: TestCacheExpiryCustom. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:55:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiryCustom stored in temp store"
}
2022/01/04 10:55:22 Waiting for app: TestCacheExpiryCustom to get deployed
2022/01/04 10:55:27 Waiting for app: TestCacheExpiryCustom to get deployed
2022/01/04 10:55:32 Waiting for app: TestCacheExpiryCustom to get deployed
2022/01/04 10:55:37 Waiting for app: TestCacheExpiryCustom to get deployed
2022/01/04 10:55:37 App: TestCacheExpiryCustom got deployed
2022/01/04 10:55:37 Starting bucket ops to source bucket
2022/01/04 10:55:42 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/04 10:55:47 Waiting for dst bucket item count to get to: 100 curr count: 12
2022/01/04 10:55:52 Waiting for dst bucket item count to get to: 100 curr count: 12
2022/01/04 10:55:57 Waiting for dst bucket item count to get to: 100 curr count: 86
2022/01/04 10:56:02 Waiting for dst bucket item count to get to: 100 curr count: 86
2022/01/04 10:56:02 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/04 10:56:02 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:56:07 Waiting for app: TestCacheExpiryCustom to get un-deployed
2022/01/04 10:56:13 Waiting for app: TestCacheExpiryCustom to get un-deployed
2022/01/04 10:56:18 Waiting for app: TestCacheExpiryCustom to get un-deployed
2022/01/04 10:56:23 Waiting for app: TestCacheExpiryCustom to get un-deployed
2022/01/04 10:56:23 App: TestCacheExpiryCustom got un-deployed
2022/01/04 10:56:23 No eventing-con process running
2022/01/04 10:56:23 Function: TestCacheExpiryCustom delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiryCustom deleting in background"
}
2022/01/04 10:56:24 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:56:34 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/04 10:56:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:56:36 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:56:46 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 10:56:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheExpiryCustom (90.20s)
=== RUN   TestCacheOverflowCustom
2022/01/04 10:56:46 Deploying app: TestCacheOverflowCustom. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:56:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheOverflowCustom stored in temp store"
}
2022/01/04 10:56:52 Waiting for app: TestCacheOverflowCustom to get deployed
2022/01/04 10:56:57 Waiting for app: TestCacheOverflowCustom to get deployed
2022/01/04 10:57:02 Waiting for app: TestCacheOverflowCustom to get deployed
2022/01/04 10:57:07 Waiting for app: TestCacheOverflowCustom to get deployed
2022/01/04 10:57:07 App: TestCacheOverflowCustom got deployed
2022/01/04 10:57:07 Starting bucket ops to source bucket
2022/01/04 10:57:12 Waiting for dst bucket item count to get to: 35 curr count: 0
2022/01/04 10:57:17 Waiting for dst bucket item count to get to: 35 curr count: 5
2022/01/04 10:57:22 Waiting for dst bucket item count to get to: 35 curr count: 5
2022/01/04 10:57:27 Waiting for dst bucket item count to get to: 35 curr count: 25
2022/01/04 10:57:32 Waiting for dst bucket item count to get to: 35 curr count: 25
2022/01/04 10:57:37 Waiting for dst bucket item count to get to: 35 curr count: 34
2022/01/04 10:57:43 Waiting for dst bucket item count to get to: 35 curr count: 34
2022/01/04 10:57:43 src & dst bucket item count matched up. src bucket count: 35 dst bucket count: 35
2022/01/04 10:57:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:57:48 Waiting for app: TestCacheOverflowCustom to get un-deployed
2022/01/04 10:57:53 Waiting for app: TestCacheOverflowCustom to get un-deployed
2022/01/04 10:57:58 Waiting for app: TestCacheOverflowCustom to get un-deployed
2022/01/04 10:58:03 Waiting for app: TestCacheOverflowCustom to get un-deployed
2022/01/04 10:58:03 App: TestCacheOverflowCustom got un-deployed
2022/01/04 10:58:03 No eventing-con process running
2022/01/04 10:58:03 Function: TestCacheOverflowCustom delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheOverflowCustom deleting in background"
}
2022/01/04 10:58:04 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:58:14 Waiting for dst bucket item count to get to: 0 curr count: 5
2022/01/04 10:58:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:58:16 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:58:26 Waiting for dst bucket item count to get to: 0 curr count: 35
2022/01/04 10:58:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheOverflowCustom (100.14s)
=== RUN   TestStrictMode
2022/01/04 10:58:26 Deploying app: TestStrictMode. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:58:27 Context: Post to main store, response code: 422 dump: {
 "name": "ERR_HANDLER_COMPILATION",
 "code": 27,
 "description": {
  "area": "handlerCode",
  "column_number": 63,
  "compile_success": false,
  "description": "        destination[meta.id] = 00000000000000000000000000000101;\n                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nSyntaxError: Octal literals are not allowed in strict mode.\n",
  "index": 132,
  "language": "JavaScript",
  "line_number": 4
 }
}
--- PASS: TestStrictMode (1.06s)
=== RUN   TestDataTypes
2022/01/04 10:58:27 Deploying app: TestDataTypes. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:58:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDataTypes stored in temp store"
}
2022/01/04 10:58:33 Waiting for app: TestDataTypes to get deployed
2022/01/04 10:58:39 Waiting for app: TestDataTypes to get deployed
2022/01/04 10:58:44 Waiting for app: TestDataTypes to get deployed
2022/01/04 10:58:49 Waiting for app: TestDataTypes to get deployed
2022/01/04 10:58:49 App: TestDataTypes got deployed
2022/01/04 10:58:49 Starting bucket ops to source bucket
2022/01/04 10:58:54 Waiting for dst bucket item count to get to: 18 curr count: 0
2022/01/04 10:58:59 Waiting for dst bucket item count to get to: 18 curr count: 10
2022/01/04 10:59:04 Waiting for dst bucket item count to get to: 18 curr count: 10
2022/01/04 10:59:04 src & dst bucket item count matched up. src bucket count: 18 dst bucket count: 18
2022/01/04 10:59:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 10:59:09 Waiting for app: TestDataTypes to get un-deployed
2022/01/04 10:59:14 Waiting for app: TestDataTypes to get un-deployed
2022/01/04 10:59:19 Waiting for app: TestDataTypes to get un-deployed
2022/01/04 10:59:24 Waiting for app: TestDataTypes to get un-deployed
2022/01/04 10:59:24 App: TestDataTypes got un-deployed
2022/01/04 10:59:24 No eventing-con process running
2022/01/04 10:59:24 Function: TestDataTypes delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDataTypes deleting in background"
}
2022/01/04 10:59:26 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:59:36 Waiting for dst bucket item count to get to: 0 curr count: 1
2022/01/04 10:59:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 10:59:37 Context: Bucket flush, response code: 200 dump: 
2022/01/04 10:59:47 Waiting for dst bucket item count to get to: 0 curr count: 10
2022/01/04 10:59:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDataTypes (80.13s)
=== RUN   TestEnoentGet
2022/01/04 10:59:47 Deploying app: TestEnoentGet. Item count src bucket: 0 dst bucket: 0
2022/01/04 10:59:49 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet stored in temp store"
}
2022/01/04 10:59:54 Waiting for app: TestEnoentGet to get deployed
2022/01/04 10:59:59 Waiting for app: TestEnoentGet to get deployed
2022/01/04 11:00:04 Waiting for app: TestEnoentGet to get deployed
2022/01/04 11:00:09 Waiting for app: TestEnoentGet to get deployed
2022/01/04 11:00:09 App: TestEnoentGet got deployed
2022/01/04 11:00:09 Starting bucket ops to source bucket
2022/01/04 11:00:14 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/04 11:00:19 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/04 11:00:19 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/04 11:00:19 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:00:24 Waiting for app: TestEnoentGet to get un-deployed
2022/01/04 11:00:29 Waiting for app: TestEnoentGet to get un-deployed
2022/01/04 11:00:34 Waiting for app: TestEnoentGet to get un-deployed
2022/01/04 11:00:39 Waiting for app: TestEnoentGet to get un-deployed
2022/01/04 11:00:39 App: TestEnoentGet got un-deployed
2022/01/04 11:00:39 No eventing-con process running
2022/01/04 11:00:39 Function: TestEnoentGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet deleting in background"
}
2022/01/04 11:00:41 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:00:51 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 11:00:56 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 11:00:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:00:58 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:01:08 Waiting for dst bucket item count to get to: 0 curr count: 58
2022/01/04 11:01:13 Waiting for dst bucket item count to get to: 0 curr count: 8
2022/01/04 11:01:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:01:13 Deploying app: TestEnoentGet. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:01:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet stored in temp store"
}
2022/01/04 11:01:19 Waiting for app: TestEnoentGet to get deployed
2022/01/04 11:01:24 Waiting for app: TestEnoentGet to get deployed
2022/01/04 11:01:29 Waiting for app: TestEnoentGet to get deployed
2022/01/04 11:01:34 Waiting for app: TestEnoentGet to get deployed
2022/01/04 11:01:34 App: TestEnoentGet got deployed
2022/01/04 11:01:34 Starting bucket ops to source bucket
2022/01/04 11:01:39 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/04 11:01:44 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/04 11:01:44 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/04 11:01:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:01:49 Waiting for app: TestEnoentGet to get un-deployed
2022/01/04 11:01:54 Waiting for app: TestEnoentGet to get un-deployed
2022/01/04 11:01:59 Waiting for app: TestEnoentGet to get un-deployed
2022/01/04 11:02:04 Waiting for app: TestEnoentGet to get un-deployed
2022/01/04 11:02:04 App: TestEnoentGet got un-deployed
2022/01/04 11:02:04 No eventing-con process running
2022/01/04 11:02:04 Function: TestEnoentGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet deleting in background"
}
2022/01/04 11:02:06 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:02:16 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 11:02:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:02:18 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:02:28 Waiting for dst bucket item count to get to: 0 curr count: 61
2022/01/04 11:02:33 Waiting for dst bucket item count to get to: 0 curr count: 11
2022/01/04 11:02:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentGet (165.48s)
=== RUN   TestEnoentDelete
2022/01/04 11:02:33 Deploying app: TestEnoentDelete. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:02:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete stored in temp store"
}
2022/01/04 11:02:39 Waiting for app: TestEnoentDelete to get deployed
2022/01/04 11:02:44 Waiting for app: TestEnoentDelete to get deployed
2022/01/04 11:02:49 Waiting for app: TestEnoentDelete to get deployed
2022/01/04 11:02:54 Waiting for app: TestEnoentDelete to get deployed
2022/01/04 11:02:54 App: TestEnoentDelete got deployed
2022/01/04 11:02:54 Starting bucket ops to source bucket
2022/01/04 11:02:59 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/04 11:03:04 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/04 11:03:04 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/04 11:03:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:03:10 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/04 11:03:15 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/04 11:03:20 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/04 11:03:25 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/04 11:03:25 App: TestEnoentDelete got un-deployed
2022/01/04 11:03:25 No eventing-con process running
2022/01/04 11:03:25 Function: TestEnoentDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete deleting in background"
}
2022/01/04 11:03:26 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:03:36 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 11:03:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:03:38 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:03:48 Waiting for dst bucket item count to get to: 0 curr count: 75
2022/01/04 11:03:53 Waiting for dst bucket item count to get to: 0 curr count: 25
2022/01/04 11:03:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:03:53 Deploying app: TestEnoentDelete. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:03:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete stored in temp store"
}
2022/01/04 11:03:59 Waiting for app: TestEnoentDelete to get deployed
2022/01/04 11:04:04 Waiting for app: TestEnoentDelete to get deployed
2022/01/04 11:04:09 Waiting for app: TestEnoentDelete to get deployed
2022/01/04 11:04:14 Waiting for app: TestEnoentDelete to get deployed
2022/01/04 11:04:14 App: TestEnoentDelete got deployed
2022/01/04 11:04:14 Starting bucket ops to source bucket
2022/01/04 11:04:20 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/04 11:04:25 Waiting for dst bucket item count to get to: 100 curr count: 50
2022/01/04 11:04:25 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/04 11:04:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:04:30 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/04 11:04:35 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/04 11:04:40 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/04 11:04:45 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/04 11:04:45 App: TestEnoentDelete got un-deployed
2022/01/04 11:04:45 No eventing-con process running
2022/01/04 11:04:45 Function: TestEnoentDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete deleting in background"
}
2022/01/04 11:04:47 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:04:57 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 11:04:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:04:58 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:05:08 Waiting for dst bucket item count to get to: 0 curr count: 82
2022/01/04 11:05:13 Waiting for dst bucket item count to get to: 0 curr count: 32
2022/01/04 11:05:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentDelete (160.51s)
=== RUN   TestError
2022/01/04 11:05:23 Waiting for app: TestError to get un-deployed
2022/01/04 11:05:23 App: TestError got un-deployed
2022/01/04 11:05:23 No eventing-con process running
2022/01/04 11:05:23 Function: TestError delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestError not found"
}
2022/01/04 11:05:25 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:05:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:05:32 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:05:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:05:37 Deploying app: TestError. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:05:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestError stored in temp store"
}
2022/01/04 11:05:43 Waiting for app: TestError to get deployed
2022/01/04 11:05:48 Waiting for app: TestError to get deployed
2022/01/04 11:05:53 Waiting for app: TestError to get deployed
2022/01/04 11:05:58 Waiting for app: TestError to get deployed
2022/01/04 11:05:58 App: TestError got deployed
2022/01/04 11:05:58 Starting bucket ops to source bucket
2022/01/04 11:06:03 Waiting for dst bucket item count to get to: 300 curr count: 0
2022/01/04 11:06:08 Waiting for dst bucket item count to get to: 300 curr count: 144
2022/01/04 11:06:08 src & dst bucket item count matched up. src bucket count: 300 dst bucket count: 300
2022/01/04 11:06:08 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:06:14 Waiting for app: TestError to get un-deployed
2022/01/04 11:06:19 Waiting for app: TestError to get un-deployed
2022/01/04 11:06:24 Waiting for app: TestError to get un-deployed
2022/01/04 11:06:29 Waiting for app: TestError to get un-deployed
2022/01/04 11:06:29 App: TestError got un-deployed
2022/01/04 11:06:29 No eventing-con process running
2022/01/04 11:06:29 Function: TestError delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestError deleting in background"
}
2022/01/04 11:06:30 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:06:40 Waiting for dst bucket item count to get to: 0 curr count: 80
2022/01/04 11:06:45 Waiting for dst bucket item count to get to: 0 curr count: 80
2022/01/04 11:06:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:06:47 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:06:57 Waiting for dst bucket item count to get to: 0 curr count: 300
2022/01/04 11:06:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestError (103.87s)
=== RUN   TestCRLF
2022/01/04 11:07:07 Waiting for app: TestCRLF to get un-deployed
2022/01/04 11:07:07 App: TestCRLF got un-deployed
2022/01/04 11:07:07 No eventing-con process running
2022/01/04 11:07:07 Function: TestCRLF delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCRLF not found"
}
2022/01/04 11:07:09 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:07:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:07:16 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:07:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:07:21 Deploying app: TestCRLF. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:07:22 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCRLF stored in temp store"
}
2022/01/04 11:07:27 Waiting for app: TestCRLF to get deployed
2022/01/04 11:07:32 Waiting for app: TestCRLF to get deployed
2022/01/04 11:07:37 Waiting for app: TestCRLF to get deployed
2022/01/04 11:07:42 Waiting for app: TestCRLF to get deployed
2022/01/04 11:07:42 App: TestCRLF got deployed
2022/01/04 11:07:42 Starting bucket ops to source bucket
2022/01/04 11:07:47 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/04 11:07:52 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/04 11:07:52 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/04 11:07:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:07:57 Waiting for app: TestCRLF to get un-deployed
2022/01/04 11:08:03 Waiting for app: TestCRLF to get un-deployed
2022/01/04 11:08:08 Waiting for app: TestCRLF to get un-deployed
2022/01/04 11:08:13 Waiting for app: TestCRLF to get un-deployed
2022/01/04 11:08:13 App: TestCRLF got un-deployed
2022/01/04 11:08:13 No eventing-con process running
2022/01/04 11:08:13 Function: TestCRLF delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCRLF deleting in background"
}
2022/01/04 11:08:14 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:08:24 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 11:08:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:08:26 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:08:36 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 11:08:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCRLF (98.80s)
=== RUN   TestImportExport
2022/01/04 11:08:46 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2022/01/04 11:08:46 App: TestImportExport_n1ql_insert_on_update got un-deployed
2022/01/04 11:08:46 No eventing-con process running
2022/01/04 11:08:46 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestImportExport_n1ql_insert_on_update not found"
}
2022/01/04 11:08:48 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:08:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:08:55 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:09:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:09:05 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2022/01/04 11:09:05 App: TestImportExport_bucket_op_on_update got un-deployed
2022/01/04 11:09:05 No eventing-con process running
2022/01/04 11:09:05 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestImportExport_bucket_op_on_update not found"
}
2022/01/04 11:09:07 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:09:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:09:13 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:09:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:09:18 Deploying app: TestImportExport_n1ql_insert_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:09:20 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update stored in temp store"
}
2022/01/04 11:09:20 Deploying app: TestImportExport_bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:09:21 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update stored in temp store"
}
2022/01/04 11:09:26 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2022/01/04 11:09:31 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2022/01/04 11:09:36 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2022/01/04 11:09:41 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2022/01/04 11:09:41 App: TestImportExport_n1ql_insert_on_update got deployed
2022/01/04 11:09:46 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2022/01/04 11:09:51 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2022/01/04 11:09:56 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2022/01/04 11:09:56 App: TestImportExport_bucket_op_on_update got deployed
2022/01/04 11:10:01 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2022/01/04 11:10:06 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2022/01/04 11:10:11 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2022/01/04 11:10:16 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2022/01/04 11:10:16 App: TestImportExport_n1ql_insert_on_update got un-deployed
2022/01/04 11:10:16 No eventing-con process running
2022/01/04 11:10:16 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update deleting in background"
}
2022/01/04 11:10:21 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2022/01/04 11:10:26 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2022/01/04 11:10:31 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2022/01/04 11:10:36 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2022/01/04 11:10:36 App: TestImportExport_bucket_op_on_update got un-deployed
2022/01/04 11:10:36 No eventing-con process running
2022/01/04 11:10:36 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update deleting in background"
}
2022/01/04 11:10:54 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2022/01/04 11:10:54 App: TestImportExport_bucket_op_on_update got un-deployed
2022/01/04 11:10:54 No eventing-con process running
2022/01/04 11:10:54 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update deleting in background"
}
2022/01/04 11:10:55 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:11:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:11:02 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:11:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:11:12 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2022/01/04 11:11:12 App: TestImportExport_n1ql_insert_on_update got un-deployed
2022/01/04 11:11:12 No eventing-con process running
2022/01/04 11:11:12 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update deleting in background"
}
2022/01/04 11:11:14 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:11:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:11:21 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:11:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestImportExport (169.66s)
=== RUN   TestDeployUndeployLoopNonDefaultSettings
2022/01/04 11:11:36 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:11:36 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2022/01/04 11:11:36 No eventing-con process running
2022/01/04 11:11:36 Function: TestDeployUndeployLoopNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeployUndeployLoopNonDefaultSettings not found"
}
2022/01/04 11:11:38 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:11:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:11:44 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:11:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:11:49 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:11:50 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2022/01/04 11:11:50 Starting bucket ops to source bucket
2022/01/04 11:11:58 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:12:03 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:12:08 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:12:13 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:12:13 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:12:18 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2022/01/04 11:12:18 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2022/01/04 11:12:19 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:12:19 Undeploying app: bucket_op_on_update
2022/01/04 11:12:24 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:12:29 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:12:34 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:12:39 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:12:39 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2022/01/04 11:12:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:12:39 No eventing-con process running
2022/01/04 11:12:40 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:12:48 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:13:23 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:13:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2022/01/04 11:13:24 Starting bucket ops to source bucket
2022/01/04 11:13:32 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:13:37 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:13:42 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:13:47 Waiting for dst bucket item count to get to: 5000 curr count: 1856
2022/01/04 11:13:52 Waiting for dst bucket item count to get to: 5000 curr count: 4356
2022/01/04 11:13:52 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:13:57 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2022/01/04 11:13:57 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2022/01/04 11:13:57 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:13:57 Undeploying app: bucket_op_on_update
2022/01/04 11:14:02 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:14:07 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:14:12 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:14:17 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:14:17 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2022/01/04 11:14:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:14:17 No eventing-con process running
2022/01/04 11:14:19 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:14:26 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:15:01 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:15:02 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2022/01/04 11:15:02 Starting bucket ops to source bucket
2022/01/04 11:15:10 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:15:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:15:20 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:15:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:15:25 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:15:30 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2022/01/04 11:15:30 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2022/01/04 11:15:30 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:15:30 Undeploying app: bucket_op_on_update
2022/01/04 11:15:35 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:15:40 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:15:45 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:15:50 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:15:50 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2022/01/04 11:15:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:15:50 No eventing-con process running
2022/01/04 11:15:52 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:15:59 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:16:34 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:16:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2022/01/04 11:16:36 Starting bucket ops to source bucket
2022/01/04 11:16:43 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:16:48 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:16:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:16:58 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2022/01/04 11:17:03 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2022/01/04 11:17:03 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:17:08 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2022/01/04 11:17:09 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2022/01/04 11:17:09 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:17:09 Undeploying app: bucket_op_on_update
2022/01/04 11:17:14 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:17:19 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:17:24 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:17:29 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:17:29 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2022/01/04 11:17:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:17:29 No eventing-con process running
2022/01/04 11:17:30 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:17:38 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:18:13 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:18:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2022/01/04 11:18:14 Starting bucket ops to source bucket
2022/01/04 11:18:22 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:18:27 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:18:32 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:18:37 Waiting for dst bucket item count to get to: 5000 curr count: 1827
2022/01/04 11:18:42 Waiting for dst bucket item count to get to: 5000 curr count: 4327
2022/01/04 11:18:42 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:18:47 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2022/01/04 11:18:47 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2022/01/04 11:18:47 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:18:47 Undeploying app: bucket_op_on_update
2022/01/04 11:18:52 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:18:57 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:19:02 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:19:07 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/04 11:19:07 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2022/01/04 11:19:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:19:07 No eventing-con process running
2022/01/04 11:19:09 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:19:16 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:19:51 Function: TestDeployUndeployLoopNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings deleting in background"
}
--- PASS: TestDeployUndeployLoopNonDefaultSettings (505.56s)
=== RUN   TestOnUpdateN1QLOp
2022/01/04 11:20:01 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2022/01/04 11:20:01 App: TestOnUpdateN1QLOp got un-deployed
2022/01/04 11:20:01 No eventing-con process running
2022/01/04 11:20:01 Function: TestOnUpdateN1QLOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateN1QLOp not found"
}
2022/01/04 11:20:03 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:20:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:20:10 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:20:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:20:15 Deploying app: TestOnUpdateN1QLOp. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:20:16 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateN1QLOp stored in temp store"
}
2022/01/04 11:20:16 Starting bucket ops to source bucket
2022/01/04 11:20:24 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:20:29 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:20:34 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:20:39 Waiting for dst bucket item count to get to: 5000 curr count: 675
2022/01/04 11:20:44 Waiting for dst bucket item count to get to: 5000 curr count: 675
2022/01/04 11:20:44 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:20:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:20:49 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2022/01/04 11:20:54 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2022/01/04 11:20:59 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2022/01/04 11:21:04 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2022/01/04 11:21:04 App: TestOnUpdateN1QLOp got un-deployed
2022/01/04 11:21:04 No eventing-con process running
2022/01/04 11:21:04 Function: TestOnUpdateN1QLOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateN1QLOp deleting in background"
}
2022/01/04 11:21:06 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:21:16 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 11:21:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:21:18 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:21:28 Waiting for dst bucket item count to get to: 0 curr count: 2595
2022/01/04 11:21:33 Waiting for dst bucket item count to get to: 0 curr count: 87
2022/01/04 11:21:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateN1QLOp (101.35s)
=== RUN   TestOnUpdateBucketOpDefaultSettings
2022/01/04 11:21:43 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2022/01/04 11:21:43 App: TestOnUpdateBucketOpDefaultSettings got un-deployed
2022/01/04 11:21:43 No eventing-con process running
2022/01/04 11:21:43 Function: TestOnUpdateBucketOpDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings not found"
}
2022/01/04 11:21:44 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:21:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:21:51 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:21:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:21:56 Deploying app: TestOnUpdateBucketOpDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:21:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings stored in temp store"
}
2022/01/04 11:21:57 Starting bucket ops to source bucket
2022/01/04 11:22:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:22:10 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:22:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:22:20 Waiting for dst bucket item count to get to: 5000 curr count: 956
2022/01/04 11:22:25 Waiting for dst bucket item count to get to: 5000 curr count: 956
2022/01/04 11:22:25 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:22:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:22:30 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2022/01/04 11:22:35 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2022/01/04 11:22:41 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2022/01/04 11:22:46 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2022/01/04 11:22:46 App: TestOnUpdateBucketOpDefaultSettings got un-deployed
2022/01/04 11:22:46 No eventing-con process running
2022/01/04 11:22:46 Function: TestOnUpdateBucketOpDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings deleting in background"
}
2022/01/04 11:22:47 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:22:57 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/04 11:22:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:22:59 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:23:09 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 11:23:14 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/04 11:23:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings (101.51s)
=== RUN   TestOnUpdateBucketOpNonDefaultSettings
2022/01/04 11:23:24 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/04 11:23:24 App: TestOnUpdateBucketOpNonDefaultSettings got un-deployed
2022/01/04 11:23:24 No eventing-con process running
2022/01/04 11:23:24 Function: TestOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpNonDefaultSettings not found"
}
2022/01/04 11:23:26 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:23:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:23:33 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:23:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:23:38 Deploying app: TestOnUpdateBucketOpNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:23:39 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpNonDefaultSettings stored in temp store"
}
2022/01/04 11:23:39 Starting bucket ops to source bucket
2022/01/04 11:23:47 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:23:52 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:23:57 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:24:02 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:24:07 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2022/01/04 11:24:07 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:24:07 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:24:12 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/04 11:24:17 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/04 11:24:22 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/04 11:24:27 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/04 11:24:27 App: TestOnUpdateBucketOpNonDefaultSettings got un-deployed
2022/01/04 11:24:27 No eventing-con process running
2022/01/04 11:24:27 Function: TestOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpNonDefaultSettings deleting in background"
}
2022/01/04 11:24:29 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:24:39 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 11:24:44 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/04 11:24:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:24:46 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:24:56 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 11:24:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpNonDefaultSettings (101.54s)
=== RUN   TestOnUpdateBucketOpDefaultSettings10K
2022/01/04 11:25:06 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2022/01/04 11:25:06 App: TestOnUpdateBucketOpDefaultSettings10K got un-deployed
2022/01/04 11:25:06 No eventing-con process running
2022/01/04 11:25:06 Function: TestOnUpdateBucketOpDefaultSettings10K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings10K not found"
}
2022/01/04 11:25:07 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:25:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:25:14 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:25:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:25:19 Deploying app: TestOnUpdateBucketOpDefaultSettings10K. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:25:20 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings10K stored in temp store"
}
2022/01/04 11:25:20 Starting bucket ops to source bucket
2022/01/04 11:25:28 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:25:33 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:25:38 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:25:43 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:25:43 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:25:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:25:49 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2022/01/04 11:25:54 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2022/01/04 11:25:59 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2022/01/04 11:26:04 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2022/01/04 11:26:04 App: TestOnUpdateBucketOpDefaultSettings10K got un-deployed
2022/01/04 11:26:04 No eventing-con process running
2022/01/04 11:26:04 Function: TestOnUpdateBucketOpDefaultSettings10K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings10K deleting in background"
}
2022/01/04 11:26:05 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:26:15 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 11:26:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:26:17 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:26:27 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 11:26:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings10K (91.52s)
=== RUN   TestOnUpdateBucketOpDefaultSettings100K
2022/01/04 11:26:37 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2022/01/04 11:26:37 App: TestOnUpdateBucketOpDefaultSettings100K got un-deployed
2022/01/04 11:26:37 No eventing-con process running
2022/01/04 11:26:37 Function: TestOnUpdateBucketOpDefaultSettings100K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings100K not found"
}
2022/01/04 11:26:39 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:26:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:26:46 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:26:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:26:51 Deploying app: TestOnUpdateBucketOpDefaultSettings100K. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:26:52 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings100K stored in temp store"
}
2022/01/04 11:26:52 Starting bucket ops to source bucket
2022/01/04 11:27:00 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:27:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:27:10 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:27:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:27:15 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:27:15 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:27:20 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2022/01/04 11:27:26 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2022/01/04 11:27:31 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2022/01/04 11:27:36 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2022/01/04 11:27:36 App: TestOnUpdateBucketOpDefaultSettings100K got un-deployed
2022/01/04 11:27:36 No eventing-con process running
2022/01/04 11:27:36 Function: TestOnUpdateBucketOpDefaultSettings100K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings100K deleting in background"
}
2022/01/04 11:27:37 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:27:47 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/04 11:27:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:27:49 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:27:59 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 11:28:04 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/04 11:28:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings100K (97.03s)
=== RUN   TestOnDeleteBucketOp
2022/01/04 11:28:14 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2022/01/04 11:28:14 App: TestOnDeleteBucketOp got un-deployed
2022/01/04 11:28:14 No eventing-con process running
2022/01/04 11:28:14 Function: TestOnDeleteBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteBucketOp not found"
}
2022/01/04 11:28:16 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:28:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:28:23 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:28:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:28:28 Deploying app: TestOnDeleteBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:28:29 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp stored in temp store"
}
2022/01/04 11:28:29 Starting bucket ops to source bucket
2022/01/04 11:28:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:28:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:28:50 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:28:55 Waiting for dst bucket item count to get to: 5000 curr count: 2504
2022/01/04 11:28:55 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:28:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:29:00 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2022/01/04 11:29:05 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2022/01/04 11:29:10 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2022/01/04 11:29:15 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2022/01/04 11:29:15 App: TestOnDeleteBucketOp got un-deployed
2022/01/04 11:29:15 No eventing-con process running
2022/01/04 11:29:15 Function: TestOnDeleteBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp deleting in background"
}
2022/01/04 11:29:17 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:29:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:29:24 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:29:34 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 11:29:39 Waiting for dst bucket item count to get to: 0 curr count: 2496
2022/01/04 11:29:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteBucketOp (94.73s)
=== RUN   TestOnDeleteBucketOp5K
2022/01/04 11:29:49 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2022/01/04 11:29:49 App: TestOnDeleteBucketOp5K got un-deployed
2022/01/04 11:29:49 No eventing-con process running
2022/01/04 11:29:49 Function: TestOnDeleteBucketOp5K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteBucketOp5K not found"
}
2022/01/04 11:29:51 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:29:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:29:58 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:30:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:30:03 Deploying app: TestOnDeleteBucketOp5K. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:30:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp5K stored in temp store"
}
2022/01/04 11:30:04 Starting bucket ops to source bucket
2022/01/04 11:30:14 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:30:19 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:30:24 Waiting for dst bucket item count to get to: 5000 curr count: 2069
2022/01/04 11:30:29 Waiting for dst bucket item count to get to: 5000 curr count: 4565
2022/01/04 11:30:29 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:30:29 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:30:35 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2022/01/04 11:30:40 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2022/01/04 11:30:45 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2022/01/04 11:30:50 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2022/01/04 11:30:50 App: TestOnDeleteBucketOp5K got un-deployed
2022/01/04 11:30:50 No eventing-con process running
2022/01/04 11:30:50 Function: TestOnDeleteBucketOp5K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp5K deleting in background"
}
2022/01/04 11:30:51 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:30:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:30:59 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:31:09 Waiting for dst bucket item count to get to: 0 curr count: 4283
2022/01/04 11:31:14 Waiting for dst bucket item count to get to: 0 curr count: 1787
2022/01/04 11:31:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteBucketOp5K (94.77s)
=== RUN   TestTimerBucketOp
2022/01/04 11:31:24 Waiting for app: TestTimerBucketOp to get un-deployed
2022/01/04 11:31:24 App: TestTimerBucketOp got un-deployed
2022/01/04 11:31:24 No eventing-con process running
2022/01/04 11:31:24 Function: TestTimerBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerBucketOp not found"
}
2022/01/04 11:31:26 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:31:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:31:32 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:31:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:31:37 Deploying app: TestTimerBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:31:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerBucketOp stored in temp store"
}
2022/01/04 11:31:38 Starting bucket ops to source bucket
2022/01/04 11:31:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:31:51 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:31:56 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:32:01 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:32:06 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:32:11 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:32:16 Waiting for dst bucket item count to get to: 5000 curr count: 2447
2022/01/04 11:32:21 Waiting for dst bucket item count to get to: 5000 curr count: 4947
2022/01/04 11:32:21 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:32:21 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:32:27 Waiting for app: TestTimerBucketOp to get un-deployed
2022/01/04 11:32:32 Waiting for app: TestTimerBucketOp to get un-deployed
2022/01/04 11:32:37 Waiting for app: TestTimerBucketOp to get un-deployed
2022/01/04 11:32:42 Waiting for app: TestTimerBucketOp to get un-deployed
2022/01/04 11:32:42 App: TestTimerBucketOp got un-deployed
2022/01/04 11:32:42 No eventing-con process running
2022/01/04 11:32:42 Function: TestTimerBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerBucketOp deleting in background"
}
2022/01/04 11:32:43 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:32:53 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 11:32:58 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/04 11:32:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:33:00 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:33:10 Waiting for dst bucket item count to get to: 0 curr count: 3606
2022/01/04 11:33:15 Waiting for dst bucket item count to get to: 0 curr count: 3606
2022/01/04 11:33:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerBucketOp (121.43s)
=== RUN   TestTimerInPastBucketOp
2022/01/04 11:33:25 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2022/01/04 11:33:25 App: TestTimerInPastBucketOp got un-deployed
2022/01/04 11:33:25 No eventing-con process running
2022/01/04 11:33:25 Function: TestTimerInPastBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerInPastBucketOp not found"
}
2022/01/04 11:33:27 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:33:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:33:34 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:33:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:33:39 Deploying app: TestTimerInPastBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:33:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerInPastBucketOp stored in temp store"
}
2022/01/04 11:33:40 Starting bucket ops to source bucket
2022/01/04 11:33:48 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:33:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:33:58 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:34:03 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:34:08 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:34:13 Waiting for dst bucket item count to get to: 5000 curr count: 64
2022/01/04 11:34:18 Waiting for dst bucket item count to get to: 5000 curr count: 1130
2022/01/04 11:34:23 Waiting for dst bucket item count to get to: 5000 curr count: 3566
2022/01/04 11:34:23 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:34:23 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:34:28 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2022/01/04 11:34:33 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2022/01/04 11:34:38 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2022/01/04 11:34:43 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2022/01/04 11:34:43 App: TestTimerInPastBucketOp got un-deployed
2022/01/04 11:34:43 No eventing-con process running
2022/01/04 11:34:43 Function: TestTimerInPastBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerInPastBucketOp deleting in background"
}
2022/01/04 11:34:45 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:34:55 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 11:34:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:34:57 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:35:07 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 11:35:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerInPastBucketOp (111.53s)
=== RUN   TestDeployUndeployLoopTimer
2022/01/04 11:35:17 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:35:17 App: TestDeployUndeployLoopTimer got un-deployed
2022/01/04 11:35:17 No eventing-con process running
2022/01/04 11:35:17 Function: TestDeployUndeployLoopTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeployUndeployLoopTimer not found"
}
2022/01/04 11:35:18 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:35:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:35:25 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:35:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:35:30 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:35:32 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2022/01/04 11:35:32 Starting bucket ops to source bucket
2022/01/04 11:35:39 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:35:44 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:35:49 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:35:54 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:35:59 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:36:04 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:36:10 Waiting for dst bucket item count to get to: 5000 curr count: 2449
2022/01/04 11:36:15 Waiting for dst bucket item count to get to: 5000 curr count: 2449
2022/01/04 11:36:15 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:36:20 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2022/01/04 11:36:20 App: TestDeployUndeployLoopTimer got deployed
2022/01/04 11:36:20 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:36:20 Undeploying app: bucket_op_with_timer
2022/01/04 11:36:25 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:36:30 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:36:35 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:36:40 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:36:40 App: TestDeployUndeployLoopTimer got un-deployed
2022/01/04 11:36:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:36:40 No eventing-con process running
2022/01/04 11:36:41 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:36:49 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:37:24 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:37:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2022/01/04 11:37:25 Starting bucket ops to source bucket
2022/01/04 11:37:33 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:37:38 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:37:43 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:37:48 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:37:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:37:58 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:38:03 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:38:03 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:38:08 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2022/01/04 11:38:08 App: TestDeployUndeployLoopTimer got deployed
2022/01/04 11:38:08 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:38:08 Undeploying app: bucket_op_with_timer
2022/01/04 11:38:13 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:38:18 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:38:23 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:38:28 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:38:28 App: TestDeployUndeployLoopTimer got un-deployed
2022/01/04 11:38:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:38:28 No eventing-con process running
2022/01/04 11:38:30 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:38:37 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:39:12 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:39:13 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2022/01/04 11:39:13 Starting bucket ops to source bucket
2022/01/04 11:39:21 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:39:26 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:39:31 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:39:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:39:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:39:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:39:51 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:39:56 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2022/01/04 11:39:56 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:40:01 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2022/01/04 11:40:01 App: TestDeployUndeployLoopTimer got deployed
2022/01/04 11:40:01 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:40:01 Undeploying app: bucket_op_with_timer
2022/01/04 11:40:07 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:40:12 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:40:17 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:40:22 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:40:22 App: TestDeployUndeployLoopTimer got un-deployed
2022/01/04 11:40:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:40:22 No eventing-con process running
2022/01/04 11:40:23 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:40:31 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:41:06 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:41:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2022/01/04 11:41:07 Starting bucket ops to source bucket
2022/01/04 11:41:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:41:20 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:41:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:41:30 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:41:35 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:41:40 Waiting for dst bucket item count to get to: 5000 curr count: 1099
2022/01/04 11:41:45 Waiting for dst bucket item count to get to: 5000 curr count: 1099
2022/01/04 11:41:45 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:41:50 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2022/01/04 11:41:50 App: TestDeployUndeployLoopTimer got deployed
2022/01/04 11:41:50 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:41:50 Undeploying app: bucket_op_with_timer
2022/01/04 11:41:55 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:42:00 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:42:05 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:42:10 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:42:10 App: TestDeployUndeployLoopTimer got un-deployed
2022/01/04 11:42:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:42:10 No eventing-con process running
2022/01/04 11:42:12 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:42:19 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:42:54 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:42:55 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2022/01/04 11:42:55 Starting bucket ops to source bucket
2022/01/04 11:43:03 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:43:08 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:43:13 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:43:18 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:43:23 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:43:28 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:43:33 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:43:33 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:43:38 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2022/01/04 11:43:38 App: TestDeployUndeployLoopTimer got deployed
2022/01/04 11:43:38 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:43:38 Undeploying app: bucket_op_with_timer
2022/01/04 11:43:43 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:43:48 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:43:53 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:43:58 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/04 11:43:58 App: TestDeployUndeployLoopTimer got un-deployed
2022/01/04 11:43:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:43:58 No eventing-con process running
2022/01/04 11:44:00 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:44:07 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:44:42 Function: TestDeployUndeployLoopTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer deleting in background"
}
--- PASS: TestDeployUndeployLoopTimer (575.51s)
=== RUN   TestMultipleHandlers
2022/01/04 11:44:52 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2022/01/04 11:44:52 App: TestMultipleHandlers_bucket_op_on_update got un-deployed
2022/01/04 11:44:52 No eventing-con process running
2022/01/04 11:44:52 Function: TestMultipleHandlers_bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMultipleHandlers_bucket_op_on_update not found"
}
2022/01/04 11:44:54 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:44:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:45:01 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:45:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:45:11 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2022/01/04 11:45:11 App: TestMultipleHandlers_bucket_op_on_delete got un-deployed
2022/01/04 11:45:11 No eventing-con process running
2022/01/04 11:45:11 Function: TestMultipleHandlers_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMultipleHandlers_bucket_op_on_delete not found"
}
2022/01/04 11:45:13 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:45:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:45:19 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:45:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:45:24 Deploying app: TestMultipleHandlers_bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:45:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_update stored in temp store"
}
2022/01/04 11:45:25 Deploying app: TestMultipleHandlers_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:45:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_delete stored in temp store"
}
2022/01/04 11:45:32 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2022/01/04 11:45:37 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2022/01/04 11:45:42 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2022/01/04 11:45:47 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2022/01/04 11:45:47 App: TestMultipleHandlers_bucket_op_on_update got deployed
2022/01/04 11:45:52 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2022/01/04 11:45:57 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2022/01/04 11:46:02 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2022/01/04 11:46:02 App: TestMultipleHandlers_bucket_op_on_delete got deployed
2022/01/04 11:46:02 Starting bucket ops to source bucket
2022/01/04 11:46:12 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:46:12 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:46:12 Starting bucket ops to source bucket
2022/01/04 11:46:27 Waiting for dst bucket item count to get to: 10000 curr count: 6512
2022/01/04 11:46:32 Waiting for dst bucket item count to get to: 10000 curr count: 6512
2022/01/04 11:46:32 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/04 11:46:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:46:32 Function: TestMultipleHandlers_bucket_op_on_update update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:46:32 Function: TestMultipleHandlers_bucket_op_on_delete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:46:37 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2022/01/04 11:46:42 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2022/01/04 11:46:47 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2022/01/04 11:46:52 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2022/01/04 11:46:52 App: TestMultipleHandlers_bucket_op_on_update got un-deployed
2022/01/04 11:46:52 No eventing-con process running
2022/01/04 11:46:52 Function: TestMultipleHandlers_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_update deleting in background"
}
2022/01/04 11:46:54 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:46:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:47:01 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:47:11 Waiting for dst bucket item count to get to: 0 curr count: 9202
2022/01/04 11:47:16 Waiting for dst bucket item count to get to: 0 curr count: 9202
2022/01/04 11:47:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:47:21 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2022/01/04 11:47:26 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2022/01/04 11:47:31 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2022/01/04 11:47:36 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2022/01/04 11:47:36 App: TestMultipleHandlers_bucket_op_on_delete got un-deployed
2022/01/04 11:47:36 No eventing-con process running
2022/01/04 11:47:36 Function: TestMultipleHandlers_bucket_op_on_delete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_delete deleting in background"
}
2022/01/04 11:47:38 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:47:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:47:45 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:47:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMultipleHandlers (187.75s)
=== RUN   TestPauseResumeLoopDefaultSettings
2022/01/04 11:48:00 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2022/01/04 11:48:00 App: TestPauseResumeLoopDefaultSettings got un-deployed
2022/01/04 11:48:00 No eventing-con process running
2022/01/04 11:48:00 Function: TestPauseResumeLoopDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeLoopDefaultSettings not found"
}
2022/01/04 11:48:02 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:48:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:48:09 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:48:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:48:14 Deploying app: TestPauseResumeLoopDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:48:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopDefaultSettings stored in temp store"
}
2022/01/04 11:48:15 Starting bucket ops to source bucket
2022/01/04 11:48:23 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:48:28 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:48:33 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:48:38 Waiting for dst bucket item count to get to: 5000 curr count: 923
2022/01/04 11:48:43 Waiting for dst bucket item count to get to: 5000 curr count: 3423
2022/01/04 11:48:43 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:48:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:48:48 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2022/01/04 11:48:48 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2022/01/04 11:48:48 Pausing app: bucket_op_on_update
2022/01/04 11:48:48 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:48:53 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2022/01/04 11:48:53 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2022/01/04 11:48:53 Resuming app: bucket_op_on_update
2022/01/04 11:48:54 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:48:54 Starting bucket ops to source bucket
2022/01/04 11:49:02 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/04 11:49:07 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/04 11:49:12 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/04 11:49:12 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/04 11:49:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:49:17 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2022/01/04 11:49:17 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2022/01/04 11:49:17 Pausing app: bucket_op_on_update
2022/01/04 11:49:17 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:49:22 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2022/01/04 11:49:22 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2022/01/04 11:49:22 Resuming app: bucket_op_on_update
2022/01/04 11:49:24 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:49:24 Starting bucket ops to source bucket
2022/01/04 11:49:31 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2022/01/04 11:49:36 Waiting for dst bucket item count to get to: 15000 curr count: 10006
2022/01/04 11:49:41 Waiting for dst bucket item count to get to: 15000 curr count: 10006
2022/01/04 11:49:41 src & dst bucket item count matched up. src bucket count: 15000 dst bucket count: 15000
2022/01/04 11:49:41 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:49:47 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2022/01/04 11:49:47 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2022/01/04 11:49:47 Pausing app: bucket_op_on_update
2022/01/04 11:49:47 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:49:52 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2022/01/04 11:49:52 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2022/01/04 11:49:52 Resuming app: bucket_op_on_update
2022/01/04 11:49:53 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:49:53 Starting bucket ops to source bucket
2022/01/04 11:50:01 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/04 11:50:06 Waiting for dst bucket item count to get to: 20000 curr count: 15289
2022/01/04 11:50:11 Waiting for dst bucket item count to get to: 20000 curr count: 15289
2022/01/04 11:50:11 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2022/01/04 11:50:11 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:50:16 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2022/01/04 11:50:16 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2022/01/04 11:50:16 Pausing app: bucket_op_on_update
2022/01/04 11:50:16 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:50:21 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2022/01/04 11:50:21 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2022/01/04 11:50:21 Resuming app: bucket_op_on_update
2022/01/04 11:50:22 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:50:22 Starting bucket ops to source bucket
2022/01/04 11:50:30 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/04 11:50:35 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/04 11:50:40 Waiting for dst bucket item count to get to: 25000 curr count: 20484
2022/01/04 11:50:45 Waiting for dst bucket item count to get to: 25000 curr count: 20484
2022/01/04 11:50:45 src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2022/01/04 11:50:45 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:50:50 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2022/01/04 11:50:50 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2022/01/04 11:50:50 Pausing app: bucket_op_on_update
2022/01/04 11:50:51 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:50:56 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2022/01/04 11:50:56 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2022/01/04 11:51:01 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2022/01/04 11:51:06 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2022/01/04 11:51:11 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2022/01/04 11:51:16 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2022/01/04 11:51:16 App: TestPauseResumeLoopDefaultSettings got un-deployed
2022/01/04 11:51:16 No eventing-con process running
2022/01/04 11:51:16 Function: TestPauseResumeLoopDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopDefaultSettings deleting in background"
}
2022/01/04 11:51:18 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:51:28 Waiting for dst bucket item count to get to: 0 curr count: 15053
2022/01/04 11:51:33 Waiting for dst bucket item count to get to: 0 curr count: 2553
2022/01/04 11:51:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:51:35 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:51:45 Waiting for dst bucket item count to get to: 0 curr count: 25000
2022/01/04 11:51:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeLoopDefaultSettings (234.55s)
=== RUN   TestPauseResumeLoopNonDefaultSettings
2022/01/04 11:51:55 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2022/01/04 11:51:55 App: TestPauseResumeLoopNonDefaultSettings got un-deployed
2022/01/04 11:51:55 No eventing-con process running
2022/01/04 11:51:55 Function: TestPauseResumeLoopNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeLoopNonDefaultSettings not found"
}
2022/01/04 11:51:56 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:52:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:52:03 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:52:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:52:08 Deploying app: TestPauseResumeLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:52:09 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopNonDefaultSettings stored in temp store"
}
2022/01/04 11:52:09 Starting bucket ops to source bucket
2022/01/04 11:52:17 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:52:22 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:52:27 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:52:32 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:52:37 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:52:42 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:52:47 Waiting for dst bucket item count to get to: 5000 curr count: 2198
2022/01/04 11:52:52 Waiting for dst bucket item count to get to: 5000 curr count: 4698
2022/01/04 11:52:52 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:52:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:52:57 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2022/01/04 11:52:57 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2022/01/04 11:52:57 Pausing app: bucket_op_with_timer
2022/01/04 11:52:58 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:53:03 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2022/01/04 11:53:03 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2022/01/04 11:53:03 Resuming app: bucket_op_with_timer
2022/01/04 11:53:04 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:53:04 Starting bucket ops to source bucket
2022/01/04 11:53:12 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/04 11:53:17 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/04 11:53:22 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/04 11:53:27 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/04 11:53:32 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/04 11:53:32 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/04 11:53:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:53:37 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2022/01/04 11:53:37 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2022/01/04 11:53:37 Pausing app: bucket_op_with_timer
2022/01/04 11:53:37 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:53:42 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2022/01/04 11:53:42 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2022/01/04 11:53:42 Resuming app: bucket_op_with_timer
2022/01/04 11:53:43 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:53:43 Starting bucket ops to source bucket
2022/01/04 11:53:51 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2022/01/04 11:53:56 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2022/01/04 11:54:01 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2022/01/04 11:54:06 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2022/01/04 11:54:11 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2022/01/04 11:54:11 src & dst bucket item count matched up. src bucket count: 15000 dst bucket count: 15000
2022/01/04 11:54:11 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:54:16 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2022/01/04 11:54:16 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2022/01/04 11:54:16 Pausing app: bucket_op_with_timer
2022/01/04 11:54:16 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:54:21 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2022/01/04 11:54:21 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2022/01/04 11:54:21 Resuming app: bucket_op_with_timer
2022/01/04 11:54:22 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:54:22 Starting bucket ops to source bucket
2022/01/04 11:54:30 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/04 11:54:35 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/04 11:54:40 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/04 11:54:45 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/04 11:54:50 Waiting for dst bucket item count to get to: 20000 curr count: 16386
2022/01/04 11:54:55 Waiting for dst bucket item count to get to: 20000 curr count: 16386
2022/01/04 11:55:00 Waiting for dst bucket item count to get to: 20000 curr count: 19182
2022/01/04 11:55:05 Waiting for dst bucket item count to get to: 20000 curr count: 19182
2022/01/04 11:55:05 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2022/01/04 11:55:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:55:10 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2022/01/04 11:55:10 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2022/01/04 11:55:10 Pausing app: bucket_op_with_timer
2022/01/04 11:55:10 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:55:15 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2022/01/04 11:55:16 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2022/01/04 11:55:16 Resuming app: bucket_op_with_timer
2022/01/04 11:55:17 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:55:17 Starting bucket ops to source bucket
2022/01/04 11:55:24 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/04 11:55:29 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/04 11:55:35 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/04 11:55:40 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/04 11:55:45 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/04 11:55:50 Waiting for dst bucket item count to get to: 25000 curr count: 22005
2022/01/04 11:55:55 Waiting for dst bucket item count to get to: 25000 curr count: 22005
2022/01/04 11:55:55 src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2022/01/04 11:55:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:56:00 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2022/01/04 11:56:00 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2022/01/04 11:56:00 Pausing app: bucket_op_with_timer
2022/01/04 11:56:00 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:56:05 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2022/01/04 11:56:05 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2022/01/04 11:56:10 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2022/01/04 11:56:15 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2022/01/04 11:56:20 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2022/01/04 11:56:25 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2022/01/04 11:56:25 App: TestPauseResumeLoopNonDefaultSettings got un-deployed
2022/01/04 11:56:25 No eventing-con process running
2022/01/04 11:56:25 Function: TestPauseResumeLoopNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopNonDefaultSettings deleting in background"
}
2022/01/04 11:56:27 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:56:37 Waiting for dst bucket item count to get to: 0 curr count: 25000
2022/01/04 11:56:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:56:38 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:56:48 Waiting for dst bucket item count to get to: 0 curr count: 21747
2022/01/04 11:56:53 Waiting for dst bucket item count to get to: 0 curr count: 9247
2022/01/04 11:56:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeLoopNonDefaultSettings (308.95s)
=== RUN   TestPauseAndResumeWithWorkerCountChange
2022/01/04 11:57:03 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2022/01/04 11:57:03 App: TestPauseAndResumeWithWorkerCountChange got un-deployed
2022/01/04 11:57:04 No eventing-con process running
2022/01/04 11:57:04 Function: TestPauseAndResumeWithWorkerCountChange delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseAndResumeWithWorkerCountChange not found"
}
2022/01/04 11:57:05 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:57:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:57:12 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:57:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:57:17 Deploying app: TestPauseAndResumeWithWorkerCountChange. Item count src bucket: 0 dst bucket: 0
2022/01/04 11:57:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseAndResumeWithWorkerCountChange stored in temp store"
}
2022/01/04 11:57:23 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2022/01/04 11:57:28 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2022/01/04 11:57:33 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2022/01/04 11:57:38 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2022/01/04 11:57:38 App: TestPauseAndResumeWithWorkerCountChange got deployed
2022/01/04 11:57:38 Starting bucket ops to source bucket
2022/01/04 11:57:47 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:57:52 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:57:57 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:58:02 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 11:58:07 Waiting for dst bucket item count to get to: 5000 curr count: 713
2022/01/04 11:58:12 Waiting for dst bucket item count to get to: 5000 curr count: 2326
2022/01/04 11:58:17 Waiting for dst bucket item count to get to: 5000 curr count: 4113
2022/01/04 11:58:17 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 11:58:17 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 11:58:17 Pausing app: bucket_op_with_timer
2022/01/04 11:58:18 Function: TestPauseAndResumeWithWorkerCountChange update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:58:23 Waiting for function: TestPauseAndResumeWithWorkerCountChange status to change to paused
2022/01/04 11:58:23 Function: TestPauseAndResumeWithWorkerCountChange status changed to paused
2022/01/04 11:58:23 Resuming app: bucket_op_with_timer
2022/01/04 11:58:24 Function: TestPauseAndResumeWithWorkerCountChange update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:6] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 11:58:24 Starting bucket ops to source bucket
2022/01/04 11:58:36 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/04 11:58:41 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/04 11:58:46 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/04 11:58:51 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/04 11:58:56 Waiting for dst bucket item count to get to: 10000 curr count: 6293
2022/01/04 11:59:01 Waiting for dst bucket item count to get to: 10000 curr count: 8793
2022/01/04 11:59:01 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/04 11:59:06 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2022/01/04 11:59:11 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2022/01/04 11:59:16 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2022/01/04 11:59:21 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2022/01/04 11:59:21 App: TestPauseAndResumeWithWorkerCountChange got un-deployed
2022/01/04 11:59:21 No eventing-con process running
2022/01/04 11:59:21 Function: TestPauseAndResumeWithWorkerCountChange delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseAndResumeWithWorkerCountChange deleting in background"
}
2022/01/04 11:59:23 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:59:33 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/04 11:59:38 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 11:59:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 11:59:39 Context: Bucket flush, response code: 200 dump: 
2022/01/04 11:59:49 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 11:59:54 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 11:59:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseAndResumeWithWorkerCountChange (181.00s)
=== RUN   TestPauseResumeWithEventingReb
2022/01/04 12:00:04 Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2022/01/04 12:00:04 App: TestPauseResumeWithEventingReb got un-deployed
2022/01/04 12:00:04 No eventing-con process running
2022/01/04 12:00:05 Function: TestPauseResumeWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeWithEventingReb not found"
}
2022/01/04 12:00:06 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:00:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:00:13 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:00:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:00:18 Deploying app: TestPauseResumeWithEventingReb. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:00:19 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeWithEventingReb stored in temp store"
}
2022/01/04 12:00:24 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2022/01/04 12:00:29 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2022/01/04 12:00:34 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2022/01/04 12:00:39 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2022/01/04 12:00:39 App: TestPauseResumeWithEventingReb got deployed
2022/01/04 12:00:39 Starting bucket ops to source bucket
2022/01/04 12:00:48 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:00:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:00:58 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:01:03 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:01:08 Waiting for dst bucket item count to get to: 5000 curr count: 1324
2022/01/04 12:01:13 Waiting for dst bucket item count to get to: 5000 curr count: 2648
2022/01/04 12:01:18 Waiting for dst bucket item count to get to: 5000 curr count: 3824
2022/01/04 12:01:18 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 12:01:18 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:01:19 Pausing app: bucket_op_with_timer
2022/01/04 12:01:19 Function: TestPauseResumeWithEventingReb update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 12:01:24 Waiting for function: TestPauseResumeWithEventingReb status to change to paused
2022/01/04 12:01:24 Function: TestPauseResumeWithEventingReb status changed to paused
2022/01/04 12:01:24 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/04 12:01:24 Removing node(s): [] from the cluster
2022/01/04 12:01:29 Rebalance progress: 29.16666666666666
2022/01/04 12:01:34 Rebalance progress: 29.16666666666666
2022/01/04 12:01:39 Rebalance progress: 100
2022/01/04 12:01:39 Resuming app: bucket_op_with_timer
2022/01/04 12:01:40 Function: TestPauseResumeWithEventingReb update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:6] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 12:01:40 Starting bucket ops to source bucket
2022/01/04 12:01:52 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/04 12:01:57 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/04 12:02:02 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/04 12:02:07 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/04 12:02:12 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/04 12:02:12 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/04 12:02:12 Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/04 12:02:17 Rebalance progress: 29.16666666666666
2022/01/04 12:02:22 Rebalance progress: 29.16666666666666
2022/01/04 12:02:27 Rebalance progress: 100

VB distribution across eventing nodes and their workers::

2022/01/04 12:02:32 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 12:02:47 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 12:03:02 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 12:03:17 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 12:03:32 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 12:03:47 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 12:04:02 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 12:04:17 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 12:04:32 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 12:04:47 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 12:05:02 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 12:05:17 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 12:05:32 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 12:05:47 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]

DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: 61d8397629ec2df9c1a90f42b6d3dc6d
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [114-170]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [171-227]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [228-284]
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 57
	v: [285-341]
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [0-56]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [57-113]
Producer node: 172.31.2.134:9300	Node UUID: 142f2ba4536e2ebf850b70cdb7738062
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [740-796]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [797-853]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [854-910]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [911-967]
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 56
	v: [968-1023]
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [683-739]
Producer node: 127.0.0.1:9303	Node UUID: 556a671ce6f0e75404f67be000cd9552
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [342-398]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [399-455]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [456-512]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [513-569]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [570-626]
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 56
	v: [627-682]


2022/01/04 12:06:02 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:06:07 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2022/01/04 12:06:12 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2022/01/04 12:06:17 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2022/01/04 12:06:22 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2022/01/04 12:06:22 clusterSetup.go:405: App: TestPauseResumeWithEventingReb got un-deployed
2022/01/04 12:06:23 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:06:23 eventingSetup.go:418: Function: TestPauseResumeWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeWithEventingReb deleting in background"
}
2022/01/04 12:06:24 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:06:34 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/04 12:06:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:06:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:06:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/04 12:06:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeWithEventingReb (411.66s)
=== RUN   TestBucketDeleteAfterPause
2022/01/04 12:06:56 clusterSetup.go:397: Waiting for app: TestBucketDeleteAfterPause to get un-deployed
2022/01/04 12:06:56 clusterSetup.go:405: App: TestBucketDeleteAfterPause got un-deployed
2022/01/04 12:06:56 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:06:56 eventingSetup.go:418: Function: TestBucketDeleteAfterPause delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketDeleteAfterPause not found"
}
2022/01/04 12:06:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:07:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:07:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:07:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:07:10 eventingSetup.go:125: Deploying app: TestBucketDeleteAfterPause. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:07:11 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteAfterPause stored in temp store"
}
2022/01/04 12:07:16 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2022/01/04 12:07:21 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2022/01/04 12:07:26 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2022/01/04 12:07:31 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2022/01/04 12:07:31 clusterSetup.go:354: App: TestBucketDeleteAfterPause got deployed
2022/01/04 12:07:31 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 12:07:40 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:07:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 12:07:40 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:07:40 handler_test.go:712: Pausing app: bucket_op_on_update
2022/01/04 12:07:41 eventingSetup.go:270: Function: TestBucketDeleteAfterPause update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 12:07:46 eventingSetup.go:719: Waiting for function: TestBucketDeleteAfterPause status to change to paused
2022/01/04 12:07:46 eventingSetup.go:727: Function: TestBucketDeleteAfterPause status changed to paused
2022/01/04 12:07:46 handler_test.go:716: Deleting source bucket: default
2022/01/04 12:07:52 eventingSetup.go:719: Waiting for function: TestBucketDeleteAfterPause status to change to undeployed
2022/01/04 12:07:52 eventingSetup.go:727: Function: TestBucketDeleteAfterPause status changed to undeployed
2022/01/04 12:07:57 clusterSetup.go:397: Waiting for app: TestBucketDeleteAfterPause to get un-deployed
2022/01/04 12:07:57 clusterSetup.go:405: App: TestBucketDeleteAfterPause got un-deployed
2022/01/04 12:07:57 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:07:58 eventingSetup.go:418: Function: TestBucketDeleteAfterPause delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteAfterPause deleting in background"
}
2022/01/04 12:07:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:08:09 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/04 12:08:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:08:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:08:21 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4264
2022/01/04 12:08:26 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4264
2022/01/04 12:08:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBucketDeleteAfterPause (99.41s)
=== RUN   TestChangeFnCodeBetweenPauseResume
2022/01/04 12:08:36 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2022/01/04 12:08:36 clusterSetup.go:405: App: TestChangeFnCodeBetweenPauseResume got un-deployed
2022/01/04 12:08:36 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:08:36 eventingSetup.go:418: Function: TestChangeFnCodeBetweenPauseResume delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestChangeFnCodeBetweenPauseResume not found"
}
2022/01/04 12:08:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:08:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:08:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:08:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:08:49 eventingSetup.go:125: Deploying app: TestChangeFnCodeBetweenPauseResume. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:08:50 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume stored in temp store"
}
2022/01/04 12:08:55 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2022/01/04 12:09:00 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2022/01/04 12:09:05 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2022/01/04 12:09:10 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2022/01/04 12:09:10 clusterSetup.go:354: App: TestChangeFnCodeBetweenPauseResume got deployed
2022/01/04 12:09:10 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 12:09:45 handler_test.go:739: Pausing function: TestChangeFnCodeBetweenPauseResume
2022/01/04 12:09:45 eventingSetup.go:270: Function: TestChangeFnCodeBetweenPauseResume update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 12:09:50 eventingSetup.go:719: Waiting for function: TestChangeFnCodeBetweenPauseResume status to change to paused
2022/01/04 12:09:50 eventingSetup.go:727: Function: TestChangeFnCodeBetweenPauseResume status changed to paused
2022/01/04 12:12:50 handler_test.go:748: Resuming function: TestChangeFnCodeBetweenPauseResume
2022/01/04 12:12:50 eventingSetup.go:125: Deploying app: TestChangeFnCodeBetweenPauseResume. Item count src bucket: 5000 dst bucket: 0
2022/01/04 12:12:51 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume stored in temp store"
}
2022/01/04 12:12:56 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2022/01/04 12:12:56 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:12:56 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 0 expected 5000
2022/01/04 12:13:01 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2022/01/04 12:13:01 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:13:01 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 2862 expected 5000
2022/01/04 12:13:06 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2022/01/04 12:13:06 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:13:06 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 3613 expected 5000
2022/01/04 12:13:11 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2022/01/04 12:13:11 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:13:11 eventingSetup.go:804: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 5000
2022/01/04 12:13:11 handler_test.go:753: Undeploying function: TestChangeFnCodeBetweenPauseResume
2022/01/04 12:13:11 eventingSetup.go:270: Function: TestChangeFnCodeBetweenPauseResume update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 12:13:21 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2022/01/04 12:13:26 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2022/01/04 12:13:31 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2022/01/04 12:13:31 clusterSetup.go:405: App: TestChangeFnCodeBetweenPauseResume got un-deployed
2022/01/04 12:13:31 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:13:31 eventingSetup.go:418: Function: TestChangeFnCodeBetweenPauseResume delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume deleting in background"
}
2022/01/04 12:13:33 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:13:43 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 12:13:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/04 12:13:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:13:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:13:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestChangeFnCodeBetweenPauseResume (328.88s)
=== RUN   TestCommentUnCommentOnDelete
2022/01/04 12:14:04 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2022/01/04 12:14:04 clusterSetup.go:405: App: TestCommentUnCommentOnDelete got un-deployed
2022/01/04 12:14:04 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:14:04 eventingSetup.go:418: Function: TestCommentUnCommentOnDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCommentUnCommentOnDelete not found"
}
2022/01/04 12:14:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:14:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:14:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:14:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:14:18 eventingSetup.go:125: Deploying app: TestCommentUnCommentOnDelete. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:14:19 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete stored in temp store"
}
2022/01/04 12:14:24 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/04 12:14:29 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/04 12:14:34 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/04 12:14:39 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/04 12:14:39 clusterSetup.go:354: App: TestCommentUnCommentOnDelete got deployed
2022/01/04 12:14:39 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 12:14:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:14:53 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 317
2022/01/04 12:14:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2817
2022/01/04 12:14:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 12:14:58 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:14:58 handler_test.go:780: Undeploying app: TestCommentUnCommentOnDelete
2022/01/04 12:14:58 eventingSetup.go:270: Function: TestCommentUnCommentOnDelete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 12:15:28 eventingSetup.go:125: Deploying app: TestCommentUnCommentOnDelete. Item count src bucket: 5000 dst bucket: 5000
2022/01/04 12:15:29 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete stored in temp store"
}
2022/01/04 12:15:34 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/04 12:15:39 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/04 12:15:44 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/04 12:15:49 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/04 12:15:49 clusterSetup.go:354: App: TestCommentUnCommentOnDelete got deployed
2022/01/04 12:15:49 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 12:16:02 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 12:16:07 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/04 12:16:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:16:07 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:16:07 handler_test.go:799: Undeploying app: TestCommentUnCommentOnDelete
2022/01/04 12:16:07 eventingSetup.go:270: Function: TestCommentUnCommentOnDelete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 12:16:17 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2022/01/04 12:16:22 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2022/01/04 12:16:27 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2022/01/04 12:16:27 clusterSetup.go:405: App: TestCommentUnCommentOnDelete got un-deployed
2022/01/04 12:16:27 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:16:27 eventingSetup.go:418: Function: TestCommentUnCommentOnDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete deleting in background"
}
2022/01/04 12:16:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:16:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:16:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:16:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCommentUnCommentOnDelete (165.73s)
=== RUN   TestCPPWorkerCleanup
2022/01/04 12:16:50 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2022/01/04 12:16:50 clusterSetup.go:405: App: TestCPPWorkerCleanup got un-deployed
2022/01/04 12:16:50 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:16:50 eventingSetup.go:418: Function: TestCPPWorkerCleanup delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCPPWorkerCleanup not found"
}
2022/01/04 12:16:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:16:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:16:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:17:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:17:03 eventingSetup.go:125: Deploying app: TestCPPWorkerCleanup. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:17:04 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCPPWorkerCleanup stored in temp store"
}
2022/01/04 12:17:04 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 12:17:11 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:17:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:17:21 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:17:26 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:17:31 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 1512
2022/01/04 12:17:36 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 4012
2022/01/04 12:17:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 12:17:36 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:17:42 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2022/01/04 12:17:47 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2022/01/04 12:17:52 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2022/01/04 12:17:57 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2022/01/04 12:17:57 clusterSetup.go:405: App: TestCPPWorkerCleanup got un-deployed
2022/01/04 12:17:57 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:17:57 eventingSetup.go:418: Function: TestCPPWorkerCleanup delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCPPWorkerCleanup deleting in background"
}
2022/01/04 12:17:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:18:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3683
2022/01/04 12:18:13 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1183
2022/01/04 12:18:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:18:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:18:25 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 12:18:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCPPWorkerCleanup (134.55s)
=== RUN   TestWithUserXattrs
2022/01/04 12:19:05 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2022/01/04 12:19:05 clusterSetup.go:405: App: TestWithUserXattrs got un-deployed
2022/01/04 12:19:05 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:19:05 eventingSetup.go:418: Function: TestWithUserXattrs delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestWithUserXattrs not found"
}
2022/01/04 12:19:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:19:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:19:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:19:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:19:18 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 12:19:20 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 12:19:22 eventingSetup.go:125: Deploying app: TestWithUserXattrs. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:19:23 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestWithUserXattrs stored in temp store"
}
2022/01/04 12:19:28 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2022/01/04 12:19:33 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2022/01/04 12:19:38 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2022/01/04 12:19:43 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2022/01/04 12:19:43 clusterSetup.go:354: App: TestWithUserXattrs got deployed
2022/01/04 12:19:43 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 12:19:52 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:19:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2419
2022/01/04 12:20:02 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 4919
2022/01/04 12:20:02 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 12:20:02 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:20:07 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2022/01/04 12:20:13 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2022/01/04 12:20:18 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2022/01/04 12:20:23 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2022/01/04 12:20:23 clusterSetup.go:405: App: TestWithUserXattrs got un-deployed
2022/01/04 12:20:23 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:20:23 eventingSetup.go:418: Function: TestWithUserXattrs delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestWithUserXattrs deleting in background"
}
2022/01/04 12:20:24 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:20:34 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 12:20:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/04 12:20:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:20:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:20:51 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4391
2022/01/04 12:20:56 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4391
2022/01/04 12:20:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestWithUserXattrs (120.96s)
=== RUN   TestEventProcessingPostBucketFlush
2022/01/04 12:21:06 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2022/01/04 12:21:06 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2022/01/04 12:21:06 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:21:06 eventingSetup.go:418: Function: TestEventProcessingPostBucketFlush delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventProcessingPostBucketFlush not found"
}
2022/01/04 12:21:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:21:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:21:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:21:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:21:19 eventingSetup.go:125: Deploying app: TestEventProcessingPostBucketFlush. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:21:20 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventProcessingPostBucketFlush stored in temp store"
}
2022/01/04 12:21:25 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2022/01/04 12:21:30 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2022/01/04 12:21:35 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2022/01/04 12:21:40 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2022/01/04 12:21:40 clusterSetup.go:354: App: TestEventProcessingPostBucketFlush got deployed
2022/01/04 12:21:40 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 12:21:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:21:54 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:21:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2500
2022/01/04 12:21:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 12:21:59 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:22:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:22:13 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4841
2022/01/04 12:22:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2341
2022/01/04 12:22:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:22:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:22:30 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3705
2022/01/04 12:22:35 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3705
2022/01/04 12:22:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:22:35 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 12:23:00 eventingSetup.go:441: Waiting for dst bucket item count to get to: 25000 curr count: 16421
2022/01/04 12:23:05 eventingSetup.go:441: Waiting for dst bucket item count to get to: 25000 curr count: 16421
2022/01/04 12:23:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2022/01/04 12:23:05 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:23:05 eventingSetup.go:270: Function: TestEventProcessingPostBucketFlush update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 12:23:10 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2022/01/04 12:23:15 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2022/01/04 12:23:20 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2022/01/04 12:23:25 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2022/01/04 12:23:25 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2022/01/04 12:23:25 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:23:30 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2022/01/04 12:23:30 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2022/01/04 12:23:30 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:23:30 eventingSetup.go:418: Function: TestEventProcessingPostBucketFlush delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventProcessingPostBucketFlush deleting in background"
}
2022/01/04 12:23:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:23:41 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 25000
2022/01/04 12:23:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 25000
2022/01/04 12:23:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:23:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:23:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 20072
2022/01/04 12:24:03 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7572
2022/01/04 12:24:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventProcessingPostBucketFlush (187.69s)
=== RUN   TestMetaBucketDelete
2022/01/04 12:24:13 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2022/01/04 12:24:13 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2022/01/04 12:24:13 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:24:13 eventingSetup.go:418: Function: TestMetaBucketDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaBucketDelete not found"
}
2022/01/04 12:24:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:24:20 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:24:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:24:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:24:26 eventingSetup.go:125: Deploying app: TestMetaBucketDelete. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:24:28 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDelete stored in temp store"
}
2022/01/04 12:24:33 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2022/01/04 12:24:38 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2022/01/04 12:24:43 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2022/01/04 12:24:48 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2022/01/04 12:24:48 clusterSetup.go:354: App: TestMetaBucketDelete got deployed
2022/01/04 12:24:48 handler_test.go:902: Deleting metadata bucket: eventing
2022/01/04 12:24:49 handler_test.go:904: Deleted metadata bucket: eventing
2022/01/04 12:24:54 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2022/01/04 12:24:54 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2022/01/04 12:25:09 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2022/01/04 12:25:09 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2022/01/04 12:25:09 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:25:09 eventingSetup.go:418: Function: TestMetaBucketDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDelete deleting in background"
}
2022/01/04 12:25:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:25:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:25:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:25:22 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaBucketDelete (78.70s)
=== RUN   TestMetaBucketDeleteWithBootstrap
2022/01/04 12:25:32 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2022/01/04 12:25:32 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2022/01/04 12:25:32 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:25:32 eventingSetup.go:418: Function: TestMetaBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaBucketDeleteWithBootstrap not found"
}
2022/01/04 12:25:33 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:25:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:25:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:25:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:25:45 eventingSetup.go:125: Deploying app: TestMetaBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:25:46 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDeleteWithBootstrap stored in temp store"
}
2022/01/04 12:26:05 handler_test.go:923: Deleting metadata bucket: eventing
2022/01/04 12:26:06 handler_test.go:925: Deleted metadata bucket: eventing
2022/01/04 12:26:21 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2022/01/04 12:26:21 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2022/01/04 12:26:36 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2022/01/04 12:26:36 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2022/01/04 12:26:36 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:26:36 eventingSetup.go:418: Function: TestMetaBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDeleteWithBootstrap deleting in background"
}
2022/01/04 12:26:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:26:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:26:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:26:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaBucketDeleteWithBootstrap (86.71s)
=== RUN   TestSourceBucketDelete
2022/01/04 12:26:59 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2022/01/04 12:26:59 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2022/01/04 12:26:59 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:26:59 eventingSetup.go:418: Function: TestSourceBucketDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceBucketDelete not found"
}
2022/01/04 12:27:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:27:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:27:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:27:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:27:12 eventingSetup.go:125: Deploying app: TestSourceBucketDelete. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:27:13 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDelete stored in temp store"
}
2022/01/04 12:27:18 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2022/01/04 12:27:23 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2022/01/04 12:27:28 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2022/01/04 12:27:33 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2022/01/04 12:27:33 clusterSetup.go:354: App: TestSourceBucketDelete got deployed
2022/01/04 12:27:33 handler_test.go:945: Deleting source bucket: default
2022/01/04 12:27:35 handler_test.go:947: Deleted source bucket: default
2022/01/04 12:27:40 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2022/01/04 12:27:40 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2022/01/04 12:27:55 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2022/01/04 12:27:55 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2022/01/04 12:27:55 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:27:55 eventingSetup.go:418: Function: TestSourceBucketDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDelete deleting in background"
}
2022/01/04 12:27:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:28:01 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:28:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:28:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceBucketDelete (79.44s)
=== RUN   TestSourceBucketDeleteWithBootstrap
2022/01/04 12:28:18 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2022/01/04 12:28:18 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2022/01/04 12:28:18 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:28:18 eventingSetup.go:418: Function: TestSourceBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceBucketDeleteWithBootstrap not found"
}
2022/01/04 12:28:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:28:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:28:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:28:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:28:31 eventingSetup.go:125: Deploying app: TestSourceBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:28:32 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDeleteWithBootstrap stored in temp store"
}
2022/01/04 12:28:51 handler_test.go:966: Deleting source bucket: default
2022/01/04 12:28:53 handler_test.go:968: Deleted source bucket: default
2022/01/04 12:29:08 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2022/01/04 12:29:08 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2022/01/04 12:29:23 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2022/01/04 12:29:23 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2022/01/04 12:29:23 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:29:23 eventingSetup.go:418: Function: TestSourceBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDeleteWithBootstrap deleting in background"
}
2022/01/04 12:29:24 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:29:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:29:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:29:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceBucketDeleteWithBootstrap (87.59s)
=== RUN   TestSourceAndMetaBucketDeleteWithBootstrap
2022/01/04 12:29:46 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2022/01/04 12:29:46 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2022/01/04 12:29:46 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:29:46 eventingSetup.go:418: Function: TestSourceAndMetaBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceAndMetaBucketDeleteWithBootstrap not found"
}
2022/01/04 12:29:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:29:52 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:29:54 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:29:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:29:59 eventingSetup.go:125: Deploying app: TestSourceAndMetaBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:30:00 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceAndMetaBucketDeleteWithBootstrap stored in temp store"
}
2022/01/04 12:30:19 handler_test.go:988: Deleting source bucket: default
2022/01/04 12:30:20 handler_test.go:990: Deleted source bucket: default
2022/01/04 12:30:20 handler_test.go:992: Deleting metadata bucket: eventing
2022/01/04 12:30:21 handler_test.go:994: Deleted metadata bucket: eventing
2022/01/04 12:30:36 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2022/01/04 12:30:36 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2022/01/04 12:30:51 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2022/01/04 12:30:51 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2022/01/04 12:30:51 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:30:51 eventingSetup.go:418: Function: TestSourceAndMetaBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceAndMetaBucketDeleteWithBootstrap deleting in background"
}
2022/01/04 12:30:52 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:30:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:30:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:31:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceAndMetaBucketDeleteWithBootstrap (88.20s)
=== RUN   TestUndeployDuringBootstrap
2022/01/04 12:31:14 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2022/01/04 12:31:14 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2022/01/04 12:31:14 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:31:14 eventingSetup.go:418: Function: TestUndeployDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployDuringBootstrap not found"
}
2022/01/04 12:31:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:31:20 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:31:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:31:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:31:27 eventingSetup.go:125: Deploying app: TestUndeployDuringBootstrap. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:31:28 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployDuringBootstrap stored in temp store"
}
2022/01/04 12:31:28 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 12:31:40 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:31:40 clusterSetup.go:375: Apps undergoing bootstrap: true
2022/01/04 12:31:40 clusterSetup.go:378: App: TestUndeployDuringBootstrap started bootstrap
2022/01/04 12:31:40 clusterSetup.go:375: Apps undergoing bootstrap: true
2022/01/04 12:31:45 clusterSetup.go:367: No apps undergoing bootstrap
2022/01/04 12:31:50 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2022/01/04 12:31:55 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2022/01/04 12:32:00 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2022/01/04 12:32:00 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2022/01/04 12:32:00 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:32:25 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2022/01/04 12:32:25 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2022/01/04 12:32:25 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:32:25 eventingSetup.go:418: Function: TestUndeployDuringBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployDuringBootstrap deleting in background"
}
2022/01/04 12:32:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:32:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 12:32:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:32:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:32:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2018
2022/01/04 12:32:53 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 150
2022/01/04 12:32:53 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployDuringBootstrap (109.31s)
=== RUN   TestDeleteBeforeUndeploy
2022/01/04 12:32:58 eventingSetup.go:125: Deploying app: TestDeleteBeforeUndeploy. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:32:59 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeleteBeforeUndeploy stored in temp store"
}
2022/01/04 12:33:04 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2022/01/04 12:33:09 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2022/01/04 12:33:14 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2022/01/04 12:33:19 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2022/01/04 12:33:20 clusterSetup.go:354: App: TestDeleteBeforeUndeploy got deployed
2022/01/04 12:33:20 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 422 dump: {
 "name": "ERR_APP_NOT_UNDEPLOYED",
 "code": 22,
 "description": "Function: TestDeleteBeforeUndeploy skipping delete request as it hasn't been undeployed"
}
2022/01/04 12:33:20 eventingSetup.go:270: Function: TestDeleteBeforeUndeploy update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 12:33:20 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeleteBeforeUndeploy deleting in background"
}
2022/01/04 12:33:25 clusterSetup.go:397: Waiting for app: TestDeleteBeforeUndeploy to get un-deployed
2022/01/04 12:33:25 clusterSetup.go:405: App: TestDeleteBeforeUndeploy got un-deployed
2022/01/04 12:33:25 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:33:25 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeleteBeforeUndeploy not found"
}
2022/01/04 12:33:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:33:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:33:33 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:33:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDeleteBeforeUndeploy (44.61s)
=== RUN   TestUndeployWhenTimersAreFired
2022/01/04 12:33:48 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2022/01/04 12:33:48 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2022/01/04 12:33:48 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:33:48 eventingSetup.go:418: Function: TestUndeployWhenTimersAreFired delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployWhenTimersAreFired not found"
}
2022/01/04 12:33:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:33:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:33:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:34:01 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:34:01 eventingSetup.go:125: Deploying app: TestUndeployWhenTimersAreFired. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:34:03 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWhenTimersAreFired stored in temp store"
}
2022/01/04 12:34:08 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2022/01/04 12:34:13 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2022/01/04 12:34:18 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2022/01/04 12:34:23 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2022/01/04 12:34:23 clusterSetup.go:354: App: TestUndeployWhenTimersAreFired got deployed
2022/01/04 12:34:23 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 12:34:58 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2022/01/04 12:35:03 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2022/01/04 12:35:08 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2022/01/04 12:35:13 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2022/01/04 12:35:13 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2022/01/04 12:35:13 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:36:58 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2022/01/04 12:36:58 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2022/01/04 12:36:58 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:36:58 eventingSetup.go:418: Function: TestUndeployWhenTimersAreFired delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWhenTimersAreFired deleting in background"
}
2022/01/04 12:36:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:37:09 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 12:37:14 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/04 12:37:14 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:37:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:37:26 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 12:37:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployWhenTimersAreFired (228.09s)
=== RUN   TestUndeployWithKVFailover
2022/01/04 12:37:36 clusterSetup.go:397: Waiting for app: TestUndeployWithKVFailover to get un-deployed
2022/01/04 12:37:36 clusterSetup.go:405: App: TestUndeployWithKVFailover got un-deployed
2022/01/04 12:37:36 eventingSetup.go:46: No eventing-con process running
2022/01/04 12:37:36 eventingSetup.go:418: Function: TestUndeployWithKVFailover delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployWithKVFailover not found"
}
2022/01/04 12:37:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:37:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:37:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:37:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:37:49 eventingSetup.go:125: Deploying app: TestUndeployWithKVFailover. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:37:50 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWithKVFailover stored in temp store"
}
2022/01/04 12:37:50 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 12:37:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:38:02 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:38:07 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:38:12 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:38:17 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:38:22 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:38:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 3106
2022/01/04 12:38:32 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 3106
2022/01/04 12:38:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 12:38:32 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2022/01/04 12:38:32 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 12:38:38 Rebalance progress: 29.16666666666666
2022/01/04 12:38:43 Rebalance progress: 29.16666666666666
2022/01/04 12:38:48 Rebalance progress: 100
2022/01/04 12:38:48 Failing over: [127.0.0.1:19003]
2022/01/04 12:38:58 Function: TestUndeployWithKVFailover update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/04 12:39:58 Removing node(s): [] from the cluster
2022/01/04 12:40:03 Rebalance progress: 29.16666666666666
2022/01/04 12:40:08 Rebalance progress: 29.16666666666666
2022/01/04 12:40:13 Rebalance progress: 100
2022/01/04 12:40:18 Waiting for app: TestUndeployWithKVFailover to get un-deployed
2022/01/04 12:40:18 App: TestUndeployWithKVFailover got un-deployed
2022/01/04 12:40:18 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:40:23 Waiting for app: TestUndeployWithKVFailover to get un-deployed
2022/01/04 12:40:23 App: TestUndeployWithKVFailover got un-deployed
2022/01/04 12:40:23 No eventing-con process running
2022/01/04 12:40:23 Function: TestUndeployWithKVFailover delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWithKVFailover deleting in background"
}
2022/01/04 12:40:24 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:40:34 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 12:40:39 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/04 12:40:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:40:41 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:40:51 Waiting for dst bucket item count to get to: 0 curr count: 4561
2022/01/04 12:40:56 Waiting for dst bucket item count to get to: 0 curr count: 4561
2022/01/04 12:40:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployWithKVFailover (209.83s)
=== RUN   TestBucketFlushWhileFnDeployed
2022/01/04 12:41:06 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2022/01/04 12:41:06 App: TestBucketFlushWhileFnDeployed got un-deployed
2022/01/04 12:41:06 No eventing-con process running
2022/01/04 12:41:06 Function: TestBucketFlushWhileFnDeployed delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketFlushWhileFnDeployed not found"
}
2022/01/04 12:41:07 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:41:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:41:14 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:41:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:41:19 Deploying app: TestBucketFlushWhileFnDeployed. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:41:20 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketFlushWhileFnDeployed stored in temp store"
}
2022/01/04 12:41:25 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2022/01/04 12:41:30 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2022/01/04 12:41:35 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2022/01/04 12:41:40 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2022/01/04 12:41:40 App: TestBucketFlushWhileFnDeployed got deployed
2022/01/04 12:41:40 Starting bucket ops to source bucket
2022/01/04 12:42:01 Waiting for dst bucket item count to get to: 20000 curr count: 10543
2022/01/04 12:42:01 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2022/01/04 12:42:01 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:42:03 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:42:13 Waiting for dst bucket item count to get to: 0 curr count: 20000
2022/01/04 12:42:18 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/04 12:42:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:42:20 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:42:30 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/04 12:42:35 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/04 12:42:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:42:35 Starting bucket ops to source bucket
2022/01/04 12:42:47 Waiting for dst bucket item count to get to: 10000 curr count: 4611
2022/01/04 12:42:52 Waiting for dst bucket item count to get to: 10000 curr count: 4611
2022/01/04 12:42:52 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/04 12:42:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:42:57 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2022/01/04 12:43:03 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2022/01/04 12:43:08 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2022/01/04 12:43:13 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2022/01/04 12:43:13 App: TestBucketFlushWhileFnDeployed got un-deployed
2022/01/04 12:43:13 No eventing-con process running
2022/01/04 12:43:13 Function: TestBucketFlushWhileFnDeployed delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketFlushWhileFnDeployed deleting in background"
}
2022/01/04 12:43:14 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:43:24 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/04 12:43:29 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 12:43:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:43:31 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:43:41 Waiting for dst bucket item count to get to: 0 curr count: 8632
2022/01/04 12:43:46 Waiting for dst bucket item count to get to: 0 curr count: 8632
2022/01/04 12:43:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBucketFlushWhileFnDeployed (169.78s)
=== RUN   TestTimerOverwrite
2022/01/04 12:43:56 Waiting for app: TestTimerOverwrite to get un-deployed
2022/01/04 12:43:56 App: TestTimerOverwrite got un-deployed
2022/01/04 12:43:56 No eventing-con process running
2022/01/04 12:43:56 Function: TestTimerOverwrite delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerOverwrite not found"
}
2022/01/04 12:43:57 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:44:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:44:04 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:44:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:44:09 Deploying app: TestTimerOverwrite. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:44:10 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverwrite stored in temp store"
}
2022/01/04 12:44:15 Waiting for app: TestTimerOverwrite to get deployed
2022/01/04 12:44:20 Waiting for app: TestTimerOverwrite to get deployed
2022/01/04 12:44:25 Waiting for app: TestTimerOverwrite to get deployed
2022/01/04 12:44:30 Waiting for app: TestTimerOverwrite to get deployed
2022/01/04 12:44:30 App: TestTimerOverwrite got deployed
2022/01/04 12:44:40 Starting bucket ops to source bucket
2022/01/04 12:44:49 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:44:54 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:44:59 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:45:04 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:45:09 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:45:14 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:45:19 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:45:24 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:45:29 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:45:34 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:45:39 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:45:44 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 12:45:44 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 12:45:54 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:45:59 Waiting for app: TestTimerOverwrite to get un-deployed
2022/01/04 12:46:04 Waiting for app: TestTimerOverwrite to get un-deployed
2022/01/04 12:46:09 Waiting for app: TestTimerOverwrite to get un-deployed
2022/01/04 12:46:14 Waiting for app: TestTimerOverwrite to get un-deployed
2022/01/04 12:46:14 App: TestTimerOverwrite got un-deployed
2022/01/04 12:46:14 No eventing-con process running
2022/01/04 12:46:14 Function: TestTimerOverwrite delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverwrite deleting in background"
}
2022/01/04 12:46:15 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:46:25 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 12:46:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:46:27 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:46:37 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 12:46:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerOverwrite (171.27s)
=== RUN   TestUndeployBackdoorDuringBootstrap
2022/01/04 12:46:42 Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2022/01/04 12:46:42 Removing node(s): [] from the cluster
2022/01/04 12:46:47 Rebalance progress: 100
2022/01/04 12:46:47 Failing over: [127.0.0.1:19003]
2022/01/04 12:46:52 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2022/01/04 12:46:52 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2022/01/04 12:46:52 No eventing-con process running
2022/01/04 12:46:52 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployBackdoorDuringBootstrap not found"
}
2022/01/04 12:46:53 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:46:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:47:00 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:47:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:47:05 Deploying app: TestUndeployBackdoorDuringBootstrap. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:47:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployBackdoorDuringBootstrap stored in temp store"
}
2022/01/04 12:47:06 Starting bucket ops to source bucket
2022/01/04 12:47:16 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:47:17 Context: Post to set retry counter, response code: 200 dump: {
 "code": 0
}
2022/01/04 12:47:17 set retry counter, response &{[123 10 32 34 99 111 100 101 34 58 32 48 10 125] }
2022/01/04 12:48:22 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2022/01/04 12:48:22 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2022/01/04 12:48:22 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:48:22 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployBackdoorDuringBootstrap deleting in background"
}
2022/01/04 12:48:27 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2022/01/04 12:48:27 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2022/01/04 12:48:27 No eventing-con process running
2022/01/04 12:48:27 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployBackdoorDuringBootstrap not found"
}
2022/01/04 12:48:28 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:48:38 Waiting for dst bucket item count to get to: 0 curr count: 3082
2022/01/04 12:48:43 Waiting for dst bucket item count to get to: 0 curr count: 582
2022/01/04 12:48:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:48:45 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:48:55 Waiting for dst bucket item count to get to: 0 curr count: 2807
2022/01/04 12:48:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:48:55 Removing node(s): [] from the cluster
2022/01/04 12:49:00 Rebalance progress: 100
--- PASS: TestUndeployBackdoorDuringBootstrap (142.73s)
=== RUN   TestOnUpdateSrcMutation
2022/01/04 12:49:10 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2022/01/04 12:49:10 App: TestOnUpdateSrcMutation got un-deployed
2022/01/04 12:49:10 No eventing-con process running
2022/01/04 12:49:10 Function: TestOnUpdateSrcMutation delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateSrcMutation not found"
}
2022/01/04 12:49:11 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:49:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:49:18 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:49:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:49:23 Deploying app: TestOnUpdateSrcMutation. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:49:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutation stored in temp store"
}
2022/01/04 12:49:24 Starting bucket ops to source bucket
2022/01/04 12:49:51 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/04 12:49:51 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:49:56 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2022/01/04 12:50:01 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2022/01/04 12:50:06 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2022/01/04 12:50:11 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2022/01/04 12:50:11 App: TestOnUpdateSrcMutation got un-deployed
2022/01/04 12:50:11 No eventing-con process running
2022/01/04 12:50:11 Function: TestOnUpdateSrcMutation delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutation deleting in background"
}
2022/01/04 12:50:12 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:50:22 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/04 12:50:27 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 12:50:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:50:29 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:50:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateSrcMutation (94.54s)
=== RUN   TestOnDeleteSrcMutation
2022/01/04 12:50:44 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2022/01/04 12:50:44 App: TestOnDeleteSrcMutation got un-deployed
2022/01/04 12:50:44 No eventing-con process running
2022/01/04 12:50:44 Function: TestOnDeleteSrcMutation delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteSrcMutation not found"
}
2022/01/04 12:50:45 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:50:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:50:52 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:50:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:50:57 Deploying app: TestOnDeleteSrcMutation. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:50:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutation stored in temp store"
}
2022/01/04 12:50:58 Starting bucket ops to source bucket
2022/01/04 12:51:27 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 12:51:27 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:51:32 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2022/01/04 12:51:37 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2022/01/04 12:51:42 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2022/01/04 12:51:47 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2022/01/04 12:51:47 App: TestOnDeleteSrcMutation got un-deployed
2022/01/04 12:51:47 No eventing-con process running
2022/01/04 12:51:47 Function: TestOnDeleteSrcMutation delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutation deleting in background"
}
2022/01/04 12:51:49 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:51:59 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 12:52:04 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/04 12:52:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:52:05 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:52:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteSrcMutation (96.20s)
=== RUN   TestOnUpdateSrcMutationWithTimer
2022/01/04 12:52:20 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2022/01/04 12:52:20 App: TestOnUpdateSrcMutationWithTimer got un-deployed
2022/01/04 12:52:20 No eventing-con process running
2022/01/04 12:52:20 Function: TestOnUpdateSrcMutationWithTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateSrcMutationWithTimer not found"
}
2022/01/04 12:52:22 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:52:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:52:28 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:52:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:52:33 Deploying app: TestOnUpdateSrcMutationWithTimer. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:52:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutationWithTimer stored in temp store"
}
2022/01/04 12:52:35 Starting bucket ops to source bucket
2022/01/04 12:53:17 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/04 12:53:17 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:53:22 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2022/01/04 12:53:27 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2022/01/04 12:53:32 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2022/01/04 12:53:37 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2022/01/04 12:53:37 App: TestOnUpdateSrcMutationWithTimer got un-deployed
2022/01/04 12:53:37 No eventing-con process running
2022/01/04 12:53:37 Function: TestOnUpdateSrcMutationWithTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutationWithTimer deleting in background"
}
2022/01/04 12:53:38 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:53:48 Waiting for dst bucket item count to get to: 0 curr count: 9512
2022/01/04 12:53:53 Waiting for dst bucket item count to get to: 0 curr count: 4512
2022/01/04 12:53:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:53:55 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:54:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateSrcMutationWithTimer (109.66s)
=== RUN   TestOnDeleteSrcMutationsWithTimer
2022/01/04 12:54:10 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2022/01/04 12:54:10 App: TestOnDeleteSrcMutationsWithTimer got un-deployed
2022/01/04 12:54:10 No eventing-con process running
2022/01/04 12:54:10 Function: TestOnDeleteSrcMutationsWithTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteSrcMutationsWithTimer not found"
}
2022/01/04 12:54:11 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:54:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:54:18 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:54:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:54:23 Deploying app: TestOnDeleteSrcMutationsWithTimer. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:54:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutationsWithTimer stored in temp store"
}
2022/01/04 12:54:24 Starting bucket ops to source bucket
2022/01/04 12:55:08 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 12:55:08 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 12:55:13 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2022/01/04 12:55:18 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2022/01/04 12:55:23 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2022/01/04 12:55:28 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2022/01/04 12:55:28 App: TestOnDeleteSrcMutationsWithTimer got un-deployed
2022/01/04 12:55:28 No eventing-con process running
2022/01/04 12:55:28 Function: TestOnDeleteSrcMutationsWithTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutationsWithTimer deleting in background"
}
2022/01/04 12:55:29 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:55:39 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/04 12:55:44 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/04 12:55:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:55:46 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:55:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteSrcMutationsWithTimer (111.17s)
=== RUN   TestInterHandlerRecursion
2022/01/04 12:56:01 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/04 12:56:01 App: TestInterHandlerRecursion_source_bucket_update_op got un-deployed
2022/01/04 12:56:01 No eventing-con process running
2022/01/04 12:56:01 Function: TestInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_source_bucket_update_op not found"
}
2022/01/04 12:56:02 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:56:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:56:09 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:56:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:56:19 Waiting for app: TestInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/04 12:56:19 App: TestInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2022/01/04 12:56:19 No eventing-con process running
2022/01/04 12:56:19 Function: TestInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2022/01/04 12:56:21 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:56:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:56:27 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:56:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:56:32 Deploying app: TestInterHandlerRecursion_source_bucket_update_op. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:56:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op stored in temp store"
}
2022/01/04 12:56:34 response body {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op stored in temp store"
} err 
2022/01/04 12:56:39 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/04 12:56:44 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/04 12:56:49 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/04 12:56:54 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/04 12:56:54 App: TestInterHandlerRecursion_source_bucket_update_op got deployed
2022/01/04 12:56:54 Deploying app: TestInterHandlerRecursion_src_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:56:54 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_FUNCTION_RECURSION",
 "code": 50,
 "description": "Inter handler recursion error"
}
2022/01/04 12:56:54 response body {
 "name": "ERR_INTER_FUNCTION_RECURSION",
 "code": 50,
 "description": "Inter handler recursion error"
} err 
2022/01/04 12:56:59 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/04 12:57:04 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/04 12:57:09 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/04 12:57:14 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/04 12:57:14 App: TestInterHandlerRecursion_source_bucket_update_op got un-deployed
2022/01/04 12:57:14 No eventing-con process running
2022/01/04 12:57:14 Function: TestInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op deleting in background"
}
2022/01/04 12:57:15 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:57:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:57:22 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:57:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:57:32 Waiting for app: TestInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/04 12:57:32 App: TestInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2022/01/04 12:57:32 No eventing-con process running
2022/01/04 12:57:32 Function: TestInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2022/01/04 12:57:33 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:57:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:57:40 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:57:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterHandlerRecursion (113.72s)
=== RUN   TestInterBucketRecursion
2022/01/04 12:57:50 Deploying app: TestInterBucketRecursion_function1. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:57:51 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 stored in temp store"
}
2022/01/04 12:57:51 response body {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 stored in temp store"
} err 
2022/01/04 12:57:51 Deploying app: TestInterBucketRecursion_function2. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:57:51 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestInterBucketRecursion_function2 causes a cycle involving functions: [TestInterBucketRecursion_function1], hence deployment is disallowed"
}
2022/01/04 12:57:56 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2022/01/04 12:58:01 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2022/01/04 12:58:06 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2022/01/04 12:58:11 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2022/01/04 12:58:11 App: TestInterBucketRecursion_function1 got deployed
2022/01/04 12:58:16 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2022/01/04 12:58:21 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2022/01/04 12:58:26 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2022/01/04 12:58:31 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2022/01/04 12:58:31 App: TestInterBucketRecursion_function1 got un-deployed
2022/01/04 12:58:31 No eventing-con process running
2022/01/04 12:58:31 Function: TestInterBucketRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 deleting in background"
}
2022/01/04 12:58:33 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:58:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:58:39 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:58:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:58:49 Waiting for app: TestInterBucketRecursion_function2 to get un-deployed
2022/01/04 12:58:49 App: TestInterBucketRecursion_function2 got un-deployed
2022/01/04 12:58:49 No eventing-con process running
2022/01/04 12:58:49 Function: TestInterBucketRecursion_function2 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterBucketRecursion_function2 not found"
}
2022/01/04 12:58:51 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:58:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:58:58 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:59:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterBucketRecursion (77.61s)
=== RUN   TestLargeHandler
2022/01/04 12:59:03 Changed force_compress value to false
2022/01/04 12:59:03 Deploying app: TestLargeHandler_function. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:59:03 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_APPCODE_SIZE",
 "code": 39,
 "description": "Function: TestLargeHandler_function handler Code size is more than 131072. Code Size: 131768"
}
2022/01/04 12:59:03 Changed force_compress value to true
2022/01/04 12:59:03 Deploying app: TestLargeHandler_function. Item count src bucket: 0 dst bucket: 0
2022/01/04 12:59:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestLargeHandler_function stored in temp store"
}
2022/01/04 12:59:09 Waiting for app: TestLargeHandler_function to get deployed
2022/01/04 12:59:14 Waiting for app: TestLargeHandler_function to get deployed
2022/01/04 12:59:20 Waiting for app: TestLargeHandler_function to get deployed
2022/01/04 12:59:25 Waiting for app: TestLargeHandler_function to get deployed
2022/01/04 12:59:25 App: TestLargeHandler_function got deployed
2022/01/04 12:59:30 Waiting for app: TestLargeHandler_function to get un-deployed
2022/01/04 12:59:35 Waiting for app: TestLargeHandler_function to get un-deployed
2022/01/04 12:59:40 Waiting for app: TestLargeHandler_function to get un-deployed
2022/01/04 12:59:45 Waiting for app: TestLargeHandler_function to get un-deployed
2022/01/04 12:59:45 App: TestLargeHandler_function got un-deployed
2022/01/04 12:59:45 No eventing-con process running
2022/01/04 12:59:45 Function: TestLargeHandler_function delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestLargeHandler_function deleting in background"
}
2022/01/04 12:59:46 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:59:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 12:59:53 Context: Bucket flush, response code: 200 dump: 
2022/01/04 12:59:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestLargeHandler (55.30s)
=== RUN   TestAllowInterHandlerRecursion
2022/01/04 13:00:08 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/04 13:00:08 App: TestAllowInterHandlerRecursion_source_bucket_update_op got un-deployed
2022/01/04 13:00:08 No eventing-con process running
2022/01/04 13:00:08 Function: TestAllowInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op not found"
}
2022/01/04 13:00:09 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:00:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:00:16 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:00:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:00:26 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/04 13:00:26 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2022/01/04 13:00:26 No eventing-con process running
2022/01/04 13:00:26 Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2022/01/04 13:00:27 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:00:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:00:34 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:00:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:00:39 Deploying app: TestAllowInterHandlerRecursion_source_bucket_update_op. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:00:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op stored in temp store"
}
2022/01/04 13:00:40 response body {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op stored in temp store"
} err 
2022/01/04 13:00:45 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/04 13:00:50 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/04 13:00:55 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/04 13:01:00 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/04 13:01:00 App: TestAllowInterHandlerRecursion_source_bucket_update_op got deployed
2022/01/04 13:01:00 Deploying app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:01:01 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete stored in temp store"
}
2022/01/04 13:01:01 response body {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete stored in temp store"
} err 
2022/01/04 13:01:06 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2022/01/04 13:01:11 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2022/01/04 13:01:17 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2022/01/04 13:01:22 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2022/01/04 13:01:22 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got deployed
2022/01/04 13:01:22 TestAllowInterHandlerRecursion_src_bucket_op_on_delete is deployed
2022/01/04 13:01:27 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/04 13:01:32 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/04 13:01:37 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/04 13:01:42 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/04 13:01:42 App: TestAllowInterHandlerRecursion_source_bucket_update_op got un-deployed
2022/01/04 13:01:42 No eventing-con process running
2022/01/04 13:01:42 Function: TestAllowInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op deleting in background"
}
2022/01/04 13:01:44 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:01:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:01:51 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:01:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:02:01 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/04 13:02:06 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/04 13:02:11 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/04 13:02:16 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/04 13:02:16 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2022/01/04 13:02:16 No eventing-con process running
2022/01/04 13:02:16 Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete deleting in background"
}
2022/01/04 13:02:17 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:02:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:02:24 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:02:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAllowInterHandlerRecursion (151.47s)
=== RUN   TestAllowInterBucketRecursion
2022/01/04 13:02:34 Deploying app: TestAllowInterBucketRecursion_function1. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:02:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 stored in temp store"
}
2022/01/04 13:02:35 response body {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 stored in temp store"
} err 
2022/01/04 13:02:40 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2022/01/04 13:02:45 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2022/01/04 13:02:50 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2022/01/04 13:02:56 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2022/01/04 13:02:56 App: TestAllowInterBucketRecursion_function1 got deployed
2022/01/04 13:02:56 Deploying app: TestAllowInterBucketRecursion_function2. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:02:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 stored in temp store"
}
2022/01/04 13:02:57 response body {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 stored in temp store"
} err 
2022/01/04 13:03:02 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2022/01/04 13:03:07 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2022/01/04 13:03:12 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2022/01/04 13:03:17 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2022/01/04 13:03:17 App: TestAllowInterBucketRecursion_function2 got deployed
2022/01/04 13:03:17 TestAllowInterBucketRecursion_function2 is deployed
2022/01/04 13:03:22 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2022/01/04 13:03:27 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2022/01/04 13:03:32 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2022/01/04 13:03:37 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2022/01/04 13:03:37 App: TestAllowInterBucketRecursion_function1 got un-deployed
2022/01/04 13:03:37 No eventing-con process running
2022/01/04 13:03:37 Function: TestAllowInterBucketRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 deleting in background"
}
2022/01/04 13:03:38 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:03:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:03:46 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:03:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:03:56 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2022/01/04 13:04:01 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2022/01/04 13:04:06 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2022/01/04 13:04:11 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2022/01/04 13:04:11 App: TestAllowInterBucketRecursion_function2 got un-deployed
2022/01/04 13:04:11 No eventing-con process running
2022/01/04 13:04:12 Function: TestAllowInterBucketRecursion_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 deleting in background"
}
2022/01/04 13:04:13 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:04:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:04:20 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:04:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAllowInterBucketRecursion (115.30s)
=== RUN   TestInterBucketRecursion2
2022/01/04 13:04:30 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:04:36 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:04:42 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:04:48 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:04:53 Deploying app: TestInterBucketRecursion2_function1. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:04:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function1 stored in temp store"
}
2022/01/04 13:04:59 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2022/01/04 13:05:04 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2022/01/04 13:05:09 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2022/01/04 13:05:14 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2022/01/04 13:05:15 App: TestInterBucketRecursion2_function1 got deployed
2022/01/04 13:05:15 Deploying app: TestInterBucketRecursion2_function2. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:05:16 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function2 stored in temp store"
}
2022/01/04 13:05:21 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2022/01/04 13:05:26 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2022/01/04 13:05:31 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2022/01/04 13:05:36 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2022/01/04 13:05:36 App: TestInterBucketRecursion2_function2 got deployed
2022/01/04 13:05:36 Deploying app: TestInterBucketRecursion2_function3. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:05:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function3 stored in temp store"
}
2022/01/04 13:05:42 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2022/01/04 13:05:47 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2022/01/04 13:05:52 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2022/01/04 13:05:57 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2022/01/04 13:05:57 App: TestInterBucketRecursion2_function3 got deployed
2022/01/04 13:05:57 Deploying app: TestInterBucketRecursion2_function4. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:05:57 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestInterBucketRecursion2_function4 causes a cycle involving functions: [TestInterBucketRecursion2_function1 TestInterBucketRecursion2_function2 TestInterBucketRecursion2_function3], hence deployment is disallowed"
}
2022/01/04 13:06:02 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2022/01/04 13:06:07 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2022/01/04 13:06:12 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2022/01/04 13:06:17 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2022/01/04 13:06:17 App: TestInterBucketRecursion2_function1 got un-deployed
2022/01/04 13:06:17 No eventing-con process running
2022/01/04 13:06:17 Function: TestInterBucketRecursion2_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function1 deleting in background"
}
2022/01/04 13:06:19 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:06:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:06:25 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:06:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:06:36 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2022/01/04 13:06:41 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2022/01/04 13:06:46 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2022/01/04 13:06:51 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2022/01/04 13:06:51 App: TestInterBucketRecursion2_function2 got un-deployed
2022/01/04 13:06:51 No eventing-con process running
2022/01/04 13:06:51 Function: TestInterBucketRecursion2_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function2 deleting in background"
}
2022/01/04 13:06:52 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:06:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:06:59 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:07:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:07:09 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2022/01/04 13:07:14 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2022/01/04 13:07:19 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2022/01/04 13:07:24 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2022/01/04 13:07:24 App: TestInterBucketRecursion2_function3 got un-deployed
2022/01/04 13:07:24 No eventing-con process running
2022/01/04 13:07:24 Function: TestInterBucketRecursion2_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function3 deleting in background"
}
2022/01/04 13:07:26 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:07:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:07:32 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:07:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:07:42 Waiting for app: TestInterBucketRecursion2_function4 to get un-deployed
2022/01/04 13:07:43 App: TestInterBucketRecursion2_function4 got un-deployed
2022/01/04 13:07:43 No eventing-con process running
2022/01/04 13:07:43 Function: TestInterBucketRecursion2_function4 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterBucketRecursion2_function4 not found"
}
2022/01/04 13:07:44 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:07:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:07:51 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:07:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterBucketRecursion2 (212.94s)
=== RUN   TestBucketDeleteWithRebOut
2022/01/04 13:08:03 Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2022/01/04 13:08:08 Rebalance progress: 100

VB distribution across eventing nodes and their workers::

2022/01/04 13:08:11 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:08:26 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:08:41 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:08:56 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:09:11 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:09:26 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:09:41 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:09:56 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:10:11 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:10:26 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:10:41 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:10:56 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:11:11 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:11:26 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:11:41 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:11:56 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:12:11 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:12:26 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:12:41 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:12:56 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:13:11 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:13:26 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:13:41 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/04 13:13:56 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:58} {Name:#primary Bucket:hello-world Completion:100}]

DCP Stream statuses:

vbucket curr owner:


2022/01/04 13:14:11 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:14:11 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 13:14:11 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 13:14:16 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:

vbucket curr owner:


2022/01/04 13:14:16 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:14:16 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 13:14:17 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 13:14:22 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:

vbucket curr owner:


2022/01/04 13:14:22 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:14:27 clusterSetup.go:397: Waiting for app: TestBucketDeleteWithRebOut to get un-deployed
2022/01/04 13:14:27 clusterSetup.go:405: App: TestBucketDeleteWithRebOut got un-deployed
2022/01/04 13:14:27 eventingSetup.go:46: No eventing-con process running
2022/01/04 13:14:27 eventingSetup.go:418: Function: TestBucketDeleteWithRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketDeleteWithRebOut not found"
}
2022/01/04 13:14:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:14:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:14:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:14:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:14:45 eventingSetup.go:125: Deploying app: TestBucketDeleteWithRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:14:46 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteWithRebOut stored in temp store"
}
2022/01/04 13:14:51 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2022/01/04 13:14:56 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2022/01/04 13:15:01 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2022/01/04 13:15:06 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2022/01/04 13:15:06 clusterSetup.go:354: App: TestBucketDeleteWithRebOut got deployed

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: 61d8397629ec2df9c1a90f42b6d3dc6d
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [0-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [114-227]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 114
	v: [228-341]
Producer node: 172.31.2.134:9300	Node UUID: 142f2ba4536e2ebf850b70cdb7738062
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [797-910]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [911-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [683-796]
Producer node: 127.0.0.1:9303	Node UUID: 556a671ce6f0e75404f67be000cd9552
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [570-682]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [342-455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [456-569]


2022/01/04 13:15:06 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:15:06 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 13:15:11 Rebalance progress: 29.16666666666666
2022/01/04 13:15:16 Rebalance progress: 29.16666666666666
2022/01/04 13:15:21 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: 61d8397629ec2df9c1a90f42b6d3dc6d
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [0-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [114-227]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 114
	v: [228-341]
Producer node: 172.31.2.134:9300	Node UUID: 142f2ba4536e2ebf850b70cdb7738062
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [911-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [683-796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [797-910]
Producer node: 127.0.0.1:9303	Node UUID: 556a671ce6f0e75404f67be000cd9552
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [342-455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [456-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [570-682]


2022/01/04 13:15:21 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:15:21 handler_test.go:1674: Deleting source bucket: default
2022/01/04 13:15:23 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 13:15:24 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 13:15:29 Rebalance progress: 29.16666666666666
2022/01/04 13:15:34 Rebalance progress: 29.16666666666666
2022/01/04 13:15:39 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 902
	vb list dump: [0-7, 9-12, 15-19, 21-32, 34-44, 46, 48-61, 63-70, 73-75, 77-84, 87-105, 107-120, 123-124, 127-130, 132, 134, 136-153, 156-183, 186-195, 197-211, 213-214, 216-222, 224-228, 230-239, 241-245, 247-261, 263-271, 273-275, 277, 279-282, 284-288, 290, 292-298, 300-302, 304-310, 312-321, 323-324, 326-334, 336, 338-340, 342-355, 357-363, 365, 368-374, 376-377, 379-381, 383-384, 386-389, 391-394, 396-405, 407-411, 413-426, 428-429, 431-519, 521-524, 526-536, 538, 543-545, 547, 549-559, 561-568, 571, 573-597, 599-607, 609-612, 614-626, 628-630, 632-637, 639, 641-650, 652-669, 671-676, 678-683, 685-686, 688-701, 703-705, 707, 709-722, 724-729, 731-734, 736-749, 751-762, 764-782, 784, 786-790, 792-798, 800-802, 804-808, 811-816, 818-824, 826, 828-831, 833-856, 858-888, 890-903, 906-907, 909-920, 922-930, 932-937, 939-952, 954-967, 970-976, 978-981, 983-1001, 1003-1006, 1008-1011, 1013-1018, 1020-1023]
	stream status: stopped
	len: 122
	vb list dump: [8, 13-14, 20, 33, 45, 47, 62, 71-72, 76, 85-86, 106, 121-122, 125-126, 131, 133, 135, 154-155, 184-185, 196, 212, 215, 223, 229, 240, 246, 262, 272, 276, 278, 283, 289, 291, 299, 303, 311, 322, 325, 335, 337, 341, 356, 364, 366-367, 375, 378, 382, 385, 390, 395, 406, 412, 427, 430, 520, 525, 537, 539-542, 546, 548, 560, 569-570, 572, 598, 608, 613, 627, 631, 638, 640, 651, 670, 677, 684, 687, 702, 706, 708, 723, 730, 735, 750, 763, 783, 785, 791, 799, 803, 809-810, 817, 825, 827, 832, 857, 889, 904-905, 908, 921, 931, 938, 953, 968-969, 977, 982, 1002, 1007, 1012, 1019]

vbucket curr owner:
Producer node: 127.0.0.1:9303	Node UUID: 556a671ce6f0e75404f67be000cd9552
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 100
	v: [342-355, 357-363, 365, 368-374, 376-377, 379-381, 383-384, 386-389, 391-394, 396-405, 407-411, 413-426, 428-429, 431-455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 103
	v: [456-519, 521-524, 526-536, 538, 543-545, 547, 549-559, 561-568]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 101
	v: [571, 573-597, 599-607, 609-612, 614-626, 628-630, 632-637, 639, 641-650, 652-669, 671-676, 678-682]
Producer node: 127.0.0.1:9302	Node UUID: 61d8397629ec2df9c1a90f42b6d3dc6d
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 100
	v: [0-7, 9-12, 15-19, 21-32, 34-44, 46, 48-61, 63-70, 73-75, 77-84, 87-105, 107-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 99
	v: [114-120, 123-124, 127-130, 132, 134, 136-153, 156-183, 186-195, 197-211, 213-214, 216-222, 224-227]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 96
	v: [228, 230-239, 241-245, 247-261, 263-271, 273-275, 277, 279-282, 284-288, 290, 292-298, 300-302, 304-310, 312-321, 323-324, 326-334, 336, 338-340]
Producer node: 172.31.2.134:9300	Node UUID: 142f2ba4536e2ebf850b70cdb7738062
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 101
	v: [911-920, 922-930, 932-937, 939-952, 954-967, 970-976, 978-981, 983-1001, 1003-1006, 1008-1011, 1013-1018, 1020-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 101
	v: [683, 685-686, 688-701, 703-705, 707, 709-722, 724-729, 731-734, 736-749, 751-762, 764-782, 784, 786-790, 792-796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 101
	v: [797-798, 800-802, 804-808, 811-816, 818-824, 826, 828-831, 833-856, 858-888, 890-903, 906-907, 909-910]


2022/01/04 13:15:39 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:15:44 eventingSetup.go:719: Waiting for function: TestBucketDeleteWithRebOut status to change to undeployed
2022/01/04 13:15:44 eventingSetup.go:727: Function: TestBucketDeleteWithRebOut status changed to undeployed
2022/01/04 13:15:49 clusterSetup.go:397: Waiting for app: TestBucketDeleteWithRebOut to get un-deployed
2022/01/04 13:15:49 clusterSetup.go:405: App: TestBucketDeleteWithRebOut got un-deployed
2022/01/04 13:15:49 eventingSetup.go:46: No eventing-con process running
2022/01/04 13:15:49 eventingSetup.go:418: Function: TestBucketDeleteWithRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteWithRebOut deleting in background"
}
2022/01/04 13:15:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:15:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:15:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:16:02 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:16:02 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2022/01/04 13:16:02 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 13:16:07 Rebalance progress: 100
--- PASS: TestBucketDeleteWithRebOut (492.41s)
=== RUN   TestN1QLRecursion
2022/01/04 13:16:10 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/04 13:16:10 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2022/01/04 13:16:10 Removing node(s): [] from the cluster
2022/01/04 13:16:15 Rebalance progress: 100
2022/01/04 13:16:22 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:16:27 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:16:33 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:16:39 Deploying app: TestN1QLRecursion_function1. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:16:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 stored in temp store"
}
2022/01/04 13:16:40 response body {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 stored in temp store"
} err 
2022/01/04 13:16:45 Waiting for app: TestN1QLRecursion_function1 to get deployed
2022/01/04 13:16:50 Waiting for app: TestN1QLRecursion_function1 to get deployed
2022/01/04 13:16:55 Waiting for app: TestN1QLRecursion_function1 to get deployed
2022/01/04 13:17:00 Waiting for app: TestN1QLRecursion_function1 to get deployed
2022/01/04 13:17:00 App: TestN1QLRecursion_function1 got deployed
2022/01/04 13:17:00 TestN1QLRecursion_function1 is deployed
2022/01/04 13:17:00 Deploying app: TestN1QLRecursion_function3. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:17:01 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 stored in temp store"
}
2022/01/04 13:17:01 response body {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 stored in temp store"
} err 
2022/01/04 13:17:06 Waiting for app: TestN1QLRecursion_function3 to get deployed
2022/01/04 13:17:11 Waiting for app: TestN1QLRecursion_function3 to get deployed
2022/01/04 13:17:16 Waiting for app: TestN1QLRecursion_function3 to get deployed
2022/01/04 13:17:21 Waiting for app: TestN1QLRecursion_function3 to get deployed
2022/01/04 13:17:21 App: TestN1QLRecursion_function3 got deployed
2022/01/04 13:17:21 TestN1QLRecursion_function3 is deployed
2022/01/04 13:17:21 Deploying app: TestN1QLRecursion_function2. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:17:21 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestN1QLRecursion_function2 causes a cycle involving functions: [TestN1QLRecursion_function3 TestN1QLRecursion_function1], hence deployment is disallowed"
}
2022/01/04 13:17:21 response body {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestN1QLRecursion_function2 causes a cycle involving functions: [TestN1QLRecursion_function3 TestN1QLRecursion_function1], hence deployment is disallowed"
} err 
2022/01/04 13:17:21 Success: TestN1QLRecursion_function2 is not deployed
2022/01/04 13:17:26 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2022/01/04 13:17:31 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2022/01/04 13:17:36 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2022/01/04 13:17:41 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2022/01/04 13:17:41 App: TestN1QLRecursion_function1 got un-deployed
2022/01/04 13:17:41 No eventing-con process running
2022/01/04 13:17:41 Function: TestN1QLRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 deleting in background"
}
2022/01/04 13:17:43 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:17:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:17:50 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:17:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:18:00 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2022/01/04 13:18:05 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2022/01/04 13:18:10 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2022/01/04 13:18:15 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2022/01/04 13:18:15 App: TestN1QLRecursion_function3 got un-deployed
2022/01/04 13:18:15 No eventing-con process running
2022/01/04 13:18:15 Function: TestN1QLRecursion_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 deleting in background"
}
2022/01/04 13:18:17 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:18:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:18:24 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:18:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:18:31 Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/04 13:18:36 Rebalance progress: 100
--- PASS: TestN1QLRecursion (145.80s)
=== RUN   TestN1QLAllowRecursion
2022/01/04 13:18:36 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/04 13:18:36 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2022/01/04 13:18:36 Removing node(s): [] from the cluster
2022/01/04 13:18:41 Rebalance progress: 100
2022/01/04 13:18:47 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:18:53 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:18:59 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:19:04 Deploying app: TestN1QLAllowRecursion_function1. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:19:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 stored in temp store"
}
2022/01/04 13:19:05 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 stored in temp store"
} err 
2022/01/04 13:19:10 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2022/01/04 13:19:15 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2022/01/04 13:19:20 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2022/01/04 13:19:25 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2022/01/04 13:19:25 App: TestN1QLAllowRecursion_function1 got deployed
2022/01/04 13:19:25 TestN1QLAllowRecursion_function1 is deployed
2022/01/04 13:19:25 Deploying app: TestN1QLAllowRecursion_function3. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:19:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 stored in temp store"
}
2022/01/04 13:19:26 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 stored in temp store"
} err 
2022/01/04 13:19:31 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2022/01/04 13:19:36 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2022/01/04 13:19:41 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2022/01/04 13:19:46 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2022/01/04 13:19:46 App: TestN1QLAllowRecursion_function3 got deployed
2022/01/04 13:19:46 TestN1QLAllowRecursion_function3 is deployed
2022/01/04 13:19:46 Deploying app: TestN1QLAllowRecursion_function2. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:19:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 stored in temp store"
}
2022/01/04 13:19:47 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 stored in temp store"
} err 
2022/01/04 13:19:52 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2022/01/04 13:19:57 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2022/01/04 13:20:02 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2022/01/04 13:20:07 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2022/01/04 13:20:07 App: TestN1QLAllowRecursion_function2 got deployed
2022/01/04 13:20:07 Success: TestN1QLAllowRecursion_function2 is deployed after allow_interbucket_recursion
2022/01/04 13:20:12 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2022/01/04 13:20:18 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2022/01/04 13:20:23 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2022/01/04 13:20:28 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2022/01/04 13:20:28 App: TestN1QLAllowRecursion_function1 got un-deployed
2022/01/04 13:20:28 No eventing-con process running
2022/01/04 13:20:28 Function: TestN1QLAllowRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 deleting in background"
}
2022/01/04 13:20:29 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:20:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:20:36 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:20:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:20:46 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2022/01/04 13:20:52 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2022/01/04 13:20:57 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2022/01/04 13:21:02 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2022/01/04 13:21:02 App: TestN1QLAllowRecursion_function2 got un-deployed
2022/01/04 13:21:02 No eventing-con process running
2022/01/04 13:21:02 Function: TestN1QLAllowRecursion_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 deleting in background"
}
2022/01/04 13:21:04 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:21:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:21:11 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:21:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:21:21 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2022/01/04 13:21:26 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2022/01/04 13:21:31 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2022/01/04 13:21:36 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2022/01/04 13:21:36 App: TestN1QLAllowRecursion_function3 got un-deployed
2022/01/04 13:21:36 No eventing-con process running
2022/01/04 13:21:36 Function: TestN1QLAllowRecursion_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 deleting in background"
}
2022/01/04 13:21:38 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:21:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:21:45 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:21:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:21:51 Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/04 13:21:56 Rebalance progress: 100
--- PASS: TestN1QLAllowRecursion (200.33s)
=== RUN   TestOnDeleteExpiryBucketOp
2022/01/04 13:21:56 Sleeping for some time
2022/01/04 13:22:06 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2022/01/04 13:22:06 App: TestOnDeleteExpiryBucketOp got un-deployed
2022/01/04 13:22:06 No eventing-con process running
2022/01/04 13:22:06 Function: TestOnDeleteExpiryBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteExpiryBucketOp not found"
}
2022/01/04 13:22:08 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:22:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:22:15 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:22:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:22:20 Deploying app: TestOnDeleteExpiryBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:22:21 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteExpiryBucketOp stored in temp store"
}
2022/01/04 13:22:21 Starting bucket ops to source bucket
2022/01/04 13:23:10 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 13:23:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 13:23:15 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 13:23:15 Starting bucket ops to source bucket
2022/01/04 13:23:16 Starting bucket ops to source bucket
2022/01/04 13:24:22 Waiting for dst bucket item count to get to: 7000 curr count: 5000
2022/01/04 13:24:22 src & dst bucket item count matched up. src bucket count: 7000 dst bucket count: 7000
2022/01/04 13:24:22 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:24:27 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2022/01/04 13:24:32 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2022/01/04 13:24:37 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2022/01/04 13:24:42 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2022/01/04 13:24:42 App: TestOnDeleteExpiryBucketOp got un-deployed
2022/01/04 13:24:42 No eventing-con process running
2022/01/04 13:24:42 Function: TestOnDeleteExpiryBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteExpiryBucketOp deleting in background"
}
2022/01/04 13:24:44 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:24:54 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/04 13:24:59 Waiting for dst bucket item count to get to: 0 curr count: 501
2022/01/04 13:24:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:25:01 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:25:11 Waiting for dst bucket item count to get to: 0 curr count: 6478
2022/01/04 13:25:16 Waiting for dst bucket item count to get to: 0 curr count: 6478
2022/01/04 13:25:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteExpiryBucketOp (199.78s)
=== RUN   TestTimerOverWriteSameReference
2022/01/04 13:25:21 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2022/01/04 13:25:21 App: TestTimerOverWriteSameReference got un-deployed
2022/01/04 13:25:21 No eventing-con process running
2022/01/04 13:25:21 Function: TestTimerOverWriteSameReference delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerOverWriteSameReference not found"
}
2022/01/04 13:25:23 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:25:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:25:29 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:25:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:25:34 Deploying app: TestTimerOverWriteSameReference. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:25:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverWriteSameReference stored in temp store"
}
2022/01/04 13:25:41 Waiting for app: TestTimerOverWriteSameReference to get deployed
2022/01/04 13:25:46 Waiting for app: TestTimerOverWriteSameReference to get deployed
2022/01/04 13:25:51 Waiting for app: TestTimerOverWriteSameReference to get deployed
2022/01/04 13:25:56 Waiting for app: TestTimerOverWriteSameReference to get deployed
2022/01/04 13:25:56 App: TestTimerOverWriteSameReference got deployed
2022/01/04 13:26:06 Starting bucket ops to source bucket
2022/01/04 13:27:07 src & dst bucket item count matched up. src bucket count: 1 dst bucket count: 1
2022/01/04 13:27:17 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:27:22 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2022/01/04 13:27:27 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2022/01/04 13:27:32 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2022/01/04 13:27:37 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2022/01/04 13:27:37 App: TestTimerOverWriteSameReference got un-deployed
2022/01/04 13:27:37 No eventing-con process running
2022/01/04 13:27:37 Function: TestTimerOverWriteSameReference delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverWriteSameReference deleting in background"
}
2022/01/04 13:27:39 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:27:49 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/04 13:27:54 Waiting for dst bucket item count to get to: 0 curr count: 500
2022/01/04 13:27:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:27:56 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:28:06 Waiting for dst bucket item count to get to: 0 curr count: 1
2022/01/04 13:28:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerOverWriteSameReference (169.86s)
=== RUN   TestCancelTimerBucketop
2022/01/04 13:28:11 Waiting for app: TestCancelTimerBucketop to get un-deployed
2022/01/04 13:28:11 App: TestCancelTimerBucketop got un-deployed
2022/01/04 13:28:11 No eventing-con process running
2022/01/04 13:28:11 Function: TestCancelTimerBucketop delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCancelTimerBucketop not found"
}
2022/01/04 13:28:12 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:28:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:28:19 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:28:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:28:24 Deploying app: TestCancelTimerBucketop. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:28:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCancelTimerBucketop stored in temp store"
}
2022/01/04 13:28:30 Waiting for app: TestCancelTimerBucketop to get deployed
2022/01/04 13:28:35 Waiting for app: TestCancelTimerBucketop to get deployed
2022/01/04 13:28:40 Waiting for app: TestCancelTimerBucketop to get deployed
2022/01/04 13:28:45 Waiting for app: TestCancelTimerBucketop to get deployed
2022/01/04 13:28:46 App: TestCancelTimerBucketop got deployed
2022/01/04 13:28:46 Starting bucket ops to source bucket
2022/01/04 13:28:53 Starting bucket ops to source bucket
2022/01/04 13:29:55 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2022/01/04 13:29:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:30:00 Waiting for app: TestCancelTimerBucketop to get un-deployed
2022/01/04 13:30:05 Waiting for app: TestCancelTimerBucketop to get un-deployed
2022/01/04 13:30:10 Waiting for app: TestCancelTimerBucketop to get un-deployed
2022/01/04 13:30:15 Waiting for app: TestCancelTimerBucketop to get un-deployed
2022/01/04 13:30:15 App: TestCancelTimerBucketop got un-deployed
2022/01/04 13:30:15 No eventing-con process running
2022/01/04 13:30:15 Function: TestCancelTimerBucketop delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCancelTimerBucketop deleting in background"
}
2022/01/04 13:30:17 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:30:27 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/04 13:30:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:30:29 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:30:39 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/04 13:30:44 Waiting for dst bucket item count to get to: 0 curr count: 500
2022/01/04 13:30:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCancelTimerBucketop (158.43s)
=== RUN   TestJSExpiryDate
2022/01/04 13:30:49 Starting bucket ops to source bucket
2022/01/04 13:31:02 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 13:31:02 Deploying app: TestJSExpiryDate. Item count src bucket: 5000 dst bucket: 0
2022/01/04 13:31:03 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestJSExpiryDate stored in temp store"
}
2022/01/04 13:31:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:31:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:31:39 Waiting for app: TestJSExpiryDate to get un-deployed
2022/01/04 13:31:44 Waiting for app: TestJSExpiryDate to get un-deployed
2022/01/04 13:31:49 Waiting for app: TestJSExpiryDate to get un-deployed
2022/01/04 13:31:54 Waiting for app: TestJSExpiryDate to get un-deployed
2022/01/04 13:31:54 App: TestJSExpiryDate got un-deployed
2022/01/04 13:31:54 No eventing-con process running
2022/01/04 13:31:54 Function: TestJSExpiryDate delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestJSExpiryDate deleting in background"
}
2022/01/04 13:31:55 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:32:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:32:03 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:32:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestJSExpiryDate (83.71s)
=== RUN   TestBinaryDoc
2022/01/04 13:32:13 Starting bucket ops to source bucket
2022/01/04 13:32:13 Deploying app: TestBinaryDoc. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:32:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBinaryDoc stored in temp store"
}
2022/01/04 13:32:14 Starting bucket ops to source bucket
2022/01/04 13:32:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:32:14 Deleting source bucket docs now
2022/01/04 13:32:14 Starting bucket ops to source bucket
2022/01/04 13:32:51 Waiting for dst bucket item count to get to: 32 curr count: 23
2022/01/04 13:32:56 Waiting for dst bucket item count to get to: 32 curr count: 28
2022/01/04 13:32:56 src & dst bucket item count matched up. src bucket count: 32 dst bucket count: 32
2022/01/04 13:32:56 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:33:01 Waiting for app: TestBinaryDoc to get un-deployed
2022/01/04 13:33:06 Waiting for app: TestBinaryDoc to get un-deployed
2022/01/04 13:33:11 Waiting for app: TestBinaryDoc to get un-deployed
2022/01/04 13:33:16 Waiting for app: TestBinaryDoc to get un-deployed
2022/01/04 13:33:16 App: TestBinaryDoc got un-deployed
2022/01/04 13:33:16 No eventing-con process running
2022/01/04 13:33:16 Function: TestBinaryDoc delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBinaryDoc deleting in background"
}
2022/01/04 13:33:18 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:33:28 Waiting for dst bucket item count to get to: 0 curr count: 24
2022/01/04 13:33:33 Waiting for dst bucket item count to get to: 0 curr count: 6
2022/01/04 13:33:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:33:35 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:33:45 Waiting for dst bucket item count to get to: 0 curr count: 32
2022/01/04 13:33:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBinaryDoc (97.23s)
=== RUN   TestConstantBindings
2022/01/04 13:33:45 Deploying app: TestConstantBindings. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:33:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestConstantBindings stored in temp store"
}
2022/01/04 13:33:46 Starting bucket ops to source bucket
2022/01/04 13:33:52 Waiting for dst bucket item count to get to: 6000 curr count: 0
2022/01/04 13:33:57 Waiting for dst bucket item count to get to: 6000 curr count: 0
2022/01/04 13:34:02 Waiting for dst bucket item count to get to: 6000 curr count: 0
2022/01/04 13:34:07 Waiting for dst bucket item count to get to: 6000 curr count: 1907
2022/01/04 13:34:12 Waiting for dst bucket item count to get to: 6000 curr count: 1907
2022/01/04 13:34:12 src & dst bucket item count matched up. src bucket count: 6000 dst bucket count: 6000
2022/01/04 13:34:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:34:17 Waiting for app: TestConstantBindings to get un-deployed
2022/01/04 13:34:22 Waiting for app: TestConstantBindings to get un-deployed
2022/01/04 13:34:27 Waiting for app: TestConstantBindings to get un-deployed
2022/01/04 13:34:32 Waiting for app: TestConstantBindings to get un-deployed
2022/01/04 13:34:32 App: TestConstantBindings got un-deployed
2022/01/04 13:34:32 No eventing-con process running
2022/01/04 13:34:32 Function: TestConstantBindings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestConstantBindings deleting in background"
}
2022/01/04 13:34:34 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:34:44 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/04 13:34:49 Waiting for dst bucket item count to get to: 0 curr count: 500
2022/01/04 13:34:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:34:51 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:35:01 Waiting for dst bucket item count to get to: 0 curr count: 5435
2022/01/04 13:35:06 Waiting for dst bucket item count to get to: 0 curr count: 5435
2022/01/04 13:35:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestConstantBindings (80.69s)
=== RUN   TestCodeInsight
2022/01/04 13:35:11 Waiting for app: TestCodeInsight to get un-deployed
2022/01/04 13:35:11 App: TestCodeInsight got un-deployed
2022/01/04 13:35:11 No eventing-con process running
2022/01/04 13:35:11 Function: TestCodeInsight delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCodeInsight not found"
}
2022/01/04 13:35:13 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:35:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:35:19 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:35:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:35:24 Starting bucket ops to source bucket
2022/01/04 13:35:25 Deploying app: TestCodeInsight. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:35:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCodeInsight stored in temp store"
}
2022/01/04 13:35:31 Waiting for app: TestCodeInsight to get deployed
2022/01/04 13:35:36 Waiting for app: TestCodeInsight to get deployed
2022/01/04 13:35:41 Waiting for app: TestCodeInsight to get deployed
2022/01/04 13:35:46 Waiting for app: TestCodeInsight to get deployed
2022/01/04 13:35:46 App: TestCodeInsight got deployed
2022/01/04 13:35:51 Waiting for dst bucket item count to get to: 1000 curr count: 302
2022/01/04 13:35:51 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2022/01/04 13:35:56 Waiting for app: TestCodeInsight to get un-deployed
2022/01/04 13:36:02 Waiting for app: TestCodeInsight to get un-deployed
2022/01/04 13:36:07 Waiting for app: TestCodeInsight to get un-deployed
2022/01/04 13:36:12 Waiting for app: TestCodeInsight to get un-deployed
2022/01/04 13:36:12 App: TestCodeInsight got un-deployed
2022/01/04 13:36:12 No eventing-con process running
2022/01/04 13:36:12 Function: TestCodeInsight delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCodeInsight deleting in background"
}
2022/01/04 13:36:13 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:36:23 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/04 13:36:29 Waiting for dst bucket item count to get to: 0 curr count: 500
2022/01/04 13:36:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:36:30 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:36:40 Waiting for dst bucket item count to get to: 0 curr count: 738
2022/01/04 13:36:45 Waiting for dst bucket item count to get to: 0 curr count: 738
2022/01/04 13:36:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCodeInsight (99.54s)
=== RUN   TestParserTransform
--- PASS: TestParserTransform (0.04s)
=== RUN   TestParserDetect
--- PASS: TestParserDetect (0.00s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	13089.194s

Functional tests took 3 hours, 38 minutes and 12 seconds.

N1ql tests

2022/01/04 13:36:53 Started n1ql
Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:44466->127.0.0.1:9000: read: connection reset by peer
Quota setup Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:44466->127.0.0.1:9000: read: connection reset by peer
2022/01/04 13:37:03 Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2022/01/04 13:37:03 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2022/01/04 13:37:03 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 13:37:04 Removing node(s): [] from the cluster
2022/01/04 13:37:09 Rebalance progress: 100
=== RUN   TestRecursiveMutationN1QL
2022/01/04 13:37:14 Waiting for app: TestRecursiveMutationN1QL to get un-deployed
2022/01/04 13:37:14 App: TestRecursiveMutationN1QL got un-deployed
2022/01/04 13:37:14 No eventing-con process running
2022/01/04 13:37:14 Function: TestRecursiveMutationN1QL delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestRecursiveMutationN1QL not found"
}
2022/01/04 13:37:15 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:37:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:37:22 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:37:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:37:27 Deploying app: TestRecursiveMutationN1QL. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:37:27 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Function: TestRecursiveMutationN1QL N1QL DML to source keyspace default:default"
}
--- PASS: TestRecursiveMutationN1QL (18.48s)
=== RUN   TestFlexReset1
2022/01/04 13:37:32 Waiting for app: TestFlexReset1 to get un-deployed
2022/01/04 13:37:32 App: TestFlexReset1 got un-deployed
2022/01/04 13:37:32 No eventing-con process running
2022/01/04 13:37:32 Function: TestFlexReset1 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestFlexReset1 not found"
}
2022/01/04 13:37:34 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:37:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:37:41 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:37:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:37:46 Starting bucket ops to source bucket
2022/01/04 13:37:46 Deploying app: TestFlexReset1. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:37:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset1 stored in temp store"
}
2022/01/04 13:37:53 Waiting for app: TestFlexReset1 to get deployed
2022/01/04 13:37:58 Waiting for app: TestFlexReset1 to get deployed
2022/01/04 13:38:03 Waiting for app: TestFlexReset1 to get deployed
2022/01/04 13:38:08 Waiting for app: TestFlexReset1 to get deployed
2022/01/04 13:38:08 App: TestFlexReset1 got deployed
2022/01/04 13:38:13 Waiting for dst bucket item count to get to: 1000 curr count: 36
2022/01/04 13:38:13 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2022/01/04 13:38:13 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:38:18 Waiting for app: TestFlexReset1 to get un-deployed
2022/01/04 13:38:23 Waiting for app: TestFlexReset1 to get un-deployed
2022/01/04 13:38:28 Waiting for app: TestFlexReset1 to get un-deployed
2022/01/04 13:38:33 Waiting for app: TestFlexReset1 to get un-deployed
2022/01/04 13:38:33 App: TestFlexReset1 got un-deployed
2022/01/04 13:38:33 No eventing-con process running
2022/01/04 13:38:33 Function: TestFlexReset1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset1 deleting in background"
}
2022/01/04 13:38:35 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:38:45 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/04 13:38:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:38:47 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:38:57 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/04 13:38:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestFlexReset1 (89.41s)
=== RUN   TestFlexReset2
2022/01/04 13:39:02 Waiting for app: TestFlexReset2 to get un-deployed
2022/01/04 13:39:02 App: TestFlexReset2 got un-deployed
2022/01/04 13:39:02 No eventing-con process running
2022/01/04 13:39:02 Function: TestFlexReset2 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestFlexReset2 not found"
}
2022/01/04 13:39:03 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:39:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:39:10 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:39:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:39:15 Starting bucket ops to source bucket
2022/01/04 13:39:16 Deploying app: TestFlexReset2. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:39:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset2 stored in temp store"
}
2022/01/04 13:39:22 Waiting for app: TestFlexReset2 to get deployed
2022/01/04 13:39:27 Waiting for app: TestFlexReset2 to get deployed
2022/01/04 13:39:32 Waiting for app: TestFlexReset2 to get deployed
2022/01/04 13:39:37 Waiting for app: TestFlexReset2 to get deployed
2022/01/04 13:39:37 App: TestFlexReset2 got deployed
2022/01/04 13:39:42 Waiting for dst bucket item count to get to: 1000 curr count: 56
2022/01/04 13:39:42 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2022/01/04 13:39:42 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:39:47 Waiting for app: TestFlexReset2 to get un-deployed
2022/01/04 13:39:52 Waiting for app: TestFlexReset2 to get un-deployed
2022/01/04 13:39:57 Waiting for app: TestFlexReset2 to get un-deployed
2022/01/04 13:40:02 Waiting for app: TestFlexReset2 to get un-deployed
2022/01/04 13:40:02 App: TestFlexReset2 got un-deployed
2022/01/04 13:40:02 No eventing-con process running
2022/01/04 13:40:02 Function: TestFlexReset2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset2 deleting in background"
}
2022/01/04 13:40:04 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:40:14 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/04 13:40:19 Waiting for dst bucket item count to get to: 0 curr count: 500
2022/01/04 13:40:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:40:21 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:40:31 Waiting for dst bucket item count to get to: 0 curr count: 936
2022/01/04 13:40:36 Waiting for dst bucket item count to get to: 0 curr count: 936
2022/01/04 13:40:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestFlexReset2 (99.27s)
=== RUN   TestN1QLLabelledBreak
2022/01/04 13:40:41 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2022/01/04 13:40:41 App: TestN1QLLabelledBreak got un-deployed
2022/01/04 13:40:41 No eventing-con process running
2022/01/04 13:40:41 Function: TestN1QLLabelledBreak delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLLabelledBreak not found"
}
2022/01/04 13:40:43 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:40:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:40:49 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:40:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:40:54 Deploying app: TestN1QLLabelledBreak. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:40:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLLabelledBreak stored in temp store"
}
2022/01/04 13:41:01 Waiting for app: TestN1QLLabelledBreak to get deployed
2022/01/04 13:41:06 Waiting for app: TestN1QLLabelledBreak to get deployed
2022/01/04 13:41:11 Waiting for app: TestN1QLLabelledBreak to get deployed
2022/01/04 13:41:16 Waiting for app: TestN1QLLabelledBreak to get deployed
2022/01/04 13:41:16 App: TestN1QLLabelledBreak got deployed
2022/01/04 13:41:16 Starting bucket ops to source bucket
2022/01/04 13:41:25 Waiting for dst bucket item count to get to: 10000 curr count: 0
2022/01/04 13:41:30 Waiting for dst bucket item count to get to: 10000 curr count: 361
2022/01/04 13:41:35 Waiting for dst bucket item count to get to: 10000 curr count: 361
2022/01/04 13:41:40 Waiting for dst bucket item count to get to: 10000 curr count: 3938
2022/01/04 13:41:45 Waiting for dst bucket item count to get to: 10000 curr count: 3938
2022/01/04 13:41:50 Waiting for dst bucket item count to get to: 10000 curr count: 8039
2022/01/04 13:41:55 Waiting for dst bucket item count to get to: 10000 curr count: 8039
2022/01/04 13:41:55 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/04 13:41:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:42:00 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2022/01/04 13:42:05 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2022/01/04 13:42:10 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2022/01/04 13:42:15 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2022/01/04 13:42:15 App: TestN1QLLabelledBreak got un-deployed
2022/01/04 13:42:15 No eventing-con process running
2022/01/04 13:42:15 Function: TestN1QLLabelledBreak delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLLabelledBreak deleting in background"
}
2022/01/04 13:42:17 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:42:27 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 13:42:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:42:29 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:42:39 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/04 13:42:44 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 13:42:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLLabelledBreak (128.17s)
=== RUN   TestN1QLUnlabelledBreak
2022/01/04 13:42:49 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2022/01/04 13:42:49 App: TestN1QLUnlabelledBreak got un-deployed
2022/01/04 13:42:49 No eventing-con process running
2022/01/04 13:42:49 Function: TestN1QLUnlabelledBreak delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLUnlabelledBreak not found"
}
2022/01/04 13:42:51 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:42:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:42:58 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:43:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:43:03 Deploying app: TestN1QLUnlabelledBreak. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:43:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLUnlabelledBreak stored in temp store"
}
2022/01/04 13:43:09 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2022/01/04 13:43:14 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2022/01/04 13:43:19 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2022/01/04 13:43:24 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2022/01/04 13:43:24 App: TestN1QLUnlabelledBreak got deployed
2022/01/04 13:43:24 Starting bucket ops to source bucket
2022/01/04 13:43:33 Waiting for dst bucket item count to get to: 10000 curr count: 363
2022/01/04 13:43:39 Waiting for dst bucket item count to get to: 10000 curr count: 1068
2022/01/04 13:43:44 Waiting for dst bucket item count to get to: 10000 curr count: 3677
2022/01/04 13:43:49 Waiting for dst bucket item count to get to: 10000 curr count: 3677
2022/01/04 13:43:54 Waiting for dst bucket item count to get to: 10000 curr count: 6551
2022/01/04 13:43:59 Waiting for dst bucket item count to get to: 10000 curr count: 8579
2022/01/04 13:43:59 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/04 13:43:59 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:44:04 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2022/01/04 13:44:09 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2022/01/04 13:44:14 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2022/01/04 13:44:19 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2022/01/04 13:44:19 App: TestN1QLUnlabelledBreak got un-deployed
2022/01/04 13:44:19 No eventing-con process running
2022/01/04 13:44:19 Function: TestN1QLUnlabelledBreak delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLUnlabelledBreak deleting in background"
}
2022/01/04 13:44:21 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:44:31 Waiting for dst bucket item count to get to: 0 curr count: 4487
2022/01/04 13:44:36 Waiting for dst bucket item count to get to: 0 curr count: 4487
2022/01/04 13:44:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:44:37 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:44:47 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 13:44:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLUnlabelledBreak (123.38s)
=== RUN   TestN1QLThrowStatement
2022/01/04 13:44:52 Waiting for app: TestN1QLThrowStatement to get un-deployed
2022/01/04 13:44:52 App: TestN1QLThrowStatement got un-deployed
2022/01/04 13:44:52 No eventing-con process running
2022/01/04 13:44:52 Function: TestN1QLThrowStatement delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLThrowStatement not found"
}
2022/01/04 13:44:54 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:44:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:45:01 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:45:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:45:06 Deploying app: TestN1QLThrowStatement. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:45:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLThrowStatement stored in temp store"
}
2022/01/04 13:45:12 Waiting for app: TestN1QLThrowStatement to get deployed
2022/01/04 13:45:17 Waiting for app: TestN1QLThrowStatement to get deployed
2022/01/04 13:45:22 Waiting for app: TestN1QLThrowStatement to get deployed
2022/01/04 13:45:27 Waiting for app: TestN1QLThrowStatement to get deployed
2022/01/04 13:45:27 App: TestN1QLThrowStatement got deployed
2022/01/04 13:45:27 Starting bucket ops to source bucket
2022/01/04 13:45:37 Waiting for dst bucket item count to get to: 10000 curr count: 0
2022/01/04 13:45:42 Waiting for dst bucket item count to get to: 10000 curr count: 125
2022/01/04 13:45:47 Waiting for dst bucket item count to get to: 10000 curr count: 125
2022/01/04 13:45:52 Waiting for dst bucket item count to get to: 10000 curr count: 3232
2022/01/04 13:45:57 Waiting for dst bucket item count to get to: 10000 curr count: 3232
2022/01/04 13:46:02 Waiting for dst bucket item count to get to: 10000 curr count: 7347
2022/01/04 13:46:07 Waiting for dst bucket item count to get to: 10000 curr count: 7347
2022/01/04 13:46:07 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/04 13:46:07 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:46:12 Waiting for app: TestN1QLThrowStatement to get un-deployed
2022/01/04 13:46:17 Waiting for app: TestN1QLThrowStatement to get un-deployed
2022/01/04 13:46:22 Waiting for app: TestN1QLThrowStatement to get un-deployed
2022/01/04 13:46:27 Waiting for app: TestN1QLThrowStatement to get un-deployed
2022/01/04 13:46:27 App: TestN1QLThrowStatement got un-deployed
2022/01/04 13:46:27 No eventing-con process running
2022/01/04 13:46:27 Function: TestN1QLThrowStatement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLThrowStatement deleting in background"
}
2022/01/04 13:46:29 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:46:39 Waiting for dst bucket item count to get to: 0 curr count: 4927
2022/01/04 13:46:44 Waiting for dst bucket item count to get to: 0 curr count: 2427
2022/01/04 13:46:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:46:46 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:46:56 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/04 13:46:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLThrowStatement (128.18s)
=== RUN   TestN1QLNestedForLoop
2022/01/04 13:47:01 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2022/01/04 13:47:01 App: TestN1QLNestedForLoop got un-deployed
2022/01/04 13:47:01 No eventing-con process running
2022/01/04 13:47:01 Function: TestN1QLNestedForLoop delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLNestedForLoop not found"
}
2022/01/04 13:47:02 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:47:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:47:09 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:47:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:47:14 Deploying app: TestN1QLNestedForLoop. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:47:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLNestedForLoop stored in temp store"
}
2022/01/04 13:47:20 Waiting for app: TestN1QLNestedForLoop to get deployed
2022/01/04 13:47:25 Waiting for app: TestN1QLNestedForLoop to get deployed
2022/01/04 13:47:30 Waiting for app: TestN1QLNestedForLoop to get deployed
2022/01/04 13:47:35 Waiting for app: TestN1QLNestedForLoop to get deployed
2022/01/04 13:47:35 App: TestN1QLNestedForLoop got deployed
2022/01/04 13:47:35 Starting bucket ops to source bucket
2022/01/04 13:47:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 13:47:50 Waiting for dst bucket item count to get to: 5000 curr count: 202
2022/01/04 13:47:55 Waiting for dst bucket item count to get to: 5000 curr count: 202
2022/01/04 13:48:00 Waiting for dst bucket item count to get to: 5000 curr count: 2364
2022/01/04 13:48:05 Waiting for dst bucket item count to get to: 5000 curr count: 2364
2022/01/04 13:48:10 Waiting for dst bucket item count to get to: 5000 curr count: 4762
2022/01/04 13:48:15 Waiting for dst bucket item count to get to: 5000 curr count: 4762
2022/01/04 13:48:15 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 13:48:15 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:48:20 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2022/01/04 13:48:25 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2022/01/04 13:48:30 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2022/01/04 13:48:35 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2022/01/04 13:48:35 App: TestN1QLNestedForLoop got un-deployed
2022/01/04 13:48:35 No eventing-con process running
2022/01/04 13:48:35 Function: TestN1QLNestedForLoop delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLNestedForLoop deleting in background"
}
2022/01/04 13:48:37 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:48:47 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 13:48:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:48:49 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:48:59 Waiting for dst bucket item count to get to: 0 curr count: 4368
2022/01/04 13:49:04 Waiting for dst bucket item count to get to: 0 curr count: 1868
2022/01/04 13:49:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLNestedForLoop (127.93s)
=== RUN   TestN1QLAutoClose
2022/01/04 13:49:09 Waiting for app: TestN1QLAutoClose to get un-deployed
2022/01/04 13:49:09 App: TestN1QLAutoClose got un-deployed
2022/01/04 13:49:09 No eventing-con process running
2022/01/04 13:49:09 Function: TestN1QLAutoClose delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLAutoClose not found"
}
2022/01/04 13:49:10 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:49:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:49:17 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:49:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:49:22 Deploying app: TestN1QLAutoClose. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:49:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAutoClose stored in temp store"
}
2022/01/04 13:49:28 Waiting for app: TestN1QLAutoClose to get deployed
2022/01/04 13:49:33 Waiting for app: TestN1QLAutoClose to get deployed
2022/01/04 13:49:38 Waiting for app: TestN1QLAutoClose to get deployed
2022/01/04 13:49:43 Waiting for app: TestN1QLAutoClose to get deployed
2022/01/04 13:49:43 App: TestN1QLAutoClose got deployed
2022/01/04 13:49:43 Starting bucket ops to source bucket
2022/01/04 13:49:49 Waiting for dst bucket item count to get to: 500 curr count: 0
2022/01/04 13:49:54 Waiting for dst bucket item count to get to: 500 curr count: 4
2022/01/04 13:49:59 Waiting for dst bucket item count to get to: 500 curr count: 10
2022/01/04 13:50:04 Waiting for dst bucket item count to get to: 500 curr count: 19
2022/01/04 13:50:09 Waiting for dst bucket item count to get to: 500 curr count: 29
2022/01/04 13:50:14 Waiting for dst bucket item count to get to: 500 curr count: 40
2022/01/04 13:50:19 Waiting for dst bucket item count to get to: 500 curr count: 52
2022/01/04 13:50:24 Waiting for dst bucket item count to get to: 500 curr count: 62
2022/01/04 13:50:29 Waiting for dst bucket item count to get to: 500 curr count: 74
2022/01/04 13:50:34 Waiting for dst bucket item count to get to: 500 curr count: 85
2022/01/04 13:50:39 Waiting for dst bucket item count to get to: 500 curr count: 95
2022/01/04 13:50:44 Waiting for dst bucket item count to get to: 500 curr count: 104
2022/01/04 13:50:49 Waiting for dst bucket item count to get to: 500 curr count: 116
2022/01/04 13:50:54 Waiting for dst bucket item count to get to: 500 curr count: 125
2022/01/04 13:50:59 Waiting for dst bucket item count to get to: 500 curr count: 125
2022/01/04 13:51:04 Waiting for dst bucket item count to get to: 500 curr count: 137
2022/01/04 13:51:09 Waiting for dst bucket item count to get to: 500 curr count: 147
2022/01/04 13:51:14 Waiting for dst bucket item count to get to: 500 curr count: 160
2022/01/04 13:51:19 Waiting for dst bucket item count to get to: 500 curr count: 171
2022/01/04 13:51:24 Waiting for dst bucket item count to get to: 500 curr count: 181
2022/01/04 13:51:29 Waiting for dst bucket item count to get to: 500 curr count: 204
2022/01/04 13:51:34 Waiting for dst bucket item count to get to: 500 curr count: 204
2022/01/04 13:51:39 Waiting for dst bucket item count to get to: 500 curr count: 226
2022/01/04 13:51:44 Waiting for dst bucket item count to get to: 500 curr count: 226
2022/01/04 13:51:49 Waiting for dst bucket item count to get to: 500 curr count: 247
2022/01/04 13:51:54 Waiting for dst bucket item count to get to: 500 curr count: 247
2022/01/04 13:51:59 Waiting for dst bucket item count to get to: 500 curr count: 266
2022/01/04 13:52:04 Waiting for dst bucket item count to get to: 500 curr count: 266
2022/01/04 13:52:09 Waiting for dst bucket item count to get to: 500 curr count: 289
2022/01/04 13:52:14 Waiting for dst bucket item count to get to: 500 curr count: 289
2022/01/04 13:52:19 Waiting for dst bucket item count to get to: 500 curr count: 312
2022/01/04 13:52:24 Waiting for dst bucket item count to get to: 500 curr count: 312
2022/01/04 13:52:29 Waiting for dst bucket item count to get to: 500 curr count: 333
2022/01/04 13:52:34 Waiting for dst bucket item count to get to: 500 curr count: 333
2022/01/04 13:52:39 Waiting for dst bucket item count to get to: 500 curr count: 355
2022/01/04 13:52:44 Waiting for dst bucket item count to get to: 500 curr count: 355
2022/01/04 13:52:49 Waiting for dst bucket item count to get to: 500 curr count: 375
2022/01/04 13:52:54 Waiting for dst bucket item count to get to: 500 curr count: 375
2022/01/04 13:52:59 Waiting for dst bucket item count to get to: 500 curr count: 396
2022/01/04 13:53:04 Waiting for dst bucket item count to get to: 500 curr count: 396
2022/01/04 13:53:09 Waiting for dst bucket item count to get to: 500 curr count: 416
2022/01/04 13:53:14 Waiting for dst bucket item count to get to: 500 curr count: 416
2022/01/04 13:53:19 Waiting for dst bucket item count to get to: 500 curr count: 440
2022/01/04 13:53:24 Waiting for dst bucket item count to get to: 500 curr count: 440
2022/01/04 13:53:29 Waiting for dst bucket item count to get to: 500 curr count: 461
2022/01/04 13:53:34 Waiting for dst bucket item count to get to: 500 curr count: 461
2022/01/04 13:53:39 Waiting for dst bucket item count to get to: 500 curr count: 483
2022/01/04 13:53:44 Waiting for dst bucket item count to get to: 500 curr count: 493
2022/01/04 13:53:44 src & dst bucket item count matched up. src bucket count: 500 dst bucket count: 500
2022/01/04 13:53:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:53:50 Waiting for app: TestN1QLAutoClose to get un-deployed
2022/01/04 13:53:55 Waiting for app: TestN1QLAutoClose to get un-deployed
2022/01/04 13:54:00 Waiting for app: TestN1QLAutoClose to get un-deployed
2022/01/04 13:54:05 Waiting for app: TestN1QLAutoClose to get un-deployed
2022/01/04 13:54:05 App: TestN1QLAutoClose got un-deployed
2022/01/04 13:54:05 No eventing-con process running
2022/01/04 13:54:05 Function: TestN1QLAutoClose delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAutoClose deleting in background"
}
2022/01/04 13:54:06 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:54:16 Waiting for dst bucket item count to get to: 0 curr count: 500
2022/01/04 13:54:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:54:18 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:54:28 Waiting for dst bucket item count to get to: 0 curr count: 374
2022/01/04 13:54:33 Waiting for dst bucket item count to get to: 0 curr count: 124
2022/01/04 13:54:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLAutoClose (329.63s)
=== RUN   TestN1QLPosParams
2022/01/04 13:54:38 Waiting for app: TestN1QLPosParams to get un-deployed
2022/01/04 13:54:38 App: TestN1QLPosParams got un-deployed
2022/01/04 13:54:38 No eventing-con process running
2022/01/04 13:54:38 Function: TestN1QLPosParams delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLPosParams not found"
}
2022/01/04 13:54:40 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:54:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:54:47 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:54:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:54:52 Deploying app: TestN1QLPosParams. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:54:53 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLPosParams stored in temp store"
}
2022/01/04 13:54:58 Waiting for app: TestN1QLPosParams to get deployed
2022/01/04 13:55:03 Waiting for app: TestN1QLPosParams to get deployed
2022/01/04 13:55:08 Waiting for app: TestN1QLPosParams to get deployed
2022/01/04 13:55:13 Waiting for app: TestN1QLPosParams to get deployed
2022/01/04 13:55:13 App: TestN1QLPosParams got deployed
2022/01/04 13:55:13 Starting bucket ops to source bucket
2022/01/04 13:55:23 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/04 13:55:28 Waiting for dst bucket item count to get to: 5000 curr count: 2019
2022/01/04 13:55:33 Waiting for dst bucket item count to get to: 5000 curr count: 3865
2022/01/04 13:55:33 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 13:55:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:55:38 Waiting for app: TestN1QLPosParams to get un-deployed
2022/01/04 13:55:43 Waiting for app: TestN1QLPosParams to get un-deployed
2022/01/04 13:55:48 Waiting for app: TestN1QLPosParams to get un-deployed
2022/01/04 13:55:53 Waiting for app: TestN1QLPosParams to get un-deployed
2022/01/04 13:55:53 App: TestN1QLPosParams got un-deployed
2022/01/04 13:55:53 No eventing-con process running
2022/01/04 13:55:53 Function: TestN1QLPosParams delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLPosParams deleting in background"
}
2022/01/04 13:55:55 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:56:05 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 13:56:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:56:07 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:56:17 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 13:56:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLPosParams (103.38s)
=== RUN   TestN1QLExhaustConnPool
2022/01/04 13:56:22 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2022/01/04 13:56:22 App: TestN1QLExhaustConnPool got un-deployed
2022/01/04 13:56:22 No eventing-con process running
2022/01/04 13:56:22 Function: TestN1QLExhaustConnPool delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLExhaustConnPool not found"
}
2022/01/04 13:56:23 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:56:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:56:30 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:56:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:56:35 Deploying app: TestN1QLExhaustConnPool. Item count src bucket: 0 dst bucket: 0
2022/01/04 13:56:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLExhaustConnPool stored in temp store"
}
2022/01/04 13:56:41 Waiting for app: TestN1QLExhaustConnPool to get deployed
2022/01/04 13:56:46 Waiting for app: TestN1QLExhaustConnPool to get deployed
2022/01/04 13:56:51 Waiting for app: TestN1QLExhaustConnPool to get deployed
2022/01/04 13:56:56 Waiting for app: TestN1QLExhaustConnPool to get deployed
2022/01/04 13:56:56 App: TestN1QLExhaustConnPool got deployed
2022/01/04 13:56:56 Starting bucket ops to source bucket
2022/01/04 13:57:02 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/04 13:57:07 Waiting for dst bucket item count to get to: 100 curr count: 56
2022/01/04 13:57:12 Waiting for dst bucket item count to get to: 100 curr count: 56
2022/01/04 13:57:12 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/04 13:57:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 13:57:17 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2022/01/04 13:57:22 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2022/01/04 13:57:27 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2022/01/04 13:57:32 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2022/01/04 13:57:32 App: TestN1QLExhaustConnPool got un-deployed
2022/01/04 13:57:32 No eventing-con process running
2022/01/04 13:57:32 Function: TestN1QLExhaustConnPool delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLExhaustConnPool deleting in background"
}
2022/01/04 13:57:34 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:57:44 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/04 13:57:49 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/04 13:57:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:57:50 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:58:00 Waiting for dst bucket item count to get to: 0 curr count: 79
2022/01/04 13:58:05 Waiting for dst bucket item count to get to: 0 curr count: 79
2022/01/04 13:58:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLExhaustConnPool (108.80s)
=== RUN   TestN1QLGraceSufficientTimeOut
2022/01/04 13:58:10 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2022/01/04 13:58:10 App: TestN1QLGraceSufficientTimeOut got un-deployed
2022/01/04 13:58:10 No eventing-con process running
2022/01/04 13:58:10 Function: TestN1QLGraceSufficientTimeOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLGraceSufficientTimeOut not found"
}
2022/01/04 13:58:12 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:58:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:58:19 Context: Bucket flush, response code: 200 dump: 
2022/01/04 13:58:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 13:58:24 Starting bucket ops to source bucket
2022/01/04 13:58:41 Starting bucket ops to source bucket
2022/01/04 13:58:58 Deploying app: TestN1QLGraceSufficientTimeOut. Item count src bucket: 30000 dst bucket: 12371
2022/01/04 13:59:00 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLGraceSufficientTimeOut stored in temp store"
}
2022/01/04 13:59:05 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2022/01/04 13:59:10 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2022/01/04 13:59:15 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2022/01/04 13:59:20 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2022/01/04 13:59:20 App: TestN1QLGraceSufficientTimeOut got deployed
2022/01/04 13:59:20 Starting bucket ops to source bucket
2022/01/04 13:59:25 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/04 13:59:30 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/04 13:59:35 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/04 13:59:40 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/04 13:59:45 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/04 13:59:50 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/04 13:59:55 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/04 14:00:00 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/04 14:00:05 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/04 14:00:10 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/04 14:00:15 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/04 14:00:15 src & dst bucket item count matched up. src bucket count: 30001 dst bucket count: 30001
2022/01/04 14:00:15 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 14:00:20 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2022/01/04 14:00:25 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2022/01/04 14:00:30 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2022/01/04 14:00:35 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2022/01/04 14:00:35 App: TestN1QLGraceSufficientTimeOut got un-deployed
2022/01/04 14:00:35 No eventing-con process running
2022/01/04 14:00:35 Function: TestN1QLGraceSufficientTimeOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLGraceSufficientTimeOut deleting in background"
}
2022/01/04 14:00:37 Context: Bucket flush, response code: 200 dump: 
2022/01/04 14:00:47 Waiting for dst bucket item count to get to: 0 curr count: 30000
2022/01/04 14:00:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:00:49 Context: Bucket flush, response code: 200 dump: 
2022/01/04 14:00:59 Waiting for dst bucket item count to get to: 0 curr count: 29304
2022/01/04 14:01:04 Waiting for dst bucket item count to get to: 0 curr count: 14304
2022/01/04 14:01:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLGraceSufficientTimeOut (178.50s)
=== RUN   TestN1QLQueryConsistency
2022/01/04 14:01:09 Waiting for app: n1qlquery_consistency to get un-deployed
2022/01/04 14:01:09 App: n1qlquery_consistency got un-deployed
2022/01/04 14:01:09 No eventing-con process running
2022/01/04 14:01:09 Function: n1qlquery_consistency delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: n1qlquery_consistency not found"
}
2022/01/04 14:01:11 Context: Bucket flush, response code: 200 dump: 
2022/01/04 14:01:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:01:17 Context: Bucket flush, response code: 200 dump: 
2022/01/04 14:01:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:01:22 Starting bucket ops to source bucket
2022/01/04 14:01:25 Deploying app: n1qlquery_consistency. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:01:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: n1qlquery_consistency stored in temp store"
}
2022/01/04 14:01:31 Waiting for app: n1qlquery_consistency to get deployed
2022/01/04 14:01:37 Waiting for app: n1qlquery_consistency to get deployed
2022/01/04 14:01:42 Waiting for app: n1qlquery_consistency to get deployed
2022/01/04 14:01:47 Waiting for app: n1qlquery_consistency to get deployed
2022/01/04 14:01:47 App: n1qlquery_consistency got deployed
2022/01/04 14:01:52 Waiting for dst bucket item count to get to: 5000 curr count: 196
2022/01/04 14:01:57 Waiting for dst bucket item count to get to: 5000 curr count: 2696
2022/01/04 14:01:57 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/04 14:01:57 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/04 14:02:02 Waiting for app: n1qlquery_consistency to get un-deployed
2022/01/04 14:02:07 Waiting for app: n1qlquery_consistency to get un-deployed
2022/01/04 14:02:12 Waiting for app: n1qlquery_consistency to get un-deployed
2022/01/04 14:02:17 Waiting for app: n1qlquery_consistency to get un-deployed
2022/01/04 14:02:17 App: n1qlquery_consistency got un-deployed
2022/01/04 14:02:17 No eventing-con process running
2022/01/04 14:02:17 Function: n1qlquery_consistency delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: n1qlquery_consistency deleting in background"
}
2022/01/04 14:02:19 Context: Bucket flush, response code: 200 dump: 
2022/01/04 14:02:29 Waiting for dst bucket item count to get to: 0 curr count: 4525
2022/01/04 14:02:34 Waiting for dst bucket item count to get to: 0 curr count: 2025
2022/01/04 14:02:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:02:35 Context: Bucket flush, response code: 200 dump: 
2022/01/04 14:02:45 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/04 14:02:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLQueryConsistency (101.52s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	1548.747s

N1ql tests took 0 hours, 25 minutes and 52 seconds.

Starting server
Starting server: attempt 1

Rebalance tests

2022/01/04 14:04:21 Started rebalance
Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:33566->127.0.0.1:9000: read: connection reset by peer
Quota setup Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:33566->127.0.0.1:9000: read: connection reset by peer
=== RUN   TestDuplicateWithEventingRebIn
2022/01/04 14:04:39 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
running apps fetch error json: cannot unmarshal number into Go value of type string
2022/01/04 14:04:44 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/01/04 14:04:44 App: TestDuplicateWithEventingRebIn got un-deployed
2022/01/04 14:04:44 No eventing-con process running
2022/01/04 14:04:44 Function: TestDuplicateWithEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingRebIn not found"
}
2022/01/04 14:04:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:04:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:04:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:04:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:04:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:04:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:05:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:05:03 Deploying app: TestDuplicateWithEventingRebIn. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:05:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebIn stored in temp store"
}
2022/01/04 14:05:09 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2022/01/04 14:05:14 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2022/01/04 14:05:19 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2022/01/04 14:05:24 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2022/01/04 14:05:24 App: TestDuplicateWithEventingRebIn got deployed
2022/01/04 14:05:24 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 14:05:24 Starting bucket ops to source bucket
2022/01/04 14:05:38 Removing node(s): [] from the cluster
2022/01/04 14:05:43 Rebalance progress: 0
2022/01/04 14:05:48 Rebalance progress: 0
2022/01/04 14:05:53 Rebalance progress: 25
2022/01/04 14:05:58 Rebalance progress: 25
2022/01/04 14:06:03 Rebalance progress: 25
2022/01/04 14:06:08 Rebalance progress: 29.83870967741936
2022/01/04 14:06:13 Rebalance progress: 97.58064516129032
2022/01/04 14:06:18 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:06:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:06:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:06:19 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2022/01/04 14:06:19 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 14:06:19 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 14:06:24 Rebalance progress: 25
2022/01/04 14:06:29 Rebalance progress: 25
2022/01/04 14:06:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:06:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:06:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:06:34 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2022/01/04 14:06:34 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 14:06:34 Waiting for src bucket item count to get to: 200000 curr count: 91901
2022/01/04 14:06:39 Waiting for src bucket item count to get to: 200000 curr count: 108579
2022/01/04 14:06:44 Waiting for src bucket item count to get to: 200000 curr count: 108579
2022/01/04 14:06:49 Waiting for src bucket item count to get to: 200000 curr count: 125391
2022/01/04 14:06:54 Waiting for src bucket item count to get to: 200000 curr count: 142510
2022/01/04 14:06:59 Waiting for src bucket item count to get to: 200000 curr count: 142510
2022/01/04 14:07:04 Waiting for src bucket item count to get to: 200000 curr count: 159535
2022/01/04 14:07:09 Waiting for src bucket item count to get to: 200000 curr count: 159535
2022/01/04 14:07:14 Waiting for src bucket item count to get to: 200000 curr count: 176373
2022/01/04 14:07:19 Waiting for src bucket item count to get to: 200000 curr count: 176373
2022/01/04 14:07:24 Waiting for src bucket item count to get to: 200000 curr count: 193111
2022/01/04 14:07:29 Waiting for src bucket item count to get to: 200000 curr count: 193111
2022/01/04 14:07:34 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/04 14:07:34 Post SET ops. Expected item count: 200000 got 200000
2022/01/04 14:07:39 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/01/04 14:07:44 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/01/04 14:07:49 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/01/04 14:07:54 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/01/04 14:07:54 App: TestDuplicateWithEventingRebIn got un-deployed
2022/01/04 14:07:54 No eventing-con process running
2022/01/04 14:07:54 Function: TestDuplicateWithEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebIn deleting in background"
}
2022/01/04 14:07:56 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:08:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:08:06 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/04 14:08:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:08:07 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:08:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:08:17 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/04 14:08:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingRebIn (228.03s)
=== RUN   TestDuplicateWithEventingRebOut
2022/01/04 14:08:22 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 14:08:22 Removing node(s): [] from the cluster
2022/01/04 14:08:28 Rebalance progress: 100
2022/01/04 14:08:33 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/01/04 14:08:33 App: TestDuplicateWithEventingRebOut got un-deployed
2022/01/04 14:08:33 No eventing-con process running
2022/01/04 14:08:33 Function: TestDuplicateWithEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingRebOut not found"
}
2022/01/04 14:08:34 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:08:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:08:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:08:41 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:08:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:08:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:08:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:08:51 Deploying app: TestDuplicateWithEventingRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:08:52 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebOut stored in temp store"
}
2022/01/04 14:08:57 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2022/01/04 14:09:02 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2022/01/04 14:09:07 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2022/01/04 14:09:12 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2022/01/04 14:09:12 App: TestDuplicateWithEventingRebOut got deployed
2022/01/04 14:09:12 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 14:09:12 Starting bucket ops to source bucket
2022/01/04 14:09:17 Rebalance progress: 25
2022/01/04 14:09:22 Rebalance progress: 25
2022/01/04 14:09:27 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:09:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:09:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:09:27 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2022/01/04 14:09:27 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 14:09:27 Waiting for src bucket item count to get to: 200000 curr count: 11550
2022/01/04 14:09:32 Waiting for src bucket item count to get to: 200000 curr count: 28247
2022/01/04 14:09:37 Waiting for src bucket item count to get to: 200000 curr count: 28247
2022/01/04 14:09:42 Waiting for src bucket item count to get to: 200000 curr count: 44773
2022/01/04 14:09:47 Waiting for src bucket item count to get to: 200000 curr count: 44773
2022/01/04 14:09:52 Waiting for src bucket item count to get to: 200000 curr count: 61535
2022/01/04 14:09:57 Waiting for src bucket item count to get to: 200000 curr count: 61535
2022/01/04 14:10:02 Waiting for src bucket item count to get to: 200000 curr count: 61535
2022/01/04 14:10:07 Waiting for src bucket item count to get to: 200000 curr count: 78247
2022/01/04 14:10:12 Waiting for src bucket item count to get to: 200000 curr count: 78247
2022/01/04 14:10:17 Waiting for src bucket item count to get to: 200000 curr count: 94898
2022/01/04 14:10:22 Waiting for src bucket item count to get to: 200000 curr count: 94898
2022/01/04 14:10:27 Waiting for src bucket item count to get to: 200000 curr count: 111362
2022/01/04 14:10:32 Waiting for src bucket item count to get to: 200000 curr count: 111362
2022/01/04 14:10:37 Waiting for src bucket item count to get to: 200000 curr count: 128277
2022/01/04 14:10:42 Waiting for src bucket item count to get to: 200000 curr count: 128277
2022/01/04 14:10:47 Waiting for src bucket item count to get to: 200000 curr count: 144781
2022/01/04 14:10:52 Waiting for src bucket item count to get to: 200000 curr count: 144781
2022/01/04 14:10:57 Waiting for src bucket item count to get to: 200000 curr count: 161409
2022/01/04 14:11:02 Waiting for src bucket item count to get to: 200000 curr count: 161409
2022/01/04 14:11:07 Waiting for src bucket item count to get to: 200000 curr count: 177245
2022/01/04 14:11:12 Waiting for src bucket item count to get to: 200000 curr count: 177245
2022/01/04 14:11:17 Waiting for src bucket item count to get to: 200000 curr count: 193787
2022/01/04 14:11:22 Waiting for src bucket item count to get to: 200000 curr count: 193787
2022/01/04 14:11:27 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/04 14:11:27 Post SET ops. Expected item count: 200000 got 200000
2022/01/04 14:11:32 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/01/04 14:11:37 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/01/04 14:11:42 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/01/04 14:11:47 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/01/04 14:11:47 App: TestDuplicateWithEventingRebOut got un-deployed
2022/01/04 14:11:47 No eventing-con process running
2022/01/04 14:11:48 Function: TestDuplicateWithEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebOut deleting in background"
}
2022/01/04 14:11:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:11:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:11:59 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/04 14:11:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:12:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:12:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:12:11 Waiting for dst bucket item count to get to: 0 curr count: 198798
2022/01/04 14:12:16 Waiting for dst bucket item count to get to: 0 curr count: 198798
2022/01/04 14:12:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingRebOut (238.65s)
=== RUN   TestDuplicateWithEventingSwapReb
2022/01/04 14:12:26 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/01/04 14:12:26 App: TestDuplicateWithEventingSwapReb got un-deployed
2022/01/04 14:12:26 No eventing-con process running
2022/01/04 14:12:26 Function: TestDuplicateWithEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingSwapReb not found"
}
2022/01/04 14:12:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:12:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:12:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:12:34 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:12:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:12:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:12:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:12:44 Deploying app: TestDuplicateWithEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:12:45 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingSwapReb stored in temp store"
}
2022/01/04 14:12:50 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2022/01/04 14:12:55 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2022/01/04 14:13:01 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2022/01/04 14:13:06 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2022/01/04 14:13:06 App: TestDuplicateWithEventingSwapReb got deployed
2022/01/04 14:13:06 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 14:13:06 Starting bucket ops to source bucket
2022/01/04 14:13:06 Removing node(s): [] from the cluster
2022/01/04 14:13:11 Rebalance progress: 25
2022/01/04 14:13:16 Rebalance progress: 25
2022/01/04 14:13:21 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:13:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:13:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:13:21 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2022/01/04 14:13:21 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 14:13:21 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 14:13:28 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 14:13:33 Rebalance progress: 16.66666666666667
2022/01/04 14:13:38 Rebalance progress: 16.66666666666667
2022/01/04 14:13:43 Rebalance progress: 16.66666666666667
2022/01/04 14:13:48 Rebalance progress: 37.15846994535519
2022/01/04 14:13:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:13:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:13:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:13:53 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 14:13:53 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 14:13:58 Rebalance progress: 16.66666666666667
2022/01/04 14:14:03 Rebalance progress: 16.66666666666667
2022/01/04 14:14:08 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:14:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:14:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:14:08 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 14:14:08 Waiting for src bucket item count to get to: 200000 curr count: 81930
2022/01/04 14:14:13 Waiting for src bucket item count to get to: 200000 curr count: 98487
2022/01/04 14:14:18 Waiting for src bucket item count to get to: 200000 curr count: 98487
2022/01/04 14:14:23 Waiting for src bucket item count to get to: 200000 curr count: 115197
2022/01/04 14:14:28 Waiting for src bucket item count to get to: 200000 curr count: 115197
2022/01/04 14:14:33 Waiting for src bucket item count to get to: 200000 curr count: 131899
2022/01/04 14:14:38 Waiting for src bucket item count to get to: 200000 curr count: 131899
2022/01/04 14:14:43 Waiting for src bucket item count to get to: 200000 curr count: 148204
2022/01/04 14:14:48 Waiting for src bucket item count to get to: 200000 curr count: 148204
2022/01/04 14:14:53 Waiting for src bucket item count to get to: 200000 curr count: 164650
2022/01/04 14:14:58 Waiting for src bucket item count to get to: 200000 curr count: 164650
2022/01/04 14:15:03 Waiting for src bucket item count to get to: 200000 curr count: 180685
2022/01/04 14:15:08 Waiting for src bucket item count to get to: 200000 curr count: 180685
2022/01/04 14:15:13 Waiting for src bucket item count to get to: 200000 curr count: 197411
2022/01/04 14:15:18 Waiting for src bucket item count to get to: 200000 curr count: 197411
2022/01/04 14:15:23 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/04 14:15:23 Post SET ops. Expected item count: 200000 got 200000
2022/01/04 14:15:28 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/01/04 14:15:34 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/01/04 14:15:39 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/01/04 14:15:44 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/01/04 14:15:44 App: TestDuplicateWithEventingSwapReb got un-deployed
2022/01/04 14:15:44 No eventing-con process running
2022/01/04 14:15:44 Function: TestDuplicateWithEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingSwapReb deleting in background"
}
2022/01/04 14:15:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:15:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:15:55 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/04 14:15:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:15:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:16:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:16:07 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/04 14:16:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingSwapReb (231.13s)
=== RUN   TestDuplicateWithKVRebIn
2022/01/04 14:16:17 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/01/04 14:16:17 App: TestDuplicateWithKVRebIn got un-deployed
2022/01/04 14:16:17 No eventing-con process running
2022/01/04 14:16:17 Function: TestDuplicateWithKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVRebIn not found"
}
2022/01/04 14:16:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:16:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:16:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:16:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:16:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:16:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:16:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:16:36 Deploying app: TestDuplicateWithKVRebIn. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:16:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebIn stored in temp store"
}
2022/01/04 14:16:42 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2022/01/04 14:16:47 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2022/01/04 14:16:52 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2022/01/04 14:16:57 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2022/01/04 14:16:57 App: TestDuplicateWithKVRebIn got deployed
2022/01/04 14:16:57 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 14:16:57 Starting bucket ops to source bucket
2022/01/04 14:16:57 Removing node(s): [] from the cluster
2022/01/04 14:17:02 Rebalance progress: 16.66666666666667
2022/01/04 14:17:07 Rebalance progress: 16.66666666666667
2022/01/04 14:17:12 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:17:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:17:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:17:12 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 14:17:12 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 14:17:17 Rebalance progress: 16.66666666666667
2022/01/04 14:17:22 Rebalance progress: 16.66666666666667
2022/01/04 14:17:27 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:17:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:17:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:17:27 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 14:17:27 Waiting for src bucket item count to get to: 200000 curr count: 36074
2022/01/04 14:17:32 Waiting for src bucket item count to get to: 200000 curr count: 52725
2022/01/04 14:17:37 Waiting for src bucket item count to get to: 200000 curr count: 52725
2022/01/04 14:17:42 Waiting for src bucket item count to get to: 200000 curr count: 69589
2022/01/04 14:17:47 Waiting for src bucket item count to get to: 200000 curr count: 69589
2022/01/04 14:17:52 Waiting for src bucket item count to get to: 200000 curr count: 85358
2022/01/04 14:17:57 Waiting for src bucket item count to get to: 200000 curr count: 85358
2022/01/04 14:18:02 Waiting for src bucket item count to get to: 200000 curr count: 102010
2022/01/04 14:18:07 Waiting for src bucket item count to get to: 200000 curr count: 102010
2022/01/04 14:18:12 Waiting for src bucket item count to get to: 200000 curr count: 118698
2022/01/04 14:18:17 Waiting for src bucket item count to get to: 200000 curr count: 118698
2022/01/04 14:18:22 Waiting for src bucket item count to get to: 200000 curr count: 118698
2022/01/04 14:18:27 Waiting for src bucket item count to get to: 200000 curr count: 135504
2022/01/04 14:18:32 Waiting for src bucket item count to get to: 200000 curr count: 135504
2022/01/04 14:18:37 Waiting for src bucket item count to get to: 200000 curr count: 152353
2022/01/04 14:18:42 Waiting for src bucket item count to get to: 200000 curr count: 152353
2022/01/04 14:18:47 Waiting for src bucket item count to get to: 200000 curr count: 169096
2022/01/04 14:18:52 Waiting for src bucket item count to get to: 200000 curr count: 169096
2022/01/04 14:18:57 Waiting for src bucket item count to get to: 200000 curr count: 184718
2022/01/04 14:19:02 Waiting for src bucket item count to get to: 200000 curr count: 184718
2022/01/04 14:19:07 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/04 14:19:07 Post SET ops. Expected item count: 200000 got 200000
2022/01/04 14:19:12 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/01/04 14:19:18 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/01/04 14:19:23 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/01/04 14:19:28 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/01/04 14:19:28 App: TestDuplicateWithKVRebIn got un-deployed
2022/01/04 14:19:28 No eventing-con process running
2022/01/04 14:19:28 Function: TestDuplicateWithKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebIn deleting in background"
}
2022/01/04 14:19:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:19:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:19:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:19:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:19:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:19:46 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/04 14:19:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVRebIn (218.97s)
=== RUN   TestDuplicateWithKVRebOut
2022/01/04 14:19:51 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 14:19:51 Removing node(s): [] from the cluster
2022/01/04 14:19:56 Rebalance progress: 100
2022/01/04 14:20:01 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/01/04 14:20:01 App: TestDuplicateWithKVRebOut got un-deployed
2022/01/04 14:20:01 No eventing-con process running
2022/01/04 14:20:01 Function: TestDuplicateWithKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVRebOut not found"
}
2022/01/04 14:20:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:20:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:20:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:20:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:20:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:20:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:20:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:20:20 Deploying app: TestDuplicateWithKVRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:20:21 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebOut stored in temp store"
}
2022/01/04 14:20:26 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2022/01/04 14:20:31 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2022/01/04 14:20:36 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2022/01/04 14:20:41 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2022/01/04 14:20:41 App: TestDuplicateWithKVRebOut got deployed
2022/01/04 14:20:41 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 14:20:41 Starting bucket ops to source bucket
2022/01/04 14:20:46 Rebalance progress: 16.66666666666667
2022/01/04 14:20:51 Rebalance progress: 16.66666666666667
2022/01/04 14:20:56 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:20:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:20:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:20:56 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 14:20:56 Waiting for src bucket item count to get to: 200000 curr count: 13150
2022/01/04 14:21:01 Waiting for src bucket item count to get to: 200000 curr count: 29598
2022/01/04 14:21:06 Waiting for src bucket item count to get to: 200000 curr count: 29598
2022/01/04 14:21:11 Waiting for src bucket item count to get to: 200000 curr count: 46388
2022/01/04 14:21:16 Waiting for src bucket item count to get to: 200000 curr count: 46388
2022/01/04 14:21:21 Waiting for src bucket item count to get to: 200000 curr count: 63311
2022/01/04 14:21:26 Waiting for src bucket item count to get to: 200000 curr count: 63311
2022/01/04 14:21:31 Waiting for src bucket item count to get to: 200000 curr count: 63311
2022/01/04 14:21:36 Waiting for src bucket item count to get to: 200000 curr count: 79117
2022/01/04 14:21:41 Waiting for src bucket item count to get to: 200000 curr count: 79117
2022/01/04 14:21:46 Waiting for src bucket item count to get to: 200000 curr count: 95337
2022/01/04 14:21:51 Waiting for src bucket item count to get to: 200000 curr count: 95337
2022/01/04 14:21:56 Waiting for src bucket item count to get to: 200000 curr count: 111934
2022/01/04 14:22:01 Waiting for src bucket item count to get to: 200000 curr count: 111934
2022/01/04 14:22:06 Waiting for src bucket item count to get to: 200000 curr count: 128147
2022/01/04 14:22:11 Waiting for src bucket item count to get to: 200000 curr count: 128147
2022/01/04 14:22:16 Waiting for src bucket item count to get to: 200000 curr count: 144464
2022/01/04 14:22:21 Waiting for src bucket item count to get to: 200000 curr count: 144464
2022/01/04 14:22:26 Waiting for src bucket item count to get to: 200000 curr count: 161253
2022/01/04 14:22:31 Waiting for src bucket item count to get to: 200000 curr count: 161253
2022/01/04 14:22:36 Waiting for src bucket item count to get to: 200000 curr count: 177231
2022/01/04 14:22:41 Waiting for src bucket item count to get to: 200000 curr count: 177231
2022/01/04 14:22:46 Waiting for src bucket item count to get to: 200000 curr count: 193497
2022/01/04 14:22:51 Waiting for src bucket item count to get to: 200000 curr count: 193497
2022/01/04 14:22:56 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/04 14:22:56 Post SET ops. Expected item count: 200000 got 200000
2022/01/04 14:23:01 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/01/04 14:23:06 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/01/04 14:23:11 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/01/04 14:23:16 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/01/04 14:23:16 App: TestDuplicateWithKVRebOut got un-deployed
2022/01/04 14:23:16 No eventing-con process running
2022/01/04 14:23:16 Function: TestDuplicateWithKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebOut deleting in background"
}
2022/01/04 14:23:18 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:23:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:23:28 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/04 14:23:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:23:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:23:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:23:40 Waiting for dst bucket item count to get to: 0 curr count: 4916
2022/01/04 14:23:45 Waiting for dst bucket item count to get to: 0 curr count: 4916
2022/01/04 14:23:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVRebOut (238.89s)
=== RUN   TestDuplicateWithKVSwapReb
2022/01/04 14:23:55 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2022/01/04 14:23:55 App: TestDuplicateWithKVSwapReb got un-deployed
2022/01/04 14:23:55 No eventing-con process running
2022/01/04 14:23:55 Function: TestDuplicateWithKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVSwapReb not found"
}
2022/01/04 14:23:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:24:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:24:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:24:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:24:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:24:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:24:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:24:13 Deploying app: TestDuplicateWithKVSwapReb. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:24:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVSwapReb stored in temp store"
}
2022/01/04 14:24:20 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2022/01/04 14:24:25 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2022/01/04 14:24:30 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2022/01/04 14:24:35 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2022/01/04 14:24:35 App: TestDuplicateWithKVSwapReb got deployed
2022/01/04 14:24:35 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 14:24:35 Starting bucket ops to source bucket
2022/01/04 14:24:35 Removing node(s): [] from the cluster
2022/01/04 14:24:40 Rebalance progress: 16.66666666666667
2022/01/04 14:24:45 Rebalance progress: 16.66666666666667
2022/01/04 14:24:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:24:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:24:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:24:50 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 14:24:50 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/04 14:24:51 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 14:24:56 Rebalance progress: 16.66666666666667
2022/01/04 14:25:01 Rebalance progress: 16.66666666666667
2022/01/04 14:25:06 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:25:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:25:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:25:06 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 14:25:06 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 14:25:11 Rebalance progress: 16.66666666666667
2022/01/04 14:25:16 Rebalance progress: 16.66666666666667
2022/01/04 14:25:21 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:25:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:25:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:25:21 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 14:25:21 Waiting for src bucket item count to get to: 200000 curr count: 69949
2022/01/04 14:25:26 Waiting for src bucket item count to get to: 200000 curr count: 69949
2022/01/04 14:25:31 Waiting for src bucket item count to get to: 200000 curr count: 85021
2022/01/04 14:25:36 Waiting for src bucket item count to get to: 200000 curr count: 85021
2022/01/04 14:25:41 Waiting for src bucket item count to get to: 200000 curr count: 101278
2022/01/04 14:25:46 Waiting for src bucket item count to get to: 200000 curr count: 101278
2022/01/04 14:25:51 Waiting for src bucket item count to get to: 200000 curr count: 117776
2022/01/04 14:25:56 Waiting for src bucket item count to get to: 200000 curr count: 117776
2022/01/04 14:26:01 Waiting for src bucket item count to get to: 200000 curr count: 134354
2022/01/04 14:26:06 Waiting for src bucket item count to get to: 200000 curr count: 134354
2022/01/04 14:26:11 Waiting for src bucket item count to get to: 200000 curr count: 151210
2022/01/04 14:26:16 Waiting for src bucket item count to get to: 200000 curr count: 151210
2022/01/04 14:26:21 Waiting for src bucket item count to get to: 200000 curr count: 167827
2022/01/04 14:26:26 Waiting for src bucket item count to get to: 200000 curr count: 167827
2022/01/04 14:26:31 Waiting for src bucket item count to get to: 200000 curr count: 183693
2022/01/04 14:26:36 Waiting for src bucket item count to get to: 200000 curr count: 183693
2022/01/04 14:26:41 Waiting for src bucket item count to get to: 200000 curr count: 183693
2022/01/04 14:26:46 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/04 14:26:46 Post SET ops. Expected item count: 200000 got 200000
2022/01/04 14:26:51 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2022/01/04 14:26:56 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2022/01/04 14:27:01 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2022/01/04 14:27:06 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2022/01/04 14:27:06 App: TestDuplicateWithKVSwapReb got un-deployed
2022/01/04 14:27:06 No eventing-con process running
2022/01/04 14:27:06 Function: TestDuplicateWithKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVSwapReb deleting in background"
}
2022/01/04 14:27:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:27:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:27:18 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/04 14:27:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:27:20 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:27:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:27:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVSwapReb (219.70s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpOneByOne
2022/01/04 14:27:35 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/04 14:27:35 App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/01/04 14:27:35 No eventing-con process running
2022/01/04 14:27:35 Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne not found"
}
2022/01/04 14:27:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:27:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:27:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:27:43 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:27:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:27:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:27:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:27:53 Deploying app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:27:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2022/01/04 14:27:59 Starting bucket ops to source bucket
2022/01/04 14:28:04 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/04 14:28:09 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/04 14:28:14 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/04 14:28:14 App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:28:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:28:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:28:14 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 14:28:14 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 14:28:15 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:28:20 Rebalance progress: 16.66666666666667
2022/01/04 14:28:25 Rebalance progress: 16.66666666666667
2022/01/04 14:28:30 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:28:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:28:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:28:30 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 14:28:30 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 14:28:30 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:28:35 Rebalance progress: 16.66666666666667
2022/01/04 14:28:40 Rebalance progress: 16.66666666666667
2022/01/04 14:28:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:28:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:28:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:28:45 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/04 14:28:45 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/04 14:28:51 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:28:56 Rebalance progress: 12.5
2022/01/04 14:29:01 Rebalance progress: 12.5
2022/01/04 14:29:06 Rebalance progress: 12.5
2022/01/04 14:29:11 Rebalance progress: 28.54166666666666
2022/01/04 14:29:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:29:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:29:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:29:16 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 14:29:21 Rebalance progress: 12.5
2022/01/04 14:29:26 Rebalance progress: 12.5
2022/01/04 14:29:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:29:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:29:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:29:31 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 14:29:36 Rebalance progress: 12.5
2022/01/04 14:29:41 Rebalance progress: 12.5
2022/01/04 14:29:46 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:29:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:29:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:29:46 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/04 14:29:51 Rebalance progress: 12.5
2022/01/04 14:29:56 Rebalance progress: 12.5
2022/01/04 14:30:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:30:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:30:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:30:06 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/04 14:30:11 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/04 14:30:16 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/04 14:30:21 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/04 14:30:21 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/01/04 14:30:21 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:30:22 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2022/01/04 14:30:23 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:30:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:30:33 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12169
2022/01/04 14:30:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12169
2022/01/04 14:30:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:30:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:30:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:30:50 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1116
2022/01/04 14:30:55 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1116
2022/01/04 14:30:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpOneByOne (210.35s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce
2022/01/04 14:31:05 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/01/04 14:31:05 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got un-deployed
2022/01/04 14:31:05 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:31:05 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce not found"
}
2022/01/04 14:31:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:31:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:31:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:31:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:31:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:31:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:31:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:31:23 eventingSetup.go:125: Deploying app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:31:25 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce stored in temp store"
}
2022/01/04 14:31:30 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 14:31:35 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2022/01/04 14:31:40 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2022/01/04 14:31:45 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2022/01/04 14:31:45 clusterSetup.go:354: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:31:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:31:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:31:45 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 14:31:45 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 14:31:45 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/04 14:31:46 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:31:51 Rebalance progress: 12.5
2022/01/04 14:31:56 Rebalance progress: 12.5
2022/01/04 14:32:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:32:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:32:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:32:01 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2022/01/04 14:32:06 Rebalance progress: 12.5
2022/01/04 14:32:11 Rebalance progress: 12.5
2022/01/04 14:32:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:32:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:32:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:32:21 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/01/04 14:32:26 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/01/04 14:32:31 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/01/04 14:32:36 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/01/04 14:32:36 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got un-deployed
2022/01/04 14:32:36 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:32:36 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce deleting in background"
}
2022/01/04 14:32:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:32:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:32:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4600
2022/01/04 14:32:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:32:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:32:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:32:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce (119.52s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings
2022/01/04 14:33:05 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/04 14:33:05 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got un-deployed
2022/01/04 14:33:05 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:33:05 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings not found"
}
2022/01/04 14:33:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:33:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:33:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:33:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:33:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:33:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:33:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:33:23 eventingSetup.go:125: Deploying app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:33:24 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings stored in temp store"
}
2022/01/04 14:33:29 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 14:33:34 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2022/01/04 14:33:39 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2022/01/04 14:33:44 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2022/01/04 14:33:44 clusterSetup.go:354: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:33:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:33:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:33:44 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 14:33:45 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:33:50 Rebalance progress: 12.5
2022/01/04 14:33:55 Rebalance progress: 12.5
2022/01/04 14:34:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:34:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:34:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:34:00 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 14:34:00 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:34:05 Rebalance progress: 12.5
2022/01/04 14:34:10 Rebalance progress: 12.5
2022/01/04 14:34:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:34:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:34:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:34:15 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/04 14:34:16 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:34:21 Rebalance progress: 12.5
2022/01/04 14:34:26 Rebalance progress: 12.5
2022/01/04 14:34:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:34:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:34:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:34:31 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 14:34:36 Rebalance progress: 12.5
2022/01/04 14:34:41 Rebalance progress: 12.5
2022/01/04 14:34:46 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:34:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:34:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:34:46 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 14:34:51 Rebalance progress: 12.5
2022/01/04 14:34:56 Rebalance progress: 12.5
2022/01/04 14:35:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:35:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:35:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:35:01 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/04 14:35:06 Rebalance progress: 12.5
2022/01/04 14:35:11 Rebalance progress: 12.5
2022/01/04 14:35:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:35:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:35:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:35:22 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/04 14:35:27 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/04 14:35:32 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/04 14:35:37 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/04 14:35:37 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got un-deployed
2022/01/04 14:35:37 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:35:37 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings deleting in background"
}
2022/01/04 14:35:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:35:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:35:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10716
2022/01/04 14:35:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:35:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:35:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:36:00 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3046
2022/01/04 14:36:05 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3046
2022/01/04 14:36:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings (190.67s)
=== RUN   TestEventingSwapRebOnUpdateBucketOp
2022/01/04 14:36:15 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/01/04 14:36:15 clusterSetup.go:405: App: TestEventingSwapRebOnUpdateBucketOp got un-deployed
2022/01/04 14:36:15 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:36:15 eventingSetup.go:418: Function: TestEventingSwapRebOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebOnUpdateBucketOp not found"
}
2022/01/04 14:36:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:36:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:36:22 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:36:24 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:36:29 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:36:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:36:29 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:36:29 eventingSetup.go:125: Deploying app: TestEventingSwapRebOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:36:30 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebOnUpdateBucketOp stored in temp store"
}
2022/01/04 14:36:35 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 14:36:40 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2022/01/04 14:36:45 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2022/01/04 14:36:50 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2022/01/04 14:36:50 clusterSetup.go:354: App: TestEventingSwapRebOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:36:50 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:36:50 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:36:50 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 14:36:50 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:36:55 Rebalance progress: 12.5
2022/01/04 14:37:00 Rebalance progress: 12.5
2022/01/04 14:37:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:37:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:37:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:37:05 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 14:37:06 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 14:37:11 Rebalance progress: 12.5
2022/01/04 14:37:16 Rebalance progress: 12.5
2022/01/04 14:37:21 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:37:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:37:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:37:21 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 14:37:26 Rebalance progress: 12.5
2022/01/04 14:37:31 Rebalance progress: 12.5
2022/01/04 14:37:36 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:37:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:37:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:37:41 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/01/04 14:37:46 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/01/04 14:37:51 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/01/04 14:37:56 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/01/04 14:37:56 clusterSetup.go:405: App: TestEventingSwapRebOnUpdateBucketOp got un-deployed
2022/01/04 14:37:56 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:37:56 eventingSetup.go:418: Function: TestEventingSwapRebOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebOnUpdateBucketOp deleting in background"
}
2022/01/04 14:37:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:38:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:38:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6091
2022/01/04 14:38:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:38:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:38:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:38:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebOnUpdateBucketOp (129.44s)
=== RUN   TestMetaRollbackWithEventingReb
2022/01/04 14:38:20 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 14:38:20 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:38:26 Rebalance progress: 100
2022/01/04 14:38:31 Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/01/04 14:38:31 App: TestMetaRollbackWithEventingReb got un-deployed
2022/01/04 14:38:31 No eventing-con process running
2022/01/04 14:38:31 Function: TestMetaRollbackWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaRollbackWithEventingReb not found"
}
2022/01/04 14:38:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:38:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:38:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:38:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:38:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:38:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:38:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:38:44 Deploying app: TestMetaRollbackWithEventingReb. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:38:45 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaRollbackWithEventingReb stored in temp store"
}
2022/01/04 14:38:50 Starting bucket ops to source bucket
2022/01/04 14:38:55 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2022/01/04 14:39:00 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2022/01/04 14:39:05 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2022/01/04 14:39:05 App: TestMetaRollbackWithEventingReb got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:39:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:39:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:39:05 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 14:39:06 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:39:11 Rebalance progress: 12.5
2022/01/04 14:39:16 Rebalance progress: 12.5
2022/01/04 14:39:21 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:39:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:39:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:39:21 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2022/01/04 14:39:21 bucketOps.go:134: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2022/01/04 14:39:26 Rebalance progress: 12.5
2022/01/04 14:39:31 Rebalance progress: 12.5
2022/01/04 14:39:36 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:39:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:39:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:39:41 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/01/04 14:39:46 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/01/04 14:39:51 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/01/04 14:39:56 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/01/04 14:39:56 clusterSetup.go:405: App: TestMetaRollbackWithEventingReb got un-deployed
2022/01/04 14:39:56 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:39:56 eventingSetup.go:418: Function: TestMetaRollbackWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaRollbackWithEventingReb deleting in background"
}
2022/01/04 14:39:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:40:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:40:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4552
2022/01/04 14:40:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:40:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:40:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:40:14 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaRollbackWithEventingReb (119.86s)
=== RUN   TestMetaPartialRollbackWithEventingReb
2022/01/04 14:40:19 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 14:40:20 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:40:25 Rebalance progress: 100
2022/01/04 14:40:30 Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/01/04 14:40:30 App: TestMetaPartialRollbackWithEventingReb got un-deployed
2022/01/04 14:40:30 No eventing-con process running
2022/01/04 14:40:30 Function: TestMetaPartialRollbackWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaPartialRollbackWithEventingReb not found"
}
2022/01/04 14:40:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:40:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:40:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:40:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:40:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:40:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:40:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:40:44 Deploying app: TestMetaPartialRollbackWithEventingReb. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:40:45 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaPartialRollbackWithEventingReb stored in temp store"
}
2022/01/04 14:40:50 Starting bucket ops to source bucket
2022/01/04 14:40:55 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2022/01/04 14:41:00 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2022/01/04 14:41:05 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2022/01/04 14:41:05 App: TestMetaPartialRollbackWithEventingReb got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:41:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:41:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:41:05 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 14:41:05 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:41:10 Rebalance progress: 12.5
2022/01/04 14:41:15 Rebalance progress: 12.5
2022/01/04 14:41:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:41:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:41:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:41:20 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2022/01/04 14:41:20 bucketOps.go:65: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaPartialRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2022/01/04 14:41:25 Rebalance progress: 12.5
2022/01/04 14:41:30 Rebalance progress: 12.5
2022/01/04 14:41:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:41:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:41:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:41:35 bucketOps.go:65: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaPartialRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2022/01/04 14:41:41 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/01/04 14:41:46 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/01/04 14:41:51 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/01/04 14:41:56 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/01/04 14:41:56 clusterSetup.go:405: App: TestMetaPartialRollbackWithEventingReb got un-deployed
2022/01/04 14:41:56 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:41:56 eventingSetup.go:418: Function: TestMetaPartialRollbackWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaPartialRollbackWithEventingReb deleting in background"
}
2022/01/04 14:41:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:42:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:42:07 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 38218
2022/01/04 14:42:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:42:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:42:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:42:19 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 38218
2022/01/04 14:42:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaPartialRollbackWithEventingReb (124.74s)
=== RUN   TestEventingRebMultipleHandlersOneByOne
2022/01/04 14:42:29 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/01/04 14:42:29 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got un-deployed
2022/01/04 14:42:29 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:42:29 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op not found"
}
2022/01/04 14:42:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:42:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:42:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:42:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:42:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:42:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:42:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:42:48 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:42:49 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:42:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:42:49 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:42:50 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update stored in temp store"
}
2022/01/04 14:42:55 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 14:43:00 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2022/01/04 14:43:05 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2022/01/04 14:43:10 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2022/01/04 14:43:10 clusterSetup.go:354: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got deployed
2022/01/04 14:43:15 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2022/01/04 14:43:20 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2022/01/04 14:43:25 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2022/01/04 14:43:25 clusterSetup.go:354: App: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:43:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:43:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:43:25 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 14:43:25 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:43:30 Rebalance progress: 12.5
2022/01/04 14:43:35 Rebalance progress: 12.5
2022/01/04 14:43:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:43:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:43:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:43:40 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 14:43:41 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:43:46 Rebalance progress: 12.5
2022/01/04 14:43:51 Rebalance progress: 12.5
2022/01/04 14:43:56 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:43:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:43:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:43:56 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/04 14:43:56 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:44:01 Rebalance progress: 12.5
2022/01/04 14:44:06 Rebalance progress: 12.5
2022/01/04 14:44:11 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:44:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:44:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:44:11 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 14:44:16 Rebalance progress: 12.5
2022/01/04 14:44:21 Rebalance progress: 12.5
2022/01/04 14:44:26 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:44:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:44:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:44:26 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 14:44:31 Rebalance progress: 12.5
2022/01/04 14:44:36 Rebalance progress: 12.5
2022/01/04 14:44:41 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:44:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:44:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:44:42 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/04 14:44:47 Rebalance progress: 12.5
2022/01/04 14:44:52 Rebalance progress: 12.5
2022/01/04 14:44:57 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:44:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:44:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:45:02 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/01/04 14:45:07 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/01/04 14:45:12 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/01/04 14:45:17 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/01/04 14:45:17 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got un-deployed
2022/01/04 14:45:17 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:45:17 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op deleting in background"
}
2022/01/04 14:45:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:45:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:45:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:45:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:45:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:45:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12156
2022/01/04 14:45:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:45:42 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2022/01/04 14:45:47 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2022/01/04 14:45:52 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2022/01/04 14:45:57 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2022/01/04 14:45:57 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update got un-deployed
2022/01/04 14:45:57 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:45:57 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update deleting in background"
}
2022/01/04 14:45:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:46:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:46:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:46:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:46:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:46:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultipleHandlersOneByOne (231.17s)
=== RUN   TestEventingRebMultipleHandlersAllAtOnce
2022/01/04 14:46:20 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2022/01/04 14:46:20 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got un-deployed
2022/01/04 14:46:20 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:46:20 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op not found"
}
2022/01/04 14:46:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:46:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:46:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:46:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:46:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:46:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:46:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:46:39 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:46:40 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:46:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:46:40 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:46:41 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update stored in temp store"
}
2022/01/04 14:46:46 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 14:46:51 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2022/01/04 14:46:56 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2022/01/04 14:47:01 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2022/01/04 14:47:01 clusterSetup.go:354: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got deployed
2022/01/04 14:47:06 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2022/01/04 14:47:11 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2022/01/04 14:47:16 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2022/01/04 14:47:16 clusterSetup.go:354: App: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:47:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:47:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:47:16 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 14:47:17 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 14:47:17 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/04 14:47:18 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:47:23 Rebalance progress: 12.5
2022/01/04 14:47:28 Rebalance progress: 12.5
2022/01/04 14:47:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:47:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:47:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:47:33 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2022/01/04 14:47:38 Rebalance progress: 12.5
2022/01/04 14:47:43 Rebalance progress: 12.5
2022/01/04 14:47:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:47:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:47:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:47:54 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2022/01/04 14:47:59 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2022/01/04 14:48:04 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2022/01/04 14:48:09 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2022/01/04 14:48:09 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got un-deployed
2022/01/04 14:48:09 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:48:09 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op deleting in background"
}
2022/01/04 14:48:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:48:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:48:23 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4907
2022/01/04 14:48:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4907
2022/01/04 14:48:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:48:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:48:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:48:40 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1434
2022/01/04 14:48:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1434
2022/01/04 14:48:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:48:50 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2022/01/04 14:48:55 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2022/01/04 14:49:00 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2022/01/04 14:49:05 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2022/01/04 14:49:05 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update got un-deployed
2022/01/04 14:49:05 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:49:05 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update deleting in background"
}
2022/01/04 14:49:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:49:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:49:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:49:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:49:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:49:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultipleHandlersAllAtOnce (188.63s)
=== RUN   TestEventingSwapRebMultipleHandlers
2022/01/04 14:49:29 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/01/04 14:49:29 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got un-deployed
2022/01/04 14:49:29 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:49:29 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update not found"
}
2022/01/04 14:49:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:49:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:49:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:49:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:49:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:49:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:49:48 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/01/04 14:49:48 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got un-deployed
2022/01/04 14:49:48 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:49:48 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op not found"
}
2022/01/04 14:49:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:49:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:49:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:49:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:50:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:50:01 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:50:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:50:01 eventingSetup.go:125: Deploying app: TestEventingSwapRebMultipleHandlersbucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:50:02 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:50:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:50:02 eventingSetup.go:125: Deploying app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:50:03 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op stored in temp store"
}
2022/01/04 14:50:08 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 14:50:13 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2022/01/04 14:50:18 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2022/01/04 14:50:23 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2022/01/04 14:50:23 clusterSetup.go:354: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got deployed
2022/01/04 14:50:28 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2022/01/04 14:50:33 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2022/01/04 14:50:39 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2022/01/04 14:50:39 clusterSetup.go:354: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:50:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:50:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:50:39 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 14:50:39 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:50:44 Rebalance progress: 12.5
2022/01/04 14:50:49 Rebalance progress: 12.5
2022/01/04 14:50:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:50:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:50:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:50:54 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 14:50:55 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 14:51:00 Rebalance progress: 12.5
2022/01/04 14:51:05 Rebalance progress: 12.5
2022/01/04 14:51:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:51:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:51:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:51:10 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 14:51:15 Rebalance progress: 12.5
2022/01/04 14:51:20 Rebalance progress: 12.5
2022/01/04 14:51:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:51:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:51:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:51:30 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/01/04 14:51:35 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/01/04 14:51:40 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/01/04 14:51:45 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/01/04 14:51:45 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got un-deployed
2022/01/04 14:51:45 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:51:45 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update deleting in background"
}
2022/01/04 14:51:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:51:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:51:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7651
2022/01/04 14:51:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:52:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:52:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:52:10 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3142
2022/01/04 14:52:15 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3142
2022/01/04 14:52:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:52:20 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/01/04 14:52:26 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/01/04 14:52:31 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/01/04 14:52:36 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/01/04 14:52:36 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got un-deployed
2022/01/04 14:52:36 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:52:36 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op deleting in background"
}
2022/01/04 14:52:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:52:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:52:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:52:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:52:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:52:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebMultipleHandlers (210.04s)
=== RUN   TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne
2022/01/04 14:52:59 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/04 14:52:59 clusterSetup.go:405: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/01/04 14:52:59 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:52:59 eventingSetup.go:418: Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne not found"
}
2022/01/04 14:53:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:53:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:53:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:53:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:53:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:53:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:53:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:53:18 eventingSetup.go:125: Deploying app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:53:19 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2022/01/04 14:53:24 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 14:53:29 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/04 14:53:34 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/04 14:53:39 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/04 14:53:39 clusterSetup.go:354: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:53:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:53:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:53:39 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 14:53:39 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:53:59 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:54:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:54:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:54:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:54:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:54:30 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:54:35 Rebalance progress: 12.5
2022/01/04 14:54:40 Rebalance progress: 12.5
2022/01/04 14:54:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:54:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:54:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:54:45 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 14:54:46 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 14:54:51 Rebalance progress: 12.5
2022/01/04 14:54:56 Rebalance progress: 12.5
2022/01/04 14:55:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:55:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:55:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:55:01 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 14:55:06 Rebalance progress: 12.5
2022/01/04 14:55:11 Rebalance progress: 12.5
2022/01/04 14:55:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:55:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:55:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:55:21 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/04 14:55:26 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/04 14:55:31 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/04 14:55:36 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/04 14:55:36 clusterSetup.go:405: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/01/04 14:55:36 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:55:36 eventingSetup.go:418: Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2022/01/04 14:55:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:55:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:55:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11236
2022/01/04 14:55:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:55:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:55:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:56:00 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 525
2022/01/04 14:56:05 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 525
2022/01/04 14:56:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne (195.88s)
=== RUN   TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne
2022/01/04 14:56:15 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/04 14:56:15 clusterSetup.go:405: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/01/04 14:56:15 eventingSetup.go:46: No eventing-con process running
2022/01/04 14:56:15 eventingSetup.go:418: Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne not found"
}
2022/01/04 14:56:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:56:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:56:22 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 14:56:23 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:56:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:56:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:56:33 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 14:56:33 eventingSetup.go:125: Deploying app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2022/01/04 14:56:35 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2022/01/04 14:56:40 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 14:56:45 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/04 14:56:50 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/04 14:56:55 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/04 14:56:55 clusterSetup.go:354: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:56:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:56:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:56:55 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 14:56:55 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:57:15 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:57:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:57:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:57:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:57:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:57:26 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 14:57:26 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:57:46 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:57:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:57:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:57:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:57:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:57:56 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 14:57:57 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:58:17 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:58:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:58:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:58:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:58:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:58:28 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 14:58:28 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:58:48 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:58:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:58:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:58:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:58:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:58:59 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 14:58:59 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:59:19 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:59:20 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:59:20 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:59:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:59:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:59:30 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 14:59:35 Rebalance progress: 12.5
2022/01/04 14:59:40 Rebalance progress: 12.5
2022/01/04 14:59:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:59:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 14:59:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 14:59:45 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 14:59:45 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 14:59:50 Rebalance progress: 12.5
2022/01/04 14:59:55 Rebalance progress: 12.5
2022/01/04 15:00:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:00:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:00:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:00:00 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 15:00:05 Rebalance progress: 12.5
2022/01/04 15:00:10 Rebalance progress: 12.5
2022/01/04 15:00:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:00:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:00:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:00:20 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/04 15:00:25 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/04 15:00:30 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/04 15:00:35 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/04 15:00:35 clusterSetup.go:405: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/01/04 15:00:35 eventingSetup.go:46: No eventing-con process running
2022/01/04 15:00:35 eventingSetup.go:418: Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2022/01/04 15:00:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:00:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:00:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 21526
2022/01/04 15:00:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:00:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:00:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:00:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 21526
2022/01/04 15:00:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne (293.84s)
=== RUN   TestEventingFailoverOnUpdateBucketOp
2022/01/04 15:01:09 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2022/01/04 15:01:09 clusterSetup.go:405: App: TestEventingFailoverOnUpdateBucketOp got un-deployed
2022/01/04 15:01:09 eventingSetup.go:46: No eventing-con process running
2022/01/04 15:01:09 eventingSetup.go:418: Function: TestEventingFailoverOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingFailoverOnUpdateBucketOp not found"
}
2022/01/04 15:01:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:01:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:01:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:01:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:01:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:01:22 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:01:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:01:27 eventingSetup.go:125: Deploying app: TestEventingFailoverOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/04 15:01:28 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingFailoverOnUpdateBucketOp stored in temp store"
}
2022/01/04 15:01:33 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 15:01:38 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2022/01/04 15:01:43 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2022/01/04 15:01:48 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2022/01/04 15:01:48 clusterSetup.go:354: App: TestEventingFailoverOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:01:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:01:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:01:48 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 15:01:49 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 15:01:54 Rebalance progress: 12.5
2022/01/04 15:01:59 Rebalance progress: 12.5
2022/01/04 15:02:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:02:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:02:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:02:04 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:02:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:02:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:02:14 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 15:02:19 Rebalance progress: 12.5
2022/01/04 15:02:24 Rebalance progress: 12.5
2022/01/04 15:02:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:02:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:02:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:02:29 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 15:02:30 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 15:02:35 Rebalance progress: 12.5
2022/01/04 15:02:40 Rebalance progress: 12.5
2022/01/04 15:02:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:02:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:02:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:02:45 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 15:02:50 Rebalance progress: 12.5
2022/01/04 15:02:55 Rebalance progress: 12.5
2022/01/04 15:03:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:03:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:03:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:03:05 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2022/01/04 15:03:10 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2022/01/04 15:03:15 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2022/01/04 15:03:20 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2022/01/04 15:03:20 clusterSetup.go:405: App: TestEventingFailoverOnUpdateBucketOp got un-deployed
2022/01/04 15:03:20 eventingSetup.go:46: No eventing-con process running
2022/01/04 15:03:20 eventingSetup.go:418: Function: TestEventingFailoverOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingFailoverOnUpdateBucketOp deleting in background"
}
2022/01/04 15:03:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:03:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:03:32 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8623
2022/01/04 15:03:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8623
2022/01/04 15:03:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:03:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:03:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:03:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8623
2022/01/04 15:03:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingFailoverOnUpdateBucketOp (169.74s)
=== RUN   TestEventingKVRebalanceOnUpdateBucketOp
2022/01/04 15:03:59 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/01/04 15:03:59 clusterSetup.go:405: App: TestEventingKVRebalanceOnUpdateBucketOp got un-deployed
2022/01/04 15:03:59 eventingSetup.go:46: No eventing-con process running
2022/01/04 15:03:59 eventingSetup.go:418: Function: TestEventingKVRebalanceOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingKVRebalanceOnUpdateBucketOp not found"
}
2022/01/04 15:04:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:04:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:04:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:04:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:04:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:04:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:04:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:04:17 eventingSetup.go:125: Deploying app: TestEventingKVRebalanceOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/04 15:04:18 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingKVRebalanceOnUpdateBucketOp stored in temp store"
}
2022/01/04 15:04:23 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 15:04:28 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2022/01/04 15:04:33 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2022/01/04 15:04:38 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2022/01/04 15:04:38 clusterSetup.go:354: App: TestEventingKVRebalanceOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:04:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:04:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:04:38 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing,kv to the cluster
2022/01/04 15:04:39 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 15:04:44 Rebalance progress: 12.5
2022/01/04 15:04:49 Rebalance progress: 12.5
2022/01/04 15:04:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:04:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:04:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:04:54 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing,kv to the cluster
2022/01/04 15:04:54 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 15:04:59 Rebalance progress: 12.5
2022/01/04 15:05:04 Rebalance progress: 12.5
2022/01/04 15:05:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:05:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:05:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:05:09 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 15:05:15 Rebalance progress: 12.5
2022/01/04 15:05:20 Rebalance progress: 12.5
2022/01/04 15:05:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:05:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:05:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:05:30 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/01/04 15:05:35 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/01/04 15:05:40 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/01/04 15:05:45 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/01/04 15:05:45 clusterSetup.go:405: App: TestEventingKVRebalanceOnUpdateBucketOp got un-deployed
2022/01/04 15:05:45 eventingSetup.go:46: No eventing-con process running
2022/01/04 15:05:45 eventingSetup.go:418: Function: TestEventingKVRebalanceOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingKVRebalanceOnUpdateBucketOp deleting in background"
}
2022/01/04 15:05:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:05:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:05:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6117
2022/01/04 15:05:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:05:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:06:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:06:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6117
2022/01/04 15:06:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingKVRebalanceOnUpdateBucketOp (139.84s)
=== RUN   TestEventingRebInWithOps
2022/01/04 15:06:18 clusterSetup.go:397: Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/01/04 15:06:18 clusterSetup.go:405: App: TestEventingRebInWithOps got un-deployed
2022/01/04 15:06:18 eventingSetup.go:46: No eventing-con process running
2022/01/04 15:06:18 eventingSetup.go:418: Function: TestEventingRebInWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebInWithOps not found"
}
2022/01/04 15:06:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:06:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:06:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:06:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:06:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:06:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:06:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:06:37 eventingSetup.go:125: Deploying app: TestEventingRebInWithOps. Item count src bucket: 0 dst bucket: 0
2022/01/04 15:06:38 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithOps stored in temp store"
}
2022/01/04 15:06:43 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2022/01/04 15:06:48 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2022/01/04 15:06:53 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2022/01/04 15:06:58 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2022/01/04 15:06:58 clusterSetup.go:354: App: TestEventingRebInWithOps got deployed
2022/01/04 15:06:58 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 15:06:58 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 15:06:58 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 15:07:04 Rebalance progress: 12.5
2022/01/04 15:07:09 Rebalance progress: 12.5
2022/01/04 15:07:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:07:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:07:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:07:14 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 15:07:19 Rebalance progress: 12.5
2022/01/04 15:07:24 Rebalance progress: 12.5
2022/01/04 15:07:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:07:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:07:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:07:29 Waiting for src bucket item count to get to: 200000 curr count: 32550
2022/01/04 15:07:34 Waiting for src bucket item count to get to: 200000 curr count: 48320
2022/01/04 15:07:39 Waiting for src bucket item count to get to: 200000 curr count: 48320
2022/01/04 15:07:44 Waiting for src bucket item count to get to: 200000 curr count: 64615
2022/01/04 15:07:49 Waiting for src bucket item count to get to: 200000 curr count: 64615
2022/01/04 15:07:54 Waiting for src bucket item count to get to: 200000 curr count: 80054
2022/01/04 15:07:59 Waiting for src bucket item count to get to: 200000 curr count: 80054
2022/01/04 15:08:04 Waiting for src bucket item count to get to: 200000 curr count: 96511
2022/01/04 15:08:09 Waiting for src bucket item count to get to: 200000 curr count: 96511
2022/01/04 15:08:14 Waiting for src bucket item count to get to: 200000 curr count: 113068
2022/01/04 15:08:19 Waiting for src bucket item count to get to: 200000 curr count: 113068
2022/01/04 15:08:24 Waiting for src bucket item count to get to: 200000 curr count: 113068
2022/01/04 15:08:29 Waiting for src bucket item count to get to: 200000 curr count: 129811
2022/01/04 15:08:34 Waiting for src bucket item count to get to: 200000 curr count: 129811
2022/01/04 15:08:39 Waiting for src bucket item count to get to: 200000 curr count: 146600
2022/01/04 15:08:44 Waiting for src bucket item count to get to: 200000 curr count: 146600
2022/01/04 15:08:49 Waiting for src bucket item count to get to: 200000 curr count: 163023
2022/01/04 15:08:54 Waiting for src bucket item count to get to: 200000 curr count: 163023
2022/01/04 15:08:59 Waiting for src bucket item count to get to: 200000 curr count: 178285
2022/01/04 15:09:04 Waiting for src bucket item count to get to: 200000 curr count: 178285
2022/01/04 15:09:09 Waiting for src bucket item count to get to: 200000 curr count: 194527
2022/01/04 15:09:14 Waiting for src bucket item count to get to: 200000 curr count: 194527
2022/01/04 15:09:19 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/04 15:09:19 Post SET ops. Expected item count: 200000 got 200000
2022/01/04 15:09:19 Starting bucket ops to source bucket
2022/01/04 15:13:03 Waiting for dst bucket item count to get to: 0 curr count: 16367
2022/01/04 15:13:08 Waiting for dst bucket item count to get to: 0 curr count: 16367
2022/01/04 15:13:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:13:08 Post DELETE ops. Expected item count: 0 got 0
2022/01/04 15:13:13 Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/01/04 15:13:18 Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/01/04 15:13:23 Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/01/04 15:13:28 Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/01/04 15:13:28 App: TestEventingRebInWithOps got un-deployed
2022/01/04 15:13:28 No eventing-con process running
2022/01/04 15:13:28 Function: TestEventingRebInWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithOps deleting in background"
}
2022/01/04 15:13:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:13:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:13:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:13:37 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:13:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:13:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebInWithOps (453.57s)
=== RUN   TestEventingRebOutWithOps
2022/01/04 15:13:47 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 15:13:47 Removing node(s): [] from the cluster
2022/01/04 15:13:52 Rebalance progress: 100
2022/01/04 15:13:57 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/01/04 15:13:57 App: TestEventingRebOutWithOps got un-deployed
2022/01/04 15:13:57 No eventing-con process running
2022/01/04 15:13:57 Function: TestEventingRebOutWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebOutWithOps not found"
}
2022/01/04 15:13:59 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:14:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:14:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:14:06 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:14:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:14:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:14:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:14:16 Deploying app: TestEventingRebOutWithOps. Item count src bucket: 0 dst bucket: 0
2022/01/04 15:14:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithOps stored in temp store"
}
2022/01/04 15:14:22 Waiting for app: TestEventingRebOutWithOps to get deployed
2022/01/04 15:14:27 Waiting for app: TestEventingRebOutWithOps to get deployed
2022/01/04 15:14:32 Waiting for app: TestEventingRebOutWithOps to get deployed
2022/01/04 15:14:37 Waiting for app: TestEventingRebOutWithOps to get deployed
2022/01/04 15:14:37 App: TestEventingRebOutWithOps got deployed
2022/01/04 15:14:37 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 15:14:37 Starting bucket ops to source bucket
2022/01/04 15:14:42 Rebalance progress: 12.5
2022/01/04 15:14:47 Rebalance progress: 12.5
2022/01/04 15:14:52 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:14:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:14:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:14:52 Waiting for src bucket item count to get to: 200000 curr count: 19287
2022/01/04 15:14:57 Waiting for src bucket item count to get to: 200000 curr count: 19287
2022/01/04 15:15:02 Waiting for src bucket item count to get to: 200000 curr count: 35557
2022/01/04 15:15:07 Waiting for src bucket item count to get to: 200000 curr count: 35557
2022/01/04 15:15:12 Waiting for src bucket item count to get to: 200000 curr count: 52069
2022/01/04 15:15:17 Waiting for src bucket item count to get to: 200000 curr count: 52069
2022/01/04 15:15:22 Waiting for src bucket item count to get to: 200000 curr count: 68635
2022/01/04 15:15:27 Waiting for src bucket item count to get to: 200000 curr count: 68635
2022/01/04 15:15:32 Waiting for src bucket item count to get to: 200000 curr count: 68635
2022/01/04 15:15:37 Waiting for src bucket item count to get to: 200000 curr count: 83584
2022/01/04 15:15:42 Waiting for src bucket item count to get to: 200000 curr count: 83584
2022/01/04 15:15:47 Waiting for src bucket item count to get to: 200000 curr count: 99939
2022/01/04 15:15:52 Waiting for src bucket item count to get to: 200000 curr count: 99939
2022/01/04 15:15:57 Waiting for src bucket item count to get to: 200000 curr count: 116211
2022/01/04 15:16:02 Waiting for src bucket item count to get to: 200000 curr count: 116211
2022/01/04 15:16:07 Waiting for src bucket item count to get to: 200000 curr count: 132531
2022/01/04 15:16:12 Waiting for src bucket item count to get to: 200000 curr count: 132531
2022/01/04 15:16:17 Waiting for src bucket item count to get to: 200000 curr count: 148654
2022/01/04 15:16:22 Waiting for src bucket item count to get to: 200000 curr count: 148654
2022/01/04 15:16:27 Waiting for src bucket item count to get to: 200000 curr count: 164837
2022/01/04 15:16:32 Waiting for src bucket item count to get to: 200000 curr count: 164837
2022/01/04 15:16:37 Waiting for src bucket item count to get to: 200000 curr count: 179669
2022/01/04 15:16:42 Waiting for src bucket item count to get to: 200000 curr count: 179669
2022/01/04 15:16:47 Waiting for src bucket item count to get to: 200000 curr count: 195751
2022/01/04 15:16:52 Waiting for src bucket item count to get to: 200000 curr count: 195751
2022/01/04 15:16:57 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/04 15:16:57 Post SET ops. Expected item count: 200000 got 200000
2022/01/04 15:16:57 Starting bucket ops to source bucket
2022/01/04 15:20:42 Waiting for dst bucket item count to get to: 0 curr count: 15015
2022/01/04 15:20:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:20:42 Post DELETE ops. Expected item count: 0 got 0
2022/01/04 15:20:47 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/01/04 15:20:53 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/01/04 15:20:58 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/01/04 15:21:03 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/01/04 15:21:03 App: TestEventingRebOutWithOps got un-deployed
2022/01/04 15:21:03 No eventing-con process running
2022/01/04 15:21:03 Function: TestEventingRebOutWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithOps deleting in background"
}
2022/01/04 15:21:04 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:21:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:21:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:21:11 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:21:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:21:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebOutWithOps (454.14s)
=== RUN   TestEventingSwapRebWithOps
2022/01/04 15:21:26 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/01/04 15:21:26 App: TestEventingSwapRebWithOps got un-deployed
2022/01/04 15:21:26 No eventing-con process running
2022/01/04 15:21:26 Function: TestEventingSwapRebWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebWithOps not found"
}
2022/01/04 15:21:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:21:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:21:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:21:35 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:21:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:21:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:21:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:21:45 Deploying app: TestEventingSwapRebWithOps. Item count src bucket: 0 dst bucket: 0
2022/01/04 15:21:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithOps stored in temp store"
}
2022/01/04 15:21:51 Waiting for app: TestEventingSwapRebWithOps to get deployed
2022/01/04 15:21:56 Waiting for app: TestEventingSwapRebWithOps to get deployed
2022/01/04 15:22:01 Waiting for app: TestEventingSwapRebWithOps to get deployed
2022/01/04 15:22:06 Waiting for app: TestEventingSwapRebWithOps to get deployed
2022/01/04 15:22:06 App: TestEventingSwapRebWithOps got deployed
2022/01/04 15:22:06 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 15:22:06 Starting bucket ops to source bucket
2022/01/04 15:22:06 Removing node(s): [] from the cluster
2022/01/04 15:22:11 Rebalance progress: 12.5
2022/01/04 15:22:16 Rebalance progress: 12.5
2022/01/04 15:22:21 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:22:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:22:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:22:21 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 15:22:22 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 15:22:27 Rebalance progress: 12.5
2022/01/04 15:22:32 Rebalance progress: 12.5
2022/01/04 15:22:37 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:22:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:22:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:22:37 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 15:22:42 Rebalance progress: 12.5
2022/01/04 15:22:47 Rebalance progress: 12.5
2022/01/04 15:22:52 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:22:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:22:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:22:52 Waiting for src bucket item count to get to: 200000 curr count: 67924
2022/01/04 15:22:57 Waiting for src bucket item count to get to: 200000 curr count: 67924
2022/01/04 15:23:02 Waiting for src bucket item count to get to: 200000 curr count: 82797
2022/01/04 15:23:07 Waiting for src bucket item count to get to: 200000 curr count: 82797
2022/01/04 15:23:12 Waiting for src bucket item count to get to: 200000 curr count: 99376
2022/01/04 15:23:17 Waiting for src bucket item count to get to: 200000 curr count: 99376
2022/01/04 15:23:22 Waiting for src bucket item count to get to: 200000 curr count: 115876
2022/01/04 15:23:27 Waiting for src bucket item count to get to: 200000 curr count: 115876
2022/01/04 15:23:32 Waiting for src bucket item count to get to: 200000 curr count: 132388
2022/01/04 15:23:37 Waiting for src bucket item count to get to: 200000 curr count: 132388
2022/01/04 15:23:42 Waiting for src bucket item count to get to: 200000 curr count: 148768
2022/01/04 15:23:47 Waiting for src bucket item count to get to: 200000 curr count: 148768
2022/01/04 15:23:52 Waiting for src bucket item count to get to: 200000 curr count: 165433
2022/01/04 15:23:57 Waiting for src bucket item count to get to: 200000 curr count: 165433
2022/01/04 15:24:02 Waiting for src bucket item count to get to: 200000 curr count: 165433
2022/01/04 15:24:07 Waiting for src bucket item count to get to: 200000 curr count: 180795
2022/01/04 15:24:12 Waiting for src bucket item count to get to: 200000 curr count: 180795
2022/01/04 15:24:17 Waiting for src bucket item count to get to: 200000 curr count: 197276
2022/01/04 15:24:22 Waiting for src bucket item count to get to: 200000 curr count: 197276
2022/01/04 15:24:27 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/04 15:24:27 Post SET ops. Expected item count: 200000 got 200000
2022/01/04 15:24:27 Starting bucket ops to source bucket
2022/01/04 15:28:12 Waiting for dst bucket item count to get to: 0 curr count: 13886
2022/01/04 15:28:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:28:12 Post DELETE ops. Expected item count: 0 got 0
2022/01/04 15:28:17 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/01/04 15:28:22 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/01/04 15:28:27 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/01/04 15:28:32 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/01/04 15:28:32 App: TestEventingSwapRebWithOps got un-deployed
2022/01/04 15:28:32 No eventing-con process running
2022/01/04 15:28:32 Function: TestEventingSwapRebWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithOps deleting in background"
}
2022/01/04 15:28:34 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:28:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:28:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:28:41 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:28:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:28:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebWithOps (449.50s)
=== RUN   TestKVRebInWithOps
2022/01/04 15:28:56 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/01/04 15:28:56 App: TestKVRebInWithOps got un-deployed
2022/01/04 15:28:56 No eventing-con process running
2022/01/04 15:28:56 Function: TestKVRebInWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebInWithOps not found"
}
2022/01/04 15:28:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:29:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:29:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:29:04 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:29:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:29:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:29:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:29:14 Deploying app: TestKVRebInWithOps. Item count src bucket: 0 dst bucket: 0
2022/01/04 15:29:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithOps stored in temp store"
}
2022/01/04 15:29:20 Waiting for app: TestKVRebInWithOps to get deployed
2022/01/04 15:29:25 Waiting for app: TestKVRebInWithOps to get deployed
2022/01/04 15:29:30 Waiting for app: TestKVRebInWithOps to get deployed
2022/01/04 15:29:35 Waiting for app: TestKVRebInWithOps to get deployed
2022/01/04 15:29:35 App: TestKVRebInWithOps got deployed
2022/01/04 15:29:35 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 15:29:35 Starting bucket ops to source bucket
2022/01/04 15:29:35 Removing node(s): [] from the cluster
2022/01/04 15:29:41 Rebalance progress: 12.5
2022/01/04 15:29:46 Rebalance progress: 12.5
2022/01/04 15:29:51 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:29:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:29:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:29:51 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 15:29:56 Rebalance progress: 12.5
2022/01/04 15:30:01 Rebalance progress: 12.5
2022/01/04 15:30:06 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:30:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:30:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:30:06 Waiting for src bucket item count to get to: 200000 curr count: 37395
2022/01/04 15:30:11 Waiting for src bucket item count to get to: 200000 curr count: 53704
2022/01/04 15:30:16 Waiting for src bucket item count to get to: 200000 curr count: 53704
2022/01/04 15:30:21 Waiting for src bucket item count to get to: 200000 curr count: 70363
2022/01/04 15:30:26 Waiting for src bucket item count to get to: 200000 curr count: 70363
2022/01/04 15:30:31 Waiting for src bucket item count to get to: 200000 curr count: 85831
2022/01/04 15:30:36 Waiting for src bucket item count to get to: 200000 curr count: 85831
2022/01/04 15:30:41 Waiting for src bucket item count to get to: 200000 curr count: 102429
2022/01/04 15:30:46 Waiting for src bucket item count to get to: 200000 curr count: 102429
2022/01/04 15:30:51 Waiting for src bucket item count to get to: 200000 curr count: 102429
2022/01/04 15:30:56 Waiting for src bucket item count to get to: 200000 curr count: 118879
2022/01/04 15:31:01 Waiting for src bucket item count to get to: 200000 curr count: 118879
2022/01/04 15:31:06 Waiting for src bucket item count to get to: 200000 curr count: 135134
2022/01/04 15:31:11 Waiting for src bucket item count to get to: 200000 curr count: 135134
2022/01/04 15:31:16 Waiting for src bucket item count to get to: 200000 curr count: 151338
2022/01/04 15:31:21 Waiting for src bucket item count to get to: 200000 curr count: 151338
2022/01/04 15:31:26 Waiting for src bucket item count to get to: 200000 curr count: 167503
2022/01/04 15:31:31 Waiting for src bucket item count to get to: 200000 curr count: 167503
2022/01/04 15:31:36 Waiting for src bucket item count to get to: 200000 curr count: 182130
2022/01/04 15:31:41 Waiting for src bucket item count to get to: 200000 curr count: 182130
2022/01/04 15:31:46 Waiting for src bucket item count to get to: 200000 curr count: 198257
2022/01/04 15:31:51 Waiting for src bucket item count to get to: 200000 curr count: 198257
2022/01/04 15:31:56 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/04 15:31:56 Post SET ops. Expected item count: 200000 got 200000
2022/01/04 15:31:56 Starting bucket ops to source bucket
2022/01/04 15:35:41 Waiting for dst bucket item count to get to: 0 curr count: 11841
2022/01/04 15:35:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:35:41 Post DELETE ops. Expected item count: 0 got 0
2022/01/04 15:35:46 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/01/04 15:35:51 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/01/04 15:35:56 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/01/04 15:36:01 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/01/04 15:36:01 App: TestKVRebInWithOps got un-deployed
2022/01/04 15:36:01 No eventing-con process running
2022/01/04 15:36:01 Function: TestKVRebInWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithOps deleting in background"
}
2022/01/04 15:36:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:36:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:36:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:36:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:36:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:36:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebInWithOps (448.91s)
=== RUN   TestKVRebOutWithOps
2022/01/04 15:36:19 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 15:36:20 Removing node(s): [] from the cluster
2022/01/04 15:36:25 Rebalance progress: 100
2022/01/04 15:36:30 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/01/04 15:36:30 App: TestKVRebOutWithOps got un-deployed
2022/01/04 15:36:30 No eventing-con process running
2022/01/04 15:36:30 Function: TestKVRebOutWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebOutWithOps not found"
}
2022/01/04 15:36:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:36:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:36:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:36:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:36:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:36:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:36:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:36:48 Deploying app: TestKVRebOutWithOps. Item count src bucket: 0 dst bucket: 0
2022/01/04 15:36:49 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithOps stored in temp store"
}
2022/01/04 15:36:54 Waiting for app: TestKVRebOutWithOps to get deployed
2022/01/04 15:36:59 Waiting for app: TestKVRebOutWithOps to get deployed
2022/01/04 15:37:04 Waiting for app: TestKVRebOutWithOps to get deployed
2022/01/04 15:37:09 Waiting for app: TestKVRebOutWithOps to get deployed
2022/01/04 15:37:10 App: TestKVRebOutWithOps got deployed
2022/01/04 15:37:10 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 15:37:10 Starting bucket ops to source bucket
2022/01/04 15:37:15 Rebalance progress: 12.5
2022/01/04 15:37:20 Rebalance progress: 12.5
2022/01/04 15:37:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:37:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:37:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:37:25 Waiting for src bucket item count to get to: 200000 curr count: 14953
2022/01/04 15:37:30 Waiting for src bucket item count to get to: 200000 curr count: 14953
2022/01/04 15:37:35 Waiting for src bucket item count to get to: 200000 curr count: 30824
2022/01/04 15:37:40 Waiting for src bucket item count to get to: 200000 curr count: 30824
2022/01/04 15:37:45 Waiting for src bucket item count to get to: 200000 curr count: 47144
2022/01/04 15:37:50 Waiting for src bucket item count to get to: 200000 curr count: 47144
2022/01/04 15:37:55 Waiting for src bucket item count to get to: 200000 curr count: 63498
2022/01/04 15:38:00 Waiting for src bucket item count to get to: 200000 curr count: 78632
2022/01/04 15:38:05 Waiting for src bucket item count to get to: 200000 curr count: 78632
2022/01/04 15:38:10 Waiting for src bucket item count to get to: 200000 curr count: 78632
2022/01/04 15:38:15 Waiting for src bucket item count to get to: 200000 curr count: 94431
2022/01/04 15:38:20 Waiting for src bucket item count to get to: 200000 curr count: 94431
2022/01/04 15:38:25 Waiting for src bucket item count to get to: 200000 curr count: 110915
2022/01/04 15:38:30 Waiting for src bucket item count to get to: 200000 curr count: 110915
2022/01/04 15:38:35 Waiting for src bucket item count to get to: 200000 curr count: 127007
2022/01/04 15:38:40 Waiting for src bucket item count to get to: 200000 curr count: 127007
2022/01/04 15:38:45 Waiting for src bucket item count to get to: 200000 curr count: 143005
2022/01/04 15:38:50 Waiting for src bucket item count to get to: 200000 curr count: 143005
2022/01/04 15:38:55 Waiting for src bucket item count to get to: 200000 curr count: 159279
2022/01/04 15:39:00 Waiting for src bucket item count to get to: 200000 curr count: 159279
2022/01/04 15:39:05 Waiting for src bucket item count to get to: 200000 curr count: 174287
2022/01/04 15:39:10 Waiting for src bucket item count to get to: 200000 curr count: 174287
2022/01/04 15:39:15 Waiting for src bucket item count to get to: 200000 curr count: 190180
2022/01/04 15:39:20 Waiting for src bucket item count to get to: 200000 curr count: 190180
2022/01/04 15:39:25 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/04 15:39:25 Post SET ops. Expected item count: 200000 got 200000
2022/01/04 15:39:25 Starting bucket ops to source bucket
2022/01/04 15:43:09 Waiting for dst bucket item count to get to: 0 curr count: 27354
2022/01/04 15:43:14 Waiting for dst bucket item count to get to: 0 curr count: 9149
2022/01/04 15:43:19 Waiting for dst bucket item count to get to: 0 curr count: 9149
2022/01/04 15:43:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:43:19 Post DELETE ops. Expected item count: 0 got 0
2022/01/04 15:43:24 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/01/04 15:43:30 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/01/04 15:43:35 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/01/04 15:43:40 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/01/04 15:43:40 App: TestKVRebOutWithOps got un-deployed
2022/01/04 15:43:40 No eventing-con process running
2022/01/04 15:43:40 Function: TestKVRebOutWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithOps deleting in background"
}
2022/01/04 15:43:41 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:43:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:43:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:43:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:43:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:43:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOutWithOps (458.74s)
=== RUN   TestKVSwapRebWithOps
2022/01/04 15:44:03 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/01/04 15:44:03 App: TestKVSwapRebWithOps got un-deployed
2022/01/04 15:44:03 No eventing-con process running
2022/01/04 15:44:03 Function: TestKVSwapRebWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVSwapRebWithOps not found"
}
2022/01/04 15:44:05 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:44:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:44:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:44:12 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:44:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:44:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:44:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:44:22 Deploying app: TestKVSwapRebWithOps. Item count src bucket: 0 dst bucket: 0
2022/01/04 15:44:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithOps stored in temp store"
}
2022/01/04 15:44:28 Waiting for app: TestKVSwapRebWithOps to get deployed
2022/01/04 15:44:33 Waiting for app: TestKVSwapRebWithOps to get deployed
2022/01/04 15:44:38 Waiting for app: TestKVSwapRebWithOps to get deployed
2022/01/04 15:44:43 Waiting for app: TestKVSwapRebWithOps to get deployed
2022/01/04 15:44:43 App: TestKVSwapRebWithOps got deployed
2022/01/04 15:44:43 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 15:44:43 Starting bucket ops to source bucket
2022/01/04 15:44:43 Removing node(s): [] from the cluster
2022/01/04 15:44:48 Rebalance progress: 12.5
2022/01/04 15:44:53 Rebalance progress: 12.5
2022/01/04 15:44:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:44:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:44:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:44:58 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/04 15:44:59 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 15:45:04 Rebalance progress: 12.5
2022/01/04 15:45:09 Rebalance progress: 12.5
2022/01/04 15:45:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:45:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:45:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:45:14 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 15:45:19 Rebalance progress: 12.5
2022/01/04 15:45:24 Rebalance progress: 12.5
2022/01/04 15:45:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:45:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:45:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:45:29 Waiting for src bucket item count to get to: 200000 curr count: 56675
2022/01/04 15:45:34 Waiting for src bucket item count to get to: 200000 curr count: 72239
2022/01/04 15:45:39 Waiting for src bucket item count to get to: 200000 curr count: 72239
2022/01/04 15:45:44 Waiting for src bucket item count to get to: 200000 curr count: 87987
2022/01/04 15:45:49 Waiting for src bucket item count to get to: 200000 curr count: 87987
2022/01/04 15:45:54 Waiting for src bucket item count to get to: 200000 curr count: 104231
2022/01/04 15:45:59 Waiting for src bucket item count to get to: 200000 curr count: 104231
2022/01/04 15:46:04 Waiting for src bucket item count to get to: 200000 curr count: 120685
2022/01/04 15:46:09 Waiting for src bucket item count to get to: 200000 curr count: 120685
2022/01/04 15:46:14 Waiting for src bucket item count to get to: 200000 curr count: 137123
2022/01/04 15:46:19 Waiting for src bucket item count to get to: 200000 curr count: 137123
2022/01/04 15:46:24 Waiting for src bucket item count to get to: 200000 curr count: 153645
2022/01/04 15:46:29 Waiting for src bucket item count to get to: 200000 curr count: 153645
2022/01/04 15:46:34 Waiting for src bucket item count to get to: 200000 curr count: 169860
2022/01/04 15:46:39 Waiting for src bucket item count to get to: 200000 curr count: 169860
2022/01/04 15:46:44 Waiting for src bucket item count to get to: 200000 curr count: 169860
2022/01/04 15:46:49 Waiting for src bucket item count to get to: 200000 curr count: 185459
2022/01/04 15:46:54 Waiting for src bucket item count to get to: 200000 curr count: 185459
2022/01/04 15:46:59 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/04 15:46:59 Post SET ops. Expected item count: 200000 got 200000
2022/01/04 15:46:59 Starting bucket ops to source bucket
2022/01/04 15:50:44 Waiting for dst bucket item count to get to: 0 curr count: 17945
2022/01/04 15:50:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:50:44 Post DELETE ops. Expected item count: 0 got 0
2022/01/04 15:50:49 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/01/04 15:50:54 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/01/04 15:50:59 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/01/04 15:51:04 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/01/04 15:51:04 App: TestKVSwapRebWithOps got un-deployed
2022/01/04 15:51:04 No eventing-con process running
2022/01/04 15:51:04 Function: TestKVSwapRebWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithOps deleting in background"
}
2022/01/04 15:51:06 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:51:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:51:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:51:13 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:51:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:51:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebWithOps (444.69s)
=== RUN   TestEventingRebInWithTimers
2022/01/04 15:51:28 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/01/04 15:51:28 App: TestEventingRebInWithTimers got un-deployed
2022/01/04 15:51:28 No eventing-con process running
2022/01/04 15:51:28 Function: TestEventingRebInWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebInWithTimers not found"
}
2022/01/04 15:51:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:51:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:51:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:51:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:51:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:51:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:51:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:51:46 Deploying app: TestEventingRebInWithTimers. Item count src bucket: 0 dst bucket: 0
2022/01/04 15:51:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithTimers stored in temp store"
}
2022/01/04 15:51:53 Waiting for app: TestEventingRebInWithTimers to get deployed
2022/01/04 15:51:58 Waiting for app: TestEventingRebInWithTimers to get deployed
2022/01/04 15:52:03 Waiting for app: TestEventingRebInWithTimers to get deployed
2022/01/04 15:52:08 Waiting for app: TestEventingRebInWithTimers to get deployed
2022/01/04 15:52:08 App: TestEventingRebInWithTimers got deployed
2022/01/04 15:52:08 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 15:52:08 Starting bucket ops to source bucket
2022/01/04 15:52:09 Removing node(s): [] from the cluster
2022/01/04 15:52:14 Rebalance progress: 12.5
2022/01/04 15:52:19 Rebalance progress: 12.5
2022/01/04 15:52:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:52:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:52:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:52:24 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 15:52:29 Rebalance progress: 12.5
2022/01/04 15:52:34 Rebalance progress: 12.5
2022/01/04 15:52:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:52:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:52:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:52:39 Waiting for src bucket item count to get to: 50000 curr count: 28723
2022/01/04 15:52:44 Waiting for src bucket item count to get to: 50000 curr count: 38549
2022/01/04 15:52:49 Waiting for src bucket item count to get to: 50000 curr count: 38549
2022/01/04 15:52:59 Waiting for dst bucket item count to get to: 50000 curr count: 29660
2022/01/04 15:53:04 Waiting for dst bucket item count to get to: 50000 curr count: 29660
2022/01/04 15:53:09 Waiting for dst bucket item count to get to: 50000 curr count: 44657
2022/01/04 15:53:14 Waiting for dst bucket item count to get to: 50000 curr count: 44657
2022/01/04 15:53:14 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/04 15:53:14 Post SET ops. Expected item count: 50000 got 50000
2022/01/04 15:53:14 Starting bucket ops to source bucket
2022/01/04 15:54:23 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 15:54:28 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 15:54:33 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 15:54:38 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 15:54:43 Waiting for dst bucket item count to get to: 0 curr count: 40842
2022/01/04 15:54:48 Waiting for dst bucket item count to get to: 0 curr count: 40842
2022/01/04 15:54:53 Waiting for dst bucket item count to get to: 0 curr count: 31367
2022/01/04 15:54:58 Waiting for dst bucket item count to get to: 0 curr count: 31367
2022/01/04 15:55:03 Waiting for dst bucket item count to get to: 0 curr count: 14563
2022/01/04 15:55:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:55:03 Post DELETE ops. Expected item count: 0 got 0
2022/01/04 15:55:09 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/01/04 15:55:14 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/01/04 15:55:19 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/01/04 15:55:24 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/01/04 15:55:24 App: TestEventingRebInWithTimers got un-deployed
2022/01/04 15:55:24 No eventing-con process running
2022/01/04 15:55:24 Function: TestEventingRebInWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithTimers deleting in background"
}
2022/01/04 15:55:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:55:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:55:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:55:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:55:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:55:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebInWithTimers (259.32s)
=== RUN   TestEventingRebOutWithTimers
2022/01/04 15:55:42 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 15:55:43 Removing node(s): [] from the cluster
2022/01/04 15:55:48 Rebalance progress: 100
2022/01/04 15:55:53 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/01/04 15:55:53 App: TestEventingRebOutWithTimers got un-deployed
2022/01/04 15:55:53 No eventing-con process running
2022/01/04 15:55:53 Function: TestEventingRebOutWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebOutWithTimers not found"
}
2022/01/04 15:55:54 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:55:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:55:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:56:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:56:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:56:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:56:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:56:11 Deploying app: TestEventingRebOutWithTimers. Item count src bucket: 0 dst bucket: 0
2022/01/04 15:56:12 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithTimers stored in temp store"
}
2022/01/04 15:56:17 Waiting for app: TestEventingRebOutWithTimers to get deployed
2022/01/04 15:56:22 Waiting for app: TestEventingRebOutWithTimers to get deployed
2022/01/04 15:56:27 Waiting for app: TestEventingRebOutWithTimers to get deployed
2022/01/04 15:56:32 Waiting for app: TestEventingRebOutWithTimers to get deployed
2022/01/04 15:56:32 App: TestEventingRebOutWithTimers got deployed
2022/01/04 15:56:32 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 15:56:32 Starting bucket ops to source bucket
2022/01/04 15:56:37 Rebalance progress: 12.5
2022/01/04 15:56:42 Rebalance progress: 12.5
2022/01/04 15:56:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:56:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:56:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 15:56:47 Waiting for src bucket item count to get to: 50000 curr count: 9475
2022/01/04 15:56:52 Waiting for src bucket item count to get to: 50000 curr count: 23228
2022/01/04 15:56:57 Waiting for src bucket item count to get to: 50000 curr count: 23228
2022/01/04 15:57:02 Waiting for src bucket item count to get to: 50000 curr count: 35297
2022/01/04 15:57:07 Waiting for src bucket item count to get to: 50000 curr count: 35297
2022/01/04 15:57:12 Waiting for src bucket item count to get to: 50000 curr count: 35297
2022/01/04 15:57:17 Waiting for src bucket item count to get to: 50000 curr count: 45280
2022/01/04 15:57:22 Waiting for src bucket item count to get to: 50000 curr count: 45280
2022/01/04 15:57:32 Waiting for dst bucket item count to get to: 50000 curr count: 38595
2022/01/04 15:57:37 Waiting for dst bucket item count to get to: 50000 curr count: 38595
2022/01/04 15:57:37 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/04 15:57:37 Post SET ops. Expected item count: 50000 got 50000
2022/01/04 15:57:37 Starting bucket ops to source bucket
2022/01/04 15:58:47 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 15:58:52 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 15:58:57 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 15:59:02 Waiting for dst bucket item count to get to: 0 curr count: 49713
2022/01/04 15:59:07 Waiting for dst bucket item count to get to: 0 curr count: 49713
2022/01/04 15:59:12 Waiting for dst bucket item count to get to: 0 curr count: 36081
2022/01/04 15:59:17 Waiting for dst bucket item count to get to: 0 curr count: 36081
2022/01/04 15:59:22 Waiting for dst bucket item count to get to: 0 curr count: 16266
2022/01/04 15:59:27 Waiting for dst bucket item count to get to: 0 curr count: 16266
2022/01/04 15:59:32 Waiting for dst bucket item count to get to: 0 curr count: 4108
2022/01/04 15:59:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 15:59:32 Post DELETE ops. Expected item count: 0 got 0
2022/01/04 15:59:37 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/01/04 15:59:42 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/01/04 15:59:47 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/01/04 15:59:52 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/01/04 15:59:52 App: TestEventingRebOutWithTimers got un-deployed
2022/01/04 15:59:52 No eventing-con process running
2022/01/04 15:59:52 Function: TestEventingRebOutWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithTimers deleting in background"
}
2022/01/04 15:59:54 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 15:59:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 15:59:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:00:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:00:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:00:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebOutWithTimers (268.49s)
=== RUN   TestEventingSwapRebWithTimers
2022/01/04 16:00:16 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/01/04 16:00:16 App: TestEventingSwapRebWithTimers got un-deployed
2022/01/04 16:00:16 No eventing-con process running
2022/01/04 16:00:16 Function: TestEventingSwapRebWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebWithTimers not found"
}
2022/01/04 16:00:18 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:00:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:00:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:00:24 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:00:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:00:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:00:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:00:34 Deploying app: TestEventingSwapRebWithTimers. Item count src bucket: 0 dst bucket: 0
2022/01/04 16:00:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithTimers stored in temp store"
}
2022/01/04 16:00:40 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2022/01/04 16:00:45 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2022/01/04 16:00:50 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2022/01/04 16:00:56 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2022/01/04 16:00:56 App: TestEventingSwapRebWithTimers got deployed
2022/01/04 16:00:56 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 16:00:56 Starting bucket ops to source bucket
2022/01/04 16:00:56 Removing node(s): [] from the cluster
2022/01/04 16:01:01 Rebalance progress: 12.5
2022/01/04 16:01:06 Rebalance progress: 12.5
2022/01/04 16:01:11 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:01:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:01:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:01:11 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 16:01:11 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 16:01:17 Rebalance progress: 12.5
2022/01/04 16:01:22 Rebalance progress: 12.5
2022/01/04 16:01:27 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:01:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:01:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:01:27 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 16:01:32 Rebalance progress: 12.5
2022/01/04 16:01:37 Rebalance progress: 12.5
2022/01/04 16:01:42 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:01:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:01:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:01:47 Waiting for dst bucket item count to get to: 50000 curr count: 40072
2022/01/04 16:01:52 Waiting for dst bucket item count to get to: 50000 curr count: 40072
2022/01/04 16:01:57 Waiting for dst bucket item count to get to: 50000 curr count: 48255
2022/01/04 16:02:02 Waiting for dst bucket item count to get to: 50000 curr count: 48255
2022/01/04 16:02:02 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/04 16:02:02 Post SET ops. Expected item count: 50000 got 50000
2022/01/04 16:02:02 Starting bucket ops to source bucket
2022/01/04 16:03:11 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:03:16 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:03:21 Waiting for dst bucket item count to get to: 0 curr count: 47572
2022/01/04 16:03:26 Waiting for dst bucket item count to get to: 0 curr count: 47572
2022/01/04 16:03:31 Waiting for dst bucket item count to get to: 0 curr count: 39315
2022/01/04 16:03:36 Waiting for dst bucket item count to get to: 0 curr count: 39315
2022/01/04 16:03:41 Waiting for dst bucket item count to get to: 0 curr count: 22875
2022/01/04 16:03:46 Waiting for dst bucket item count to get to: 0 curr count: 22875
2022/01/04 16:03:51 Waiting for dst bucket item count to get to: 0 curr count: 681
2022/01/04 16:03:56 Waiting for dst bucket item count to get to: 0 curr count: 681
2022/01/04 16:03:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:03:56 Post DELETE ops. Expected item count: 0 got 0
2022/01/04 16:04:01 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/01/04 16:04:06 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/01/04 16:04:11 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/01/04 16:04:16 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/01/04 16:04:16 App: TestEventingSwapRebWithTimers got un-deployed
2022/01/04 16:04:16 No eventing-con process running
2022/01/04 16:04:16 Function: TestEventingSwapRebWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithTimers deleting in background"
}
2022/01/04 16:04:18 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:04:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:04:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:04:25 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:04:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:04:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebWithTimers (263.99s)
=== RUN   TestKVRebInWithTimers
2022/01/04 16:04:40 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/01/04 16:04:40 App: TestKVRebInWithTimers got un-deployed
2022/01/04 16:04:40 No eventing-con process running
2022/01/04 16:04:40 Function: TestKVRebInWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebInWithTimers not found"
}
2022/01/04 16:04:42 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:04:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:04:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:04:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:04:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:04:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:04:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:04:58 Deploying app: TestKVRebInWithTimers. Item count src bucket: 0 dst bucket: 0
2022/01/04 16:04:59 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithTimers stored in temp store"
}
2022/01/04 16:05:04 Waiting for app: TestKVRebInWithTimers to get deployed
2022/01/04 16:05:09 Waiting for app: TestKVRebInWithTimers to get deployed
2022/01/04 16:05:14 Waiting for app: TestKVRebInWithTimers to get deployed
2022/01/04 16:05:20 Waiting for app: TestKVRebInWithTimers to get deployed
2022/01/04 16:05:20 App: TestKVRebInWithTimers got deployed
2022/01/04 16:05:20 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 16:05:20 Starting bucket ops to source bucket
2022/01/04 16:05:20 Removing node(s): [] from the cluster
2022/01/04 16:05:25 Rebalance progress: 12.5
2022/01/04 16:05:30 Rebalance progress: 12.5
2022/01/04 16:05:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:05:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:05:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:05:35 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 16:05:40 Rebalance progress: 12.5
2022/01/04 16:05:45 Rebalance progress: 12.5
2022/01/04 16:05:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:05:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:05:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:05:50 Waiting for src bucket item count to get to: 50000 curr count: 27398
2022/01/04 16:05:55 Waiting for src bucket item count to get to: 50000 curr count: 37180
2022/01/04 16:06:00 Waiting for src bucket item count to get to: 50000 curr count: 48843
2022/01/04 16:06:05 Waiting for src bucket item count to get to: 50000 curr count: 48843
2022/01/04 16:06:15 Waiting for dst bucket item count to get to: 50000 curr count: 41825
2022/01/04 16:06:20 Waiting for dst bucket item count to get to: 50000 curr count: 41825
2022/01/04 16:06:20 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/04 16:06:20 Post SET ops. Expected item count: 50000 got 50000
2022/01/04 16:06:20 Starting bucket ops to source bucket
2022/01/04 16:07:29 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:07:34 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:07:39 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:07:44 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:07:49 Waiting for dst bucket item count to get to: 0 curr count: 40492
2022/01/04 16:07:54 Waiting for dst bucket item count to get to: 0 curr count: 40492
2022/01/04 16:07:59 Waiting for dst bucket item count to get to: 0 curr count: 22978
2022/01/04 16:08:04 Waiting for dst bucket item count to get to: 0 curr count: 22978
2022/01/04 16:08:09 Waiting for dst bucket item count to get to: 0 curr count: 11646
2022/01/04 16:08:14 Waiting for dst bucket item count to get to: 0 curr count: 11646
2022/01/04 16:08:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:08:14 Post DELETE ops. Expected item count: 0 got 0
2022/01/04 16:08:19 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/01/04 16:08:24 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/01/04 16:08:30 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/01/04 16:08:35 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/01/04 16:08:35 App: TestKVRebInWithTimers got un-deployed
2022/01/04 16:08:35 No eventing-con process running
2022/01/04 16:08:35 Function: TestKVRebInWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithTimers deleting in background"
}
2022/01/04 16:08:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:08:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:08:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:08:43 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:08:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:08:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebInWithTimers (258.37s)
=== RUN   TestKVRebOutWithTimers
2022/01/04 16:08:53 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 16:08:53 Removing node(s): [] from the cluster
2022/01/04 16:08:58 Rebalance progress: 100
2022/01/04 16:09:03 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/01/04 16:09:03 App: TestKVRebOutWithTimers got un-deployed
2022/01/04 16:09:03 No eventing-con process running
2022/01/04 16:09:03 Function: TestKVRebOutWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebOutWithTimers not found"
}
2022/01/04 16:09:05 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:09:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:09:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:09:12 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:09:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:09:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:09:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:09:22 Deploying app: TestKVRebOutWithTimers. Item count src bucket: 0 dst bucket: 0
2022/01/04 16:09:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithTimers stored in temp store"
}
2022/01/04 16:09:28 Waiting for app: TestKVRebOutWithTimers to get deployed
2022/01/04 16:09:33 Waiting for app: TestKVRebOutWithTimers to get deployed
2022/01/04 16:09:38 Waiting for app: TestKVRebOutWithTimers to get deployed
2022/01/04 16:09:43 Waiting for app: TestKVRebOutWithTimers to get deployed
2022/01/04 16:09:43 App: TestKVRebOutWithTimers got deployed
2022/01/04 16:09:43 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 16:09:43 Starting bucket ops to source bucket
2022/01/04 16:09:48 Rebalance progress: 12.5
2022/01/04 16:09:53 Rebalance progress: 12.5
2022/01/04 16:09:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:09:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:09:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:09:58 Waiting for src bucket item count to get to: 50000 curr count: 8195
2022/01/04 16:10:03 Waiting for src bucket item count to get to: 50000 curr count: 21781
2022/01/04 16:10:08 Waiting for src bucket item count to get to: 50000 curr count: 21781
2022/01/04 16:10:13 Waiting for src bucket item count to get to: 50000 curr count: 33730
2022/01/04 16:10:18 Waiting for src bucket item count to get to: 50000 curr count: 33730
2022/01/04 16:10:23 Waiting for src bucket item count to get to: 50000 curr count: 44581
2022/01/04 16:10:28 Waiting for src bucket item count to get to: 50000 curr count: 44581
2022/01/04 16:10:33 Waiting for src bucket item count to get to: 50000 curr count: 44581
2022/01/04 16:10:43 Waiting for dst bucket item count to get to: 50000 curr count: 38871
2022/01/04 16:10:48 Waiting for dst bucket item count to get to: 50000 curr count: 38871
2022/01/04 16:10:48 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/04 16:10:48 Post SET ops. Expected item count: 50000 got 50000
2022/01/04 16:10:48 Starting bucket ops to source bucket
2022/01/04 16:11:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:12:03 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:12:08 Waiting for dst bucket item count to get to: 0 curr count: 48875
2022/01/04 16:12:13 Waiting for dst bucket item count to get to: 0 curr count: 48875
2022/01/04 16:12:18 Waiting for dst bucket item count to get to: 0 curr count: 38912
2022/01/04 16:12:23 Waiting for dst bucket item count to get to: 0 curr count: 38912
2022/01/04 16:12:28 Waiting for dst bucket item count to get to: 0 curr count: 17489
2022/01/04 16:12:33 Waiting for dst bucket item count to get to: 0 curr count: 17489
2022/01/04 16:12:38 Waiting for dst bucket item count to get to: 0 curr count: 3626
2022/01/04 16:12:43 Waiting for dst bucket item count to get to: 0 curr count: 3626
2022/01/04 16:12:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:12:43 Post DELETE ops. Expected item count: 0 got 0
2022/01/04 16:12:48 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/01/04 16:12:53 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/01/04 16:12:58 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/01/04 16:13:03 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/01/04 16:13:03 App: TestKVRebOutWithTimers got un-deployed
2022/01/04 16:13:03 No eventing-con process running
2022/01/04 16:13:03 Function: TestKVRebOutWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithTimers deleting in background"
}
2022/01/04 16:13:05 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:13:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:13:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:13:12 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:13:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:13:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOutWithTimers (268.47s)
=== RUN   TestKVSwapRebWithTimers
2022/01/04 16:13:27 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/01/04 16:13:27 App: TestKVSwapRebWithTimers got un-deployed
2022/01/04 16:13:27 No eventing-con process running
2022/01/04 16:13:27 Function: TestKVSwapRebWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVSwapRebWithTimers not found"
}
2022/01/04 16:13:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:13:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:13:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:13:35 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:13:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:13:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:13:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:13:45 Deploying app: TestKVSwapRebWithTimers. Item count src bucket: 0 dst bucket: 0
2022/01/04 16:13:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithTimers stored in temp store"
}
2022/01/04 16:13:51 Waiting for app: TestKVSwapRebWithTimers to get deployed
2022/01/04 16:13:56 Waiting for app: TestKVSwapRebWithTimers to get deployed
2022/01/04 16:14:01 Waiting for app: TestKVSwapRebWithTimers to get deployed
2022/01/04 16:14:06 Waiting for app: TestKVSwapRebWithTimers to get deployed
2022/01/04 16:14:06 App: TestKVSwapRebWithTimers got deployed
2022/01/04 16:14:06 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 16:14:06 Starting bucket ops to source bucket
2022/01/04 16:14:07 Removing node(s): [] from the cluster
2022/01/04 16:14:12 Rebalance progress: 12.5
2022/01/04 16:14:17 Rebalance progress: 12.5
2022/01/04 16:14:22 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:14:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:14:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:14:22 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/04 16:14:23 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 16:14:28 Rebalance progress: 12.5
2022/01/04 16:14:33 Rebalance progress: 12.5
2022/01/04 16:14:38 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:14:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:14:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:14:38 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 16:14:43 Rebalance progress: 12.5
2022/01/04 16:14:48 Rebalance progress: 12.5
2022/01/04 16:14:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:14:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:14:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:14:53 Waiting for src bucket item count to get to: 50000 curr count: 48430
2022/01/04 16:14:58 Waiting for src bucket item count to get to: 50000 curr count: 48430
2022/01/04 16:15:08 Waiting for dst bucket item count to get to: 50000 curr count: 47154
2022/01/04 16:15:13 Waiting for dst bucket item count to get to: 50000 curr count: 47154
2022/01/04 16:15:13 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/04 16:15:13 Post SET ops. Expected item count: 50000 got 50000
2022/01/04 16:15:13 Starting bucket ops to source bucket
2022/01/04 16:16:22 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:16:27 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:16:32 Waiting for dst bucket item count to get to: 0 curr count: 46897
2022/01/04 16:16:37 Waiting for dst bucket item count to get to: 0 curr count: 46897
2022/01/04 16:16:42 Waiting for dst bucket item count to get to: 0 curr count: 38536
2022/01/04 16:16:47 Waiting for dst bucket item count to get to: 0 curr count: 38536
2022/01/04 16:16:52 Waiting for dst bucket item count to get to: 0 curr count: 25640
2022/01/04 16:16:57 Waiting for dst bucket item count to get to: 0 curr count: 25640
2022/01/04 16:17:02 Waiting for dst bucket item count to get to: 0 curr count: 2297
2022/01/04 16:17:07 Waiting for dst bucket item count to get to: 0 curr count: 2297
2022/01/04 16:17:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:17:07 Post DELETE ops. Expected item count: 0 got 0
2022/01/04 16:17:13 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/01/04 16:17:18 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/01/04 16:17:23 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/01/04 16:17:28 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/01/04 16:17:33 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/01/04 16:17:33 App: TestKVSwapRebWithTimers got un-deployed
2022/01/04 16:17:33 No eventing-con process running
2022/01/04 16:17:33 Function: TestKVSwapRebWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithTimers deleting in background"
}
2022/01/04 16:17:35 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:17:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:17:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:17:41 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:17:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:17:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebWithTimers (269.94s)
=== RUN   TestDuplicateTimerCreationEventingRebIn
2022/01/04 16:17:57 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/04 16:17:57 App: TestDuplicateTimerCreationEventingRebIn got un-deployed
2022/01/04 16:17:57 No eventing-con process running
2022/01/04 16:17:57 Function: TestDuplicateTimerCreationEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingRebIn not found"
}
2022/01/04 16:17:58 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:18:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:18:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:18:05 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:18:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:18:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:18:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:18:15 Deploying app: TestDuplicateTimerCreationEventingRebIn. Item count src bucket: 0 dst bucket: 0
2022/01/04 16:18:16 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebIn stored in temp store"
}
2022/01/04 16:18:21 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2022/01/04 16:18:26 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2022/01/04 16:18:31 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2022/01/04 16:18:36 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2022/01/04 16:18:36 App: TestDuplicateTimerCreationEventingRebIn got deployed
2022/01/04 16:18:36 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 16:18:36 Starting bucket ops to source bucket
2022/01/04 16:18:37 Removing node(s): [] from the cluster
2022/01/04 16:18:42 Rebalance progress: 12.5
2022/01/04 16:18:47 Rebalance progress: 12.5
2022/01/04 16:18:52 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:18:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:18:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:18:52 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 16:18:57 Rebalance progress: 12.5
2022/01/04 16:19:02 Rebalance progress: 12.5
2022/01/04 16:19:07 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:19:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:19:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:19:07 Waiting for src bucket item count to get to: 50000 curr count: 30186
2022/01/04 16:19:12 Waiting for src bucket item count to get to: 50000 curr count: 41763
2022/01/04 16:19:17 Waiting for src bucket item count to get to: 50000 curr count: 41763
2022/01/04 16:19:27 Waiting for dst bucket item count to get to: 50000 curr count: 27913
2022/01/04 16:19:32 Waiting for dst bucket item count to get to: 50000 curr count: 27913
2022/01/04 16:19:37 Waiting for dst bucket item count to get to: 50000 curr count: 36211
2022/01/04 16:19:42 Waiting for dst bucket item count to get to: 50000 curr count: 36211
2022/01/04 16:19:47 Waiting for dst bucket item count to get to: 50000 curr count: 46724
2022/01/04 16:19:52 Waiting for dst bucket item count to get to: 50000 curr count: 46724
2022/01/04 16:19:52 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/04 16:19:52 Post SET ops. Expected item count: 50000 got 50000
2022/01/04 16:19:57 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/04 16:20:02 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/04 16:20:08 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/04 16:20:13 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/04 16:20:18 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/04 16:20:23 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/04 16:20:23 App: TestDuplicateTimerCreationEventingRebIn got un-deployed
2022/01/04 16:20:23 No eventing-con process running
2022/01/04 16:20:23 Function: TestDuplicateTimerCreationEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebIn deleting in background"
}
2022/01/04 16:20:24 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:20:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:20:34 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:20:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:20:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:20:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:20:46 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:20:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingRebIn (179.71s)
=== RUN   TestDuplicateTimerCreationEventingRebOut
2022/01/04 16:20:51 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 16:20:51 Removing node(s): [] from the cluster
2022/01/04 16:20:57 Rebalance progress: 100
2022/01/04 16:21:02 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/01/04 16:21:02 App: TestDuplicateTimerCreationEventingRebOut got un-deployed
2022/01/04 16:21:02 No eventing-con process running
2022/01/04 16:21:02 Function: TestDuplicateTimerCreationEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingRebOut not found"
}
2022/01/04 16:21:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:21:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:21:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:21:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:21:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:21:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:21:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:21:20 Deploying app: TestDuplicateTimerCreationEventingRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/04 16:21:21 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebOut stored in temp store"
}
2022/01/04 16:21:26 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2022/01/04 16:21:31 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2022/01/04 16:21:36 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2022/01/04 16:21:41 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2022/01/04 16:21:41 App: TestDuplicateTimerCreationEventingRebOut got deployed
2022/01/04 16:21:41 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 16:21:41 Starting bucket ops to source bucket
2022/01/04 16:21:46 Rebalance progress: 12.5
2022/01/04 16:21:51 Rebalance progress: 12.5
2022/01/04 16:21:56 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:21:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:21:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:21:56 Waiting for src bucket item count to get to: 50000 curr count: 9929
2022/01/04 16:22:01 Waiting for src bucket item count to get to: 50000 curr count: 24007
2022/01/04 16:22:06 Waiting for src bucket item count to get to: 50000 curr count: 24007
2022/01/04 16:22:11 Waiting for src bucket item count to get to: 50000 curr count: 35792
2022/01/04 16:22:16 Waiting for src bucket item count to get to: 50000 curr count: 35792
2022/01/04 16:22:21 Waiting for src bucket item count to get to: 50000 curr count: 45021
2022/01/04 16:22:26 Waiting for src bucket item count to get to: 50000 curr count: 45021
2022/01/04 16:22:31 Waiting for src bucket item count to get to: 50000 curr count: 45021
2022/01/04 16:22:41 Waiting for dst bucket item count to get to: 50000 curr count: 33791
2022/01/04 16:22:46 Waiting for dst bucket item count to get to: 50000 curr count: 33791
2022/01/04 16:22:51 Waiting for dst bucket item count to get to: 50000 curr count: 47975
2022/01/04 16:22:56 Waiting for dst bucket item count to get to: 50000 curr count: 47975
2022/01/04 16:22:56 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/04 16:22:56 Post SET ops. Expected item count: 50000 got 50000
2022/01/04 16:23:02 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/01/04 16:23:07 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/01/04 16:23:12 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/01/04 16:23:17 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/01/04 16:23:22 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/01/04 16:23:22 App: TestDuplicateTimerCreationEventingRebOut got un-deployed
2022/01/04 16:23:22 No eventing-con process running
2022/01/04 16:23:22 Function: TestDuplicateTimerCreationEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebOut deleting in background"
}
2022/01/04 16:23:24 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:23:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:23:34 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:23:39 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:23:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:23:41 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:23:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:23:51 Waiting for dst bucket item count to get to: 0 curr count: 30843
2022/01/04 16:23:56 Waiting for dst bucket item count to get to: 0 curr count: 30843
2022/01/04 16:23:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingRebOut (189.33s)
=== RUN   TestDuplicateTimerCreationEventingSwapReb
2022/01/04 16:24:06 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/01/04 16:24:06 App: TestDuplicateTimerCreationEventingSwapReb got un-deployed
2022/01/04 16:24:06 No eventing-con process running
2022/01/04 16:24:06 Function: TestDuplicateTimerCreationEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingSwapReb not found"
}
2022/01/04 16:24:07 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:24:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:24:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:24:14 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:24:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:24:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:24:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:24:24 Deploying app: TestDuplicateTimerCreationEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2022/01/04 16:24:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingSwapReb stored in temp store"
}
2022/01/04 16:24:30 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2022/01/04 16:24:35 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2022/01/04 16:24:40 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2022/01/04 16:24:45 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2022/01/04 16:24:45 App: TestDuplicateTimerCreationEventingSwapReb got deployed
2022/01/04 16:24:45 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 16:24:45 Starting bucket ops to source bucket
2022/01/04 16:24:46 Removing node(s): [] from the cluster
2022/01/04 16:24:51 Rebalance progress: 12.5
2022/01/04 16:24:56 Rebalance progress: 12.5
2022/01/04 16:25:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:25:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:25:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:25:01 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 16:25:01 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 16:25:06 Rebalance progress: 12.5
2022/01/04 16:25:11 Rebalance progress: 12.5
2022/01/04 16:25:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:25:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:25:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:25:16 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 16:25:21 Rebalance progress: 12.5
2022/01/04 16:25:26 Rebalance progress: 12.5
2022/01/04 16:25:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:25:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:25:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:25:36 Waiting for dst bucket item count to get to: 50000 curr count: 31607
2022/01/04 16:25:41 Waiting for dst bucket item count to get to: 50000 curr count: 31607
2022/01/04 16:25:46 Waiting for dst bucket item count to get to: 50000 curr count: 37776
2022/01/04 16:25:51 Waiting for dst bucket item count to get to: 50000 curr count: 37776
2022/01/04 16:25:51 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/04 16:25:51 Post SET ops. Expected item count: 50000 got 50000
2022/01/04 16:25:56 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/01/04 16:26:01 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/01/04 16:26:07 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/01/04 16:26:12 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/01/04 16:26:17 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/01/04 16:26:22 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/01/04 16:26:22 App: TestDuplicateTimerCreationEventingSwapReb got un-deployed
2022/01/04 16:26:22 No eventing-con process running
2022/01/04 16:26:22 Function: TestDuplicateTimerCreationEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingSwapReb deleting in background"
}
2022/01/04 16:26:23 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:26:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:26:33 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:26:38 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:26:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:26:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:26:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:26:50 Waiting for dst bucket item count to get to: 0 curr count: 17672
2022/01/04 16:26:55 Waiting for dst bucket item count to get to: 0 curr count: 17672
2022/01/04 16:26:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingSwapReb (179.72s)
=== RUN   TestDuplicateTimerCreationKVRebIn
2022/01/04 16:27:05 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/01/04 16:27:05 App: TestDuplicateTimerCreationKVRebIn got un-deployed
2022/01/04 16:27:05 No eventing-con process running
2022/01/04 16:27:05 Function: TestDuplicateTimerCreationKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVRebIn not found"
}
2022/01/04 16:27:07 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:27:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:27:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:27:14 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:27:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:27:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:27:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:27:24 Deploying app: TestDuplicateTimerCreationKVRebIn. Item count src bucket: 0 dst bucket: 0
2022/01/04 16:27:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebIn stored in temp store"
}
2022/01/04 16:27:30 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2022/01/04 16:27:35 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2022/01/04 16:27:40 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2022/01/04 16:27:45 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2022/01/04 16:27:45 App: TestDuplicateTimerCreationKVRebIn got deployed
2022/01/04 16:27:45 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 16:27:45 Starting bucket ops to source bucket
2022/01/04 16:27:45 Removing node(s): [] from the cluster
2022/01/04 16:27:50 Rebalance progress: 12.5
2022/01/04 16:27:55 Rebalance progress: 12.5
2022/01/04 16:28:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:28:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:28:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:28:00 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 16:28:05 Rebalance progress: 12.5
2022/01/04 16:28:10 Rebalance progress: 12.5
2022/01/04 16:28:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:28:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:28:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:28:15 Waiting for src bucket item count to get to: 50000 curr count: 30338
2022/01/04 16:28:21 Waiting for src bucket item count to get to: 50000 curr count: 41413
2022/01/04 16:28:26 Waiting for src bucket item count to get to: 50000 curr count: 41413
2022/01/04 16:28:36 Waiting for dst bucket item count to get to: 50000 curr count: 33561
2022/01/04 16:28:41 Waiting for dst bucket item count to get to: 50000 curr count: 33561
2022/01/04 16:28:46 Waiting for dst bucket item count to get to: 50000 curr count: 40360
2022/01/04 16:28:51 Waiting for dst bucket item count to get to: 50000 curr count: 40360
2022/01/04 16:28:51 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/04 16:28:51 Post SET ops. Expected item count: 50000 got 50000
2022/01/04 16:28:56 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/01/04 16:29:01 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/01/04 16:29:06 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/01/04 16:29:11 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/01/04 16:29:16 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/01/04 16:29:16 App: TestDuplicateTimerCreationKVRebIn got un-deployed
2022/01/04 16:29:16 No eventing-con process running
2022/01/04 16:29:16 Function: TestDuplicateTimerCreationKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebIn deleting in background"
}
2022/01/04 16:29:18 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:29:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:29:28 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:29:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:29:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:29:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:29:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVRebIn (159.33s)
=== RUN   TestDuplicateTimerCreationKVRebOut
2022/01/04 16:29:40 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 16:29:40 Removing node(s): [] from the cluster
2022/01/04 16:29:45 Rebalance progress: 100
2022/01/04 16:29:50 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/01/04 16:29:50 App: TestDuplicateTimerCreationKVRebOut got un-deployed
2022/01/04 16:29:50 No eventing-con process running
2022/01/04 16:29:50 Function: TestDuplicateTimerCreationKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVRebOut not found"
}
2022/01/04 16:29:52 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:29:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:29:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:29:59 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:30:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:30:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:30:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:30:09 Deploying app: TestDuplicateTimerCreationKVRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/04 16:30:10 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebOut stored in temp store"
}
2022/01/04 16:30:15 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2022/01/04 16:30:20 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2022/01/04 16:30:25 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2022/01/04 16:30:30 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2022/01/04 16:30:30 App: TestDuplicateTimerCreationKVRebOut got deployed
2022/01/04 16:30:30 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 16:30:30 Starting bucket ops to source bucket
2022/01/04 16:30:35 Rebalance progress: 12.5
2022/01/04 16:30:40 Rebalance progress: 12.5
2022/01/04 16:30:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:30:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:30:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:30:45 Waiting for src bucket item count to get to: 50000 curr count: 11975
2022/01/04 16:30:50 Waiting for src bucket item count to get to: 50000 curr count: 25922
2022/01/04 16:30:55 Waiting for src bucket item count to get to: 50000 curr count: 25922
2022/01/04 16:31:00 Waiting for src bucket item count to get to: 50000 curr count: 38346
2022/01/04 16:31:05 Waiting for src bucket item count to get to: 50000 curr count: 38346
2022/01/04 16:31:10 Waiting for src bucket item count to get to: 50000 curr count: 38346
2022/01/04 16:31:15 Waiting for src bucket item count to get to: 50000 curr count: 48434
2022/01/04 16:31:20 Waiting for src bucket item count to get to: 50000 curr count: 48434
2022/01/04 16:31:30 Waiting for dst bucket item count to get to: 50000 curr count: 33670
2022/01/04 16:31:35 Waiting for dst bucket item count to get to: 50000 curr count: 33670
2022/01/04 16:31:40 Waiting for dst bucket item count to get to: 50000 curr count: 44316
2022/01/04 16:31:45 Waiting for dst bucket item count to get to: 50000 curr count: 44316
2022/01/04 16:31:45 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/04 16:31:45 Post SET ops. Expected item count: 50000 got 50000
2022/01/04 16:31:50 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/01/04 16:31:56 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/01/04 16:32:01 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/01/04 16:32:06 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/01/04 16:32:11 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/01/04 16:32:11 App: TestDuplicateTimerCreationKVRebOut got un-deployed
2022/01/04 16:32:11 No eventing-con process running
2022/01/04 16:32:11 Function: TestDuplicateTimerCreationKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebOut deleting in background"
}
2022/01/04 16:32:13 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:32:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:32:23 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:32:28 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:32:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:32:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:32:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:32:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVRebOut (179.94s)
=== RUN   TestDuplicateTimerCreationKVSwapReb
2022/01/04 16:32:45 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/01/04 16:32:45 App: TestDuplicateTimerCreationKVSwapReb got un-deployed
2022/01/04 16:32:45 No eventing-con process running
2022/01/04 16:32:45 Function: TestDuplicateTimerCreationKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVSwapReb not found"
}
2022/01/04 16:32:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:32:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:32:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:32:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:32:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:32:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:33:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:33:03 Deploying app: TestDuplicateTimerCreationKVSwapReb. Item count src bucket: 0 dst bucket: 0
2022/01/04 16:33:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVSwapReb stored in temp store"
}
2022/01/04 16:33:09 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2022/01/04 16:33:14 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2022/01/04 16:33:19 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2022/01/04 16:33:24 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2022/01/04 16:33:24 App: TestDuplicateTimerCreationKVSwapReb got deployed
2022/01/04 16:33:24 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 16:33:24 Starting bucket ops to source bucket
2022/01/04 16:33:25 Removing node(s): [] from the cluster
2022/01/04 16:33:30 Rebalance progress: 12.5
2022/01/04 16:33:35 Rebalance progress: 12.5
2022/01/04 16:33:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:33:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:33:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:33:40 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/04 16:33:40 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 16:33:45 Rebalance progress: 12.5
2022/01/04 16:33:50 Rebalance progress: 12.5
2022/01/04 16:33:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:33:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:33:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:33:55 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 16:34:00 Rebalance progress: 12.5
2022/01/04 16:34:05 Rebalance progress: 12.5
2022/01/04 16:34:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:34:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:34:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:34:10 Waiting for src bucket item count to get to: 50000 curr count: 42226
2022/01/04 16:34:20 Waiting for dst bucket item count to get to: 50000 curr count: 30165
2022/01/04 16:34:25 Waiting for dst bucket item count to get to: 50000 curr count: 30165
2022/01/04 16:34:30 Waiting for dst bucket item count to get to: 50000 curr count: 35854
2022/01/04 16:34:30 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/04 16:34:30 Post SET ops. Expected item count: 50000 got 50000
2022/01/04 16:34:36 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/01/04 16:34:41 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/01/04 16:34:46 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/01/04 16:34:51 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/01/04 16:34:56 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/01/04 16:35:01 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/01/04 16:35:01 App: TestDuplicateTimerCreationKVSwapReb got un-deployed
2022/01/04 16:35:01 No eventing-con process running
2022/01/04 16:35:01 Function: TestDuplicateTimerCreationKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVSwapReb deleting in background"
}
2022/01/04 16:35:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:35:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:35:13 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:35:18 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:35:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:35:20 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:35:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:35:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVSwapReb (170.01s)
=== RUN   TestDuplicateTimerFiringEventingRebIn
2022/01/04 16:35:35 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/01/04 16:35:35 App: TestDuplicateTimerFiringEventingRebIn got un-deployed
2022/01/04 16:35:35 No eventing-con process running
2022/01/04 16:35:35 Function: TestDuplicateTimerFiringEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingRebIn not found"
}
2022/01/04 16:35:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:35:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:35:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:35:43 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:35:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:35:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:35:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:35:53 Deploying app: TestDuplicateTimerFiringEventingRebIn. Item count src bucket: 0 dst bucket: 0
2022/01/04 16:35:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebIn stored in temp store"
}
2022/01/04 16:35:59 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2022/01/04 16:36:04 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2022/01/04 16:36:09 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2022/01/04 16:36:14 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2022/01/04 16:36:14 App: TestDuplicateTimerFiringEventingRebIn got deployed
2022/01/04 16:36:14 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 16:36:14 Starting bucket ops to source bucket
2022/01/04 16:36:15 Removing node(s): [] from the cluster
2022/01/04 16:36:20 Rebalance progress: 12.5
2022/01/04 16:36:25 Rebalance progress: 12.5
2022/01/04 16:36:30 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:36:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:36:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:36:30 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 16:36:35 Rebalance progress: 12.5
2022/01/04 16:36:40 Rebalance progress: 12.5
2022/01/04 16:36:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:36:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:36:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:36:46 Waiting for src bucket item count to get to: 50000 curr count: 31117
2022/01/04 16:36:51 Waiting for src bucket item count to get to: 50000 curr count: 31117
2022/01/04 16:36:56 Waiting for src bucket item count to get to: 50000 curr count: 42179
2022/01/04 16:37:01 Waiting for src bucket item count to get to: 50000 curr count: 42179
2022/01/04 16:37:11 Waiting for dst bucket item count to get to: 50000 curr count: 34465
2022/01/04 16:37:16 Waiting for dst bucket item count to get to: 50000 curr count: 34465
2022/01/04 16:37:21 Waiting for dst bucket item count to get to: 50000 curr count: 41702
2022/01/04 16:37:21 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/04 16:37:21 Post SET ops. Expected item count: 50000 got 50000
2022/01/04 16:37:26 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/01/04 16:37:31 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/01/04 16:37:36 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/01/04 16:37:41 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/01/04 16:37:46 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/01/04 16:37:46 App: TestDuplicateTimerFiringEventingRebIn got un-deployed
2022/01/04 16:37:46 No eventing-con process running
2022/01/04 16:37:46 Function: TestDuplicateTimerFiringEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebIn deleting in background"
}
2022/01/04 16:37:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:37:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:37:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:37:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:38:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:38:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:38:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingRebIn (160.10s)
=== RUN   TestDuplicateTimerFiringEventingRebOut
2022/01/04 16:38:10 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 16:38:10 Removing node(s): [] from the cluster
2022/01/04 16:38:15 Rebalance progress: 100
2022/01/04 16:38:20 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/01/04 16:38:20 App: TestDuplicateTimerFiringEventingRebOut got un-deployed
2022/01/04 16:38:20 No eventing-con process running
2022/01/04 16:38:20 Function: TestDuplicateTimerFiringEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingRebOut not found"
}
2022/01/04 16:38:22 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:38:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:38:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:38:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:38:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:38:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:38:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:38:38 Deploying app: TestDuplicateTimerFiringEventingRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/04 16:38:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebOut stored in temp store"
}
2022/01/04 16:38:45 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2022/01/04 16:38:50 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2022/01/04 16:38:55 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2022/01/04 16:39:00 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2022/01/04 16:39:00 App: TestDuplicateTimerFiringEventingRebOut got deployed
2022/01/04 16:39:00 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 16:39:00 Starting bucket ops to source bucket
2022/01/04 16:39:05 Rebalance progress: 12.5
2022/01/04 16:39:10 Rebalance progress: 12.5
2022/01/04 16:39:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:39:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:39:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:39:15 Waiting for src bucket item count to get to: 50000 curr count: 13323
2022/01/04 16:39:20 Waiting for src bucket item count to get to: 50000 curr count: 13323
2022/01/04 16:39:25 Waiting for src bucket item count to get to: 50000 curr count: 26129
2022/01/04 16:39:30 Waiting for src bucket item count to get to: 50000 curr count: 26129
2022/01/04 16:39:35 Waiting for src bucket item count to get to: 50000 curr count: 35364
2022/01/04 16:39:40 Waiting for src bucket item count to get to: 50000 curr count: 47141
2022/01/04 16:39:45 Waiting for src bucket item count to get to: 50000 curr count: 47141
2022/01/04 16:39:50 Waiting for src bucket item count to get to: 50000 curr count: 47141
2022/01/04 16:40:00 Waiting for dst bucket item count to get to: 50000 curr count: 43369
2022/01/04 16:40:05 Waiting for dst bucket item count to get to: 50000 curr count: 43369
2022/01/04 16:40:05 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/04 16:40:05 Post SET ops. Expected item count: 50000 got 50000
2022/01/04 16:40:10 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/01/04 16:40:15 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/01/04 16:40:20 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/01/04 16:40:25 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/01/04 16:40:31 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/01/04 16:40:31 App: TestDuplicateTimerFiringEventingRebOut got un-deployed
2022/01/04 16:40:31 No eventing-con process running
2022/01/04 16:40:31 Function: TestDuplicateTimerFiringEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebOut deleting in background"
}
2022/01/04 16:40:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:40:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:40:42 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:40:47 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:40:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:40:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:40:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:40:59 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:40:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingRebOut (174.43s)
=== RUN   TestDuplicateTimerFiringEventingSwapReb
2022/01/04 16:41:09 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/01/04 16:41:09 App: TestDuplicateTimerFiringEventingSwapReb got un-deployed
2022/01/04 16:41:09 No eventing-con process running
2022/01/04 16:41:09 Function: TestDuplicateTimerFiringEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingSwapReb not found"
}
2022/01/04 16:41:11 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:41:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:41:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:41:18 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:41:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:41:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:41:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:41:28 Deploying app: TestDuplicateTimerFiringEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2022/01/04 16:41:29 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingSwapReb stored in temp store"
}
2022/01/04 16:41:34 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2022/01/04 16:41:39 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2022/01/04 16:41:44 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2022/01/04 16:41:49 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2022/01/04 16:41:49 App: TestDuplicateTimerFiringEventingSwapReb got deployed
2022/01/04 16:41:49 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/04 16:41:49 Starting bucket ops to source bucket
2022/01/04 16:41:49 Removing node(s): [] from the cluster
2022/01/04 16:41:54 Rebalance progress: 12.5
2022/01/04 16:41:59 Rebalance progress: 12.5
2022/01/04 16:42:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:42:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:42:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:42:04 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 16:42:05 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 16:42:10 Rebalance progress: 12.5
2022/01/04 16:42:15 Rebalance progress: 12.5
2022/01/04 16:42:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:42:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:42:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:42:20 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 16:42:25 Rebalance progress: 12.5
2022/01/04 16:42:30 Rebalance progress: 12.5
2022/01/04 16:42:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:42:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:42:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:42:35 Waiting for src bucket item count to get to: 50000 curr count: 47791
2022/01/04 16:42:40 Waiting for src bucket item count to get to: 50000 curr count: 47791
2022/01/04 16:42:50 Waiting for dst bucket item count to get to: 50000 curr count: 43627
2022/01/04 16:42:55 Waiting for dst bucket item count to get to: 50000 curr count: 43627
2022/01/04 16:42:55 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/04 16:42:55 Post SET ops. Expected item count: 50000 got 50000
2022/01/04 16:43:00 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/01/04 16:43:05 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/01/04 16:43:10 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/01/04 16:43:16 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/01/04 16:43:21 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/01/04 16:43:21 App: TestDuplicateTimerFiringEventingSwapReb got un-deployed
2022/01/04 16:43:21 No eventing-con process running
2022/01/04 16:43:21 Function: TestDuplicateTimerFiringEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingSwapReb deleting in background"
}
2022/01/04 16:43:22 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:43:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:43:32 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:43:37 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:43:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:43:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:43:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:43:49 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:43:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingSwapReb (170.17s)
=== RUN   TestDuplicateTimerFiringKVRebIn
2022/01/04 16:43:59 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/01/04 16:43:59 App: TestDuplicateTimerFiringKVRebIn got un-deployed
2022/01/04 16:43:59 No eventing-con process running
2022/01/04 16:43:59 Function: TestDuplicateTimerFiringKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVRebIn not found"
}
2022/01/04 16:44:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:44:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:44:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:44:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:44:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:44:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:44:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:44:18 Deploying app: TestDuplicateTimerFiringKVRebIn. Item count src bucket: 0 dst bucket: 0
2022/01/04 16:44:19 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebIn stored in temp store"
}
2022/01/04 16:44:24 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2022/01/04 16:44:29 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2022/01/04 16:44:34 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2022/01/04 16:44:39 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2022/01/04 16:44:39 App: TestDuplicateTimerFiringKVRebIn got deployed
2022/01/04 16:44:39 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 16:44:39 Starting bucket ops to source bucket
2022/01/04 16:44:39 Removing node(s): [] from the cluster
2022/01/04 16:44:44 Rebalance progress: 12.5
2022/01/04 16:44:49 Rebalance progress: 12.5
2022/01/04 16:44:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:44:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:44:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:44:54 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 16:45:00 Rebalance progress: 12.5
2022/01/04 16:45:05 Rebalance progress: 12.5
2022/01/04 16:45:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:45:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:45:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:45:10 Waiting for src bucket item count to get to: 50000 curr count: 27421
2022/01/04 16:45:15 Waiting for src bucket item count to get to: 50000 curr count: 37066
2022/01/04 16:45:20 Waiting for src bucket item count to get to: 50000 curr count: 37066
2022/01/04 16:45:25 Waiting for src bucket item count to get to: 50000 curr count: 49073
2022/01/04 16:45:30 Waiting for src bucket item count to get to: 50000 curr count: 49073
2022/01/04 16:45:40 Waiting for dst bucket item count to get to: 50000 curr count: 42201
2022/01/04 16:45:45 Waiting for dst bucket item count to get to: 50000 curr count: 42201
2022/01/04 16:45:45 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/04 16:45:45 Post SET ops. Expected item count: 50000 got 50000
2022/01/04 16:45:50 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/01/04 16:45:55 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/01/04 16:46:00 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/01/04 16:46:05 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/01/04 16:46:11 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/01/04 16:46:11 App: TestDuplicateTimerFiringKVRebIn got un-deployed
2022/01/04 16:46:11 No eventing-con process running
2022/01/04 16:46:11 Function: TestDuplicateTimerFiringKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebIn deleting in background"
}
2022/01/04 16:46:12 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:46:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:46:22 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:46:27 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:46:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:46:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:46:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:46:39 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:46:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVRebIn (169.84s)
=== RUN   TestDuplicateTimerFiringKVRebOut
2022/01/04 16:46:44 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 16:46:44 Removing node(s): [] from the cluster
2022/01/04 16:46:49 Rebalance progress: 100
2022/01/04 16:46:54 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/01/04 16:46:54 App: TestDuplicateTimerFiringKVRebOut got un-deployed
2022/01/04 16:46:54 No eventing-con process running
2022/01/04 16:46:54 Function: TestDuplicateTimerFiringKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVRebOut not found"
}
2022/01/04 16:46:56 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:47:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:47:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:47:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:47:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:47:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:47:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:47:13 Deploying app: TestDuplicateTimerFiringKVRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/04 16:47:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebOut stored in temp store"
}
2022/01/04 16:47:19 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2022/01/04 16:47:24 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2022/01/04 16:47:29 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2022/01/04 16:47:34 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2022/01/04 16:47:34 App: TestDuplicateTimerFiringKVRebOut got deployed
2022/01/04 16:47:34 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 16:47:34 Starting bucket ops to source bucket
2022/01/04 16:47:39 Rebalance progress: 12.5
2022/01/04 16:47:44 Rebalance progress: 12.5
2022/01/04 16:47:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:47:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:47:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:47:49 Waiting for src bucket item count to get to: 50000 curr count: 6433
2022/01/04 16:47:54 Waiting for src bucket item count to get to: 50000 curr count: 20385
2022/01/04 16:47:59 Waiting for src bucket item count to get to: 50000 curr count: 20385
2022/01/04 16:48:04 Waiting for src bucket item count to get to: 50000 curr count: 31974
2022/01/04 16:48:09 Waiting for src bucket item count to get to: 50000 curr count: 31974
2022/01/04 16:48:14 Waiting for src bucket item count to get to: 50000 curr count: 43163
2022/01/04 16:48:19 Waiting for src bucket item count to get to: 50000 curr count: 43163
2022/01/04 16:48:24 Waiting for src bucket item count to get to: 50000 curr count: 43163
2022/01/04 16:48:34 Waiting for dst bucket item count to get to: 50000 curr count: 36086
2022/01/04 16:48:39 Waiting for dst bucket item count to get to: 50000 curr count: 36086
2022/01/04 16:48:44 Waiting for dst bucket item count to get to: 50000 curr count: 43895
2022/01/04 16:48:49 Waiting for dst bucket item count to get to: 50000 curr count: 43895
2022/01/04 16:48:49 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/04 16:48:49 Post SET ops. Expected item count: 50000 got 50000
2022/01/04 16:48:54 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/01/04 16:48:59 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/01/04 16:49:05 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/01/04 16:49:10 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/01/04 16:49:15 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/01/04 16:49:15 App: TestDuplicateTimerFiringKVRebOut got un-deployed
2022/01/04 16:49:15 No eventing-con process running
2022/01/04 16:49:15 Function: TestDuplicateTimerFiringKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebOut deleting in background"
}
2022/01/04 16:49:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:49:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:49:27 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:49:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:49:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:49:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:49:39 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:49:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVRebOut (179.50s)
=== RUN   TestDuplicateTimerFiringKVSwapReb
2022/01/04 16:49:49 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/01/04 16:49:49 App: TestDuplicateTimerFiringKVSwapReb got un-deployed
2022/01/04 16:49:49 No eventing-con process running
2022/01/04 16:49:49 Function: TestDuplicateTimerFiringKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVSwapReb not found"
}
2022/01/04 16:49:50 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:49:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:49:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:49:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:50:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:50:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:50:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:50:07 Deploying app: TestDuplicateTimerFiringKVSwapReb. Item count src bucket: 0 dst bucket: 0
2022/01/04 16:50:08 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVSwapReb stored in temp store"
}
2022/01/04 16:50:13 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2022/01/04 16:50:18 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2022/01/04 16:50:23 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2022/01/04 16:50:28 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2022/01/04 16:50:28 App: TestDuplicateTimerFiringKVSwapReb got deployed
2022/01/04 16:50:28 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 16:50:28 Starting bucket ops to source bucket
2022/01/04 16:50:29 Removing node(s): [] from the cluster
2022/01/04 16:50:34 Rebalance progress: 12.5
2022/01/04 16:50:39 Rebalance progress: 12.5
2022/01/04 16:50:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:50:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:50:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:50:44 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/04 16:50:45 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 16:50:50 Rebalance progress: 12.5
2022/01/04 16:50:55 Rebalance progress: 12.5
2022/01/04 16:51:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:51:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:51:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:51:00 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 16:51:05 Rebalance progress: 12.5
2022/01/04 16:51:10 Rebalance progress: 12.5
2022/01/04 16:51:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:51:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:51:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:51:15 Waiting for src bucket item count to get to: 50000 curr count: 48253
2022/01/04 16:51:20 Waiting for src bucket item count to get to: 50000 curr count: 48253
2022/01/04 16:51:30 Waiting for dst bucket item count to get to: 50000 curr count: 40157
2022/01/04 16:51:35 Waiting for dst bucket item count to get to: 50000 curr count: 40157
2022/01/04 16:51:40 Waiting for dst bucket item count to get to: 50000 curr count: 48648
2022/01/04 16:51:45 Waiting for dst bucket item count to get to: 50000 curr count: 48648
2022/01/04 16:51:45 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/04 16:51:45 Post SET ops. Expected item count: 50000 got 50000
2022/01/04 16:51:50 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/01/04 16:51:55 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/01/04 16:52:01 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/01/04 16:52:06 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/01/04 16:52:11 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/01/04 16:52:11 App: TestDuplicateTimerFiringKVSwapReb got un-deployed
2022/01/04 16:52:11 No eventing-con process running
2022/01/04 16:52:11 Function: TestDuplicateTimerFiringKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVSwapReb deleting in background"
}
2022/01/04 16:52:13 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:52:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:52:23 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:52:28 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/04 16:52:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:52:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:52:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:52:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVSwapReb (175.78s)
=== RUN   TestKVRebOnUpdateBucketOpOneByOne
2022/01/04 16:52:44 Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 16:52:44 App: bucket_op_on_update got un-deployed
2022/01/04 16:52:44 No eventing-con process running
2022/01/04 16:52:44 Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/04 16:52:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:52:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:52:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:52:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:52:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:52:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:53:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:53:03 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 16:53:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/04 16:53:09 Starting bucket ops to source bucket
2022/01/04 16:53:14 Waiting for app: bucket_op_on_update to get deployed
2022/01/04 16:53:19 Waiting for app: bucket_op_on_update to get deployed
2022/01/04 16:53:24 Waiting for app: bucket_op_on_update to get deployed
2022/01/04 16:53:24 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:53:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:53:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:53:24 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 16:53:24 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 16:53:29 Rebalance progress: 12.5
2022/01/04 16:53:34 Rebalance progress: 12.5
2022/01/04 16:53:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:53:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:53:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:53:39 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/04 16:53:40 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 16:53:45 Rebalance progress: 12.5
2022/01/04 16:53:50 Rebalance progress: 12.5
2022/01/04 16:53:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:53:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:53:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:53:55 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2022/01/04 16:53:55 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 16:54:00 Rebalance progress: 12.5
2022/01/04 16:54:05 Rebalance progress: 12.5
2022/01/04 16:54:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:54:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:54:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:54:10 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 16:54:15 Rebalance progress: 12.5
2022/01/04 16:54:20 Rebalance progress: 12.5
2022/01/04 16:54:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:54:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:54:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:54:25 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 16:54:30 Rebalance progress: 12.5
2022/01/04 16:54:35 Rebalance progress: 12.5
2022/01/04 16:54:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:54:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:54:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:54:40 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/04 16:54:45 Rebalance progress: 12.5
2022/01/04 16:54:50 Rebalance progress: 12.5
2022/01/04 16:54:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:54:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:54:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:55:01 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 16:55:06 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 16:55:11 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 16:55:16 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 16:55:21 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 16:55:21 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 16:55:21 eventingSetup.go:46: No eventing-con process running
2022/01/04 16:55:21 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/04 16:55:23 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:55:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:55:33 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10634
2022/01/04 16:55:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10634
2022/01/04 16:55:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:55:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:55:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:55:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOnUpdateBucketOpOneByOne (190.30s)
=== RUN   TestKVForceFailover
2022/01/04 16:56:00 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 16:56:00 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 16:56:00 eventingSetup.go:46: No eventing-con process running
2022/01/04 16:56:00 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/04 16:56:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:56:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:56:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:56:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:56:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:56:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:56:13 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 16:56:13 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 16:56:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:56:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:56:19 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 16:56:20 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/04 16:56:20 Starting bucket ops to source bucket
2022/01/04 16:56:25 Waiting for app: bucket_op_on_update to get deployed
2022/01/04 16:56:30 Waiting for app: bucket_op_on_update to get deployed
2022/01/04 16:56:35 Waiting for app: bucket_op_on_update to get deployed
2022/01/04 16:56:40 Waiting for app: bucket_op_on_update to get deployed
2022/01/04 16:56:40 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:56:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:56:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:56:40 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
2022/01/04 16:57:00 clusterSetup.go:237: Kicking off failover recovery, type: full
2022/01/04 16:57:00 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/04 16:57:05 Rebalance progress: 12.5
2022/01/04 16:57:10 Rebalance progress: 12.5
2022/01/04 16:57:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:57:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:57:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:57:15 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2022/01/04 16:57:20 Rebalance progress: 12.5
2022/01/04 16:57:25 Rebalance progress: 12.5
2022/01/04 16:57:30 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:57:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:57:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:57:35 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 16:57:40 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 16:57:46 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 16:57:51 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 16:57:56 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 16:57:56 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 16:57:56 eventingSetup.go:46: No eventing-con process running
2022/01/04 16:57:56 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/04 16:57:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:58:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:58:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7040
2022/01/04 16:58:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:58:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:58:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:58:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVForceFailover (149.86s)
=== RUN   TestKVHardFailoverRecovery
2022/01/04 16:58:25 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 16:58:25 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 16:58:25 eventingSetup.go:46: No eventing-con process running
2022/01/04 16:58:25 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/04 16:58:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:58:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:58:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 16:58:33 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:58:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:58:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:58:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 16:58:43 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 16:58:44 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/04 16:58:49 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 16:58:54 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 16:58:59 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 16:59:04 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 16:59:04 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:59:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:59:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:59:04 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 16:59:05 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 16:59:10 Rebalance progress: 12.5
2022/01/04 16:59:15 Rebalance progress: 12.5
2022/01/04 16:59:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:59:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 16:59:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 16:59:20 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
2022/01/04 17:00:20 clusterSetup.go:237: Kicking off failover recovery, type: full
2022/01/04 17:00:25 Rebalance progress: 12.5
2022/01/04 17:00:30 Rebalance progress: 12.5
2022/01/04 17:00:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:00:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:00:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:00:35 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 17:00:40 Rebalance progress: 12.5
2022/01/04 17:00:45 Rebalance progress: 12.5
2022/01/04 17:00:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:00:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:00:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:00:55 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:01:00 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:01:06 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:01:11 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:01:16 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:01:21 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:01:21 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 17:01:21 eventingSetup.go:46: No eventing-con process running
2022/01/04 17:01:21 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/04 17:01:23 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:01:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:01:33 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12084
2022/01/04 17:01:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12084
2022/01/04 17:01:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:01:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:01:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:01:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12084
2022/01/04 17:01:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVHardFailoverRecovery (214.79s)
=== RUN   TestKVRebOnUpdateBucketOpAllAtOnce
2022/01/04 17:01:59 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:01:59 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 17:01:59 eventingSetup.go:46: No eventing-con process running
2022/01/04 17:01:59 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/04 17:02:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:02:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:02:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:02:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:02:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:02:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:02:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:02:18 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 17:02:19 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/04 17:02:24 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 17:02:29 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:02:34 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:02:39 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:02:39 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:02:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:02:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:02:39 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 17:02:39 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/04 17:02:39 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2022/01/04 17:02:40 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 17:02:45 Rebalance progress: 12.5
2022/01/04 17:02:50 Rebalance progress: 12.5
2022/01/04 17:02:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:02:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:02:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:02:55 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2022/01/04 17:03:00 Rebalance progress: 12.5
2022/01/04 17:03:05 Rebalance progress: 12.5
2022/01/04 17:03:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:03:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:03:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:03:15 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:03:20 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:03:25 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:03:31 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:03:36 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:03:36 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 17:03:36 eventingSetup.go:46: No eventing-con process running
2022/01/04 17:03:36 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/04 17:03:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:03:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:03:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4593
2022/01/04 17:03:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:03:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:03:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:03:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4593
2022/01/04 17:03:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOnUpdateBucketOpAllAtOnce (129.89s)
=== RUN   TestKVSwapRebOnUpdateBucketOp
2022/01/04 17:04:09 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:04:09 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 17:04:09 eventingSetup.go:46: No eventing-con process running
2022/01/04 17:04:09 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/04 17:04:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:04:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:04:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:04:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:04:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:04:23 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:04:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:04:23 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 17:04:24 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/04 17:04:29 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 17:04:34 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:04:39 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:04:44 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:04:44 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:04:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:04:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:04:44 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 17:04:44 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 17:04:49 Rebalance progress: 12.5
2022/01/04 17:04:54 Rebalance progress: 12.5
2022/01/04 17:04:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:04:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:04:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:05:00 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/04 17:05:00 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 17:05:05 Rebalance progress: 12.5
2022/01/04 17:05:10 Rebalance progress: 12.5
2022/01/04 17:05:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:05:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:05:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:05:15 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 17:05:20 Rebalance progress: 12.5
2022/01/04 17:05:25 Rebalance progress: 12.5
2022/01/04 17:05:30 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:05:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:05:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:05:35 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:05:40 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:05:46 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:05:51 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:05:56 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:05:56 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 17:05:56 eventingSetup.go:46: No eventing-con process running
2022/01/04 17:05:56 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/04 17:05:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:06:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:06:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6104
2022/01/04 17:06:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:06:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:06:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:06:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:06:20 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:06:20 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 17:06:20 eventingSetup.go:46: No eventing-con process running
2022/01/04 17:06:20 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/04 17:06:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:06:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:06:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:06:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:06:33 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:06:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebOnUpdateBucketOp (153.81s)
=== RUN   TestKVRebalanceWithMultipleHandlers
2022/01/04 17:06:43 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:06:43 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 17:06:43 eventingSetup.go:46: No eventing-con process running
2022/01/04 17:06:43 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/04 17:06:45 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:06:50 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:06:50 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:06:52 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:06:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:06:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:07:02 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 17:07:02 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2022/01/04 17:07:02 eventingSetup.go:46: No eventing-con process running
2022/01/04 17:07:02 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: sys_test_bucket_op not found"
}
2022/01/04 17:07:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:07:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:07:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:07:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:07:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:07:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:07:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:07:15 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 17:07:16 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:07:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:07:16 eventingSetup.go:125: Deploying app: sys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/01/04 17:07:17 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op stored in temp store"
}
2022/01/04 17:07:22 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 17:07:27 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:07:32 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:07:37 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:07:37 clusterSetup.go:354: App: bucket_op_on_update got deployed
2022/01/04 17:07:42 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/01/04 17:07:47 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/01/04 17:07:52 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/01/04 17:07:52 clusterSetup.go:354: App: sys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:07:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:07:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:07:52 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 17:07:53 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 17:07:58 Rebalance progress: 12.5
2022/01/04 17:08:03 Rebalance progress: 12.5
2022/01/04 17:08:08 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:08:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:08:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:08:08 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/04 17:08:08 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 17:08:13 Rebalance progress: 12.5
2022/01/04 17:08:18 Rebalance progress: 12.5
2022/01/04 17:08:23 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:08:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:08:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:08:23 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2022/01/04 17:08:24 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 17:08:29 Rebalance progress: 12.5
2022/01/04 17:08:34 Rebalance progress: 12.5
2022/01/04 17:08:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:08:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:08:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:08:39 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 17:08:44 Rebalance progress: 12.5
2022/01/04 17:08:49 Rebalance progress: 12.5
2022/01/04 17:08:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:08:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:08:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:08:54 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 17:08:59 Rebalance progress: 12.5
2022/01/04 17:09:04 Rebalance progress: 12.5
2022/01/04 17:09:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:09:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:09:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:09:09 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/04 17:09:14 Rebalance progress: 12.5
2022/01/04 17:09:19 Rebalance progress: 12.5
2022/01/04 17:09:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:09:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:09:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:09:29 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:09:34 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:09:40 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:09:45 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:09:50 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:09:55 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:10:00 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:10:00 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 17:10:00 eventingSetup.go:46: No eventing-con process running
2022/01/04 17:10:00 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/04 17:10:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:10:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:10:13 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12160
2022/01/04 17:10:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12160
2022/01/04 17:10:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:10:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:10:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:10:30 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2728
2022/01/04 17:10:35 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2728
2022/01/04 17:10:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:10:40 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 17:10:45 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 17:10:51 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 17:10:56 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 17:11:01 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 17:11:01 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2022/01/04 17:11:01 eventingSetup.go:46: No eventing-con process running
2022/01/04 17:11:01 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op deleting in background"
}
2022/01/04 17:11:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:11:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:11:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:11:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:11:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:11:14 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebalanceWithMultipleHandlers (281.45s)
=== RUN   TestKVSwapRebalanceWithMultipleHandlers
2022/01/04 17:11:24 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:11:24 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 17:11:24 eventingSetup.go:46: No eventing-con process running
2022/01/04 17:11:24 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/04 17:11:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:11:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:11:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:11:33 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:11:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:11:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:11:43 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 17:11:43 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2022/01/04 17:11:43 eventingSetup.go:46: No eventing-con process running
2022/01/04 17:11:43 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: sys_test_bucket_op not found"
}
2022/01/04 17:11:45 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:11:50 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:11:50 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:11:52 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:11:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:11:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:11:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:11:57 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 17:11:58 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:11:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:11:58 eventingSetup.go:125: Deploying app: sys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/01/04 17:11:59 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op stored in temp store"
}
2022/01/04 17:12:04 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 17:12:09 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:12:14 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:12:19 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:12:19 clusterSetup.go:354: App: bucket_op_on_update got deployed
2022/01/04 17:12:24 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/01/04 17:12:29 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/01/04 17:12:34 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/01/04 17:12:34 clusterSetup.go:354: App: sys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:12:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:12:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:12:34 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 17:12:34 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 17:12:39 Rebalance progress: 12.5
2022/01/04 17:12:44 Rebalance progress: 12.5
2022/01/04 17:12:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:12:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:12:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:12:49 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/04 17:12:50 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 17:12:55 Rebalance progress: 12.5
2022/01/04 17:13:00 Rebalance progress: 12.5
2022/01/04 17:13:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:13:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:13:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:13:05 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 17:13:10 Rebalance progress: 12.5
2022/01/04 17:13:15 Rebalance progress: 12.5
2022/01/04 17:13:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:13:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:13:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:13:25 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:13:30 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:13:35 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:13:40 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:13:45 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:13:46 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 17:13:46 eventingSetup.go:46: No eventing-con process running
2022/01/04 17:13:46 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/04 17:13:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:13:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:13:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:13:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:14:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:14:07 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7579
2022/01/04 17:14:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:14:12 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 17:14:17 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 17:14:23 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 17:14:28 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 17:14:33 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 17:14:33 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2022/01/04 17:14:33 eventingSetup.go:46: No eventing-con process running
2022/01/04 17:14:33 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op deleting in background"
}
2022/01/04 17:14:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:14:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:14:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:14:42 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:14:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:14:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebalanceWithMultipleHandlers (212.16s)
=== RUN   TestKVRebStopStartKVOpsOnUpdateBucketOpOneByOne
2022/01/04 17:14:57 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:14:57 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 17:14:57 eventingSetup.go:46: No eventing-con process running
2022/01/04 17:14:57 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/04 17:14:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:15:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:15:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:15:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:15:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:15:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:15:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:15:15 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 17:15:16 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/04 17:15:21 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 17:15:26 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:15:31 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:15:36 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:15:36 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:15:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:15:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:15:36 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 17:15:37 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 17:15:57 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:15:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:15:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:16:07 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:16:07 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:16:07 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 17:16:12 Rebalance progress: 12.5
2022/01/04 17:16:17 Rebalance progress: 12.5
2022/01/04 17:16:22 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:16:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:16:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:16:22 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/04 17:16:23 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 17:16:28 Rebalance progress: 12.5
2022/01/04 17:16:33 Rebalance progress: 12.5
2022/01/04 17:16:38 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:16:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:16:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:16:38 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 17:16:43 Rebalance progress: 12.5
2022/01/04 17:16:48 Rebalance progress: 12.5
2022/01/04 17:16:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:16:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:16:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:16:58 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:17:03 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:17:08 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:17:14 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:17:19 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:17:19 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 17:17:19 eventingSetup.go:46: No eventing-con process running
2022/01/04 17:17:19 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/04 17:17:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:17:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:17:30 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4663
2022/01/04 17:17:35 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4663
2022/01/04 17:17:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:17:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:17:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:17:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9167
2022/01/04 17:17:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebStopStartKVOpsOnUpdateBucketOpOneByOne (180.58s)
=== RUN   TestKVFailoverOnUpdateBucketOp
2022/01/04 17:17:57 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:17:57 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 17:17:57 eventingSetup.go:46: No eventing-con process running
2022/01/04 17:17:57 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/04 17:17:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:18:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:18:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:18:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:18:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:18:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:18:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:18:16 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 17:18:17 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/04 17:18:22 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 17:18:27 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:18:32 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:18:37 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:18:37 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:18:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:18:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:18:37 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 17:18:37 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 17:18:42 Rebalance progress: 12.5
2022/01/04 17:18:47 Rebalance progress: 12.5
2022/01/04 17:18:52 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:18:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:18:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:18:52 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:19:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:19:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:19:02 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 17:19:07 Rebalance progress: 12.5
2022/01/04 17:19:12 Rebalance progress: 12.5
2022/01/04 17:19:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:19:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:19:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:19:17 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/04 17:19:18 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 17:19:23 Rebalance progress: 12.5
2022/01/04 17:19:28 Rebalance progress: 12.5
2022/01/04 17:19:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:19:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:19:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:19:33 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 17:19:38 Rebalance progress: 12.5
2022/01/04 17:19:43 Rebalance progress: 12.5
2022/01/04 17:19:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:19:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:19:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:19:53 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:19:58 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:20:03 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:20:08 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:20:13 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:20:13 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 17:20:13 eventingSetup.go:46: No eventing-con process running
2022/01/04 17:20:14 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/04 17:20:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:20:20 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:20:25 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8579
2022/01/04 17:20:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:20:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:20:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:20:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8579
2022/01/04 17:20:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVFailoverOnUpdateBucketOp (169.82s)
=== RUN   TestBootstrapAfterKVHardFailover
2022/01/04 17:20:42 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 17:20:42 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 17:20:47 Rebalance progress: 100
2022/01/04 17:20:47 Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:21:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:21:17 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 17:21:19 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/04 17:21:24 Removing node(s): [] from the cluster
2022/01/04 17:21:24 Starting bucket ops to source bucket
2022/01/04 17:21:29 Rebalance failed. See logs for detailed reason. You can try again.
2022/01/04 17:21:34 Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:21:39 Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:21:44 Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:21:49 Waiting for app: bucket_op_on_update to get deployed
2022/01/04 17:21:49 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:21:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:21:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 17:21:54 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:21:59 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:22:04 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:22:09 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:22:14 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 17:22:14 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 17:22:14 eventingSetup.go:46: No eventing-con process running
2022/01/04 17:22:14 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/04 17:22:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:22:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:22:26 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2511
2022/01/04 17:22:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 17:22:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 17:22:33 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 17:22:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2511
2022/01/04 17:22:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBootstrapAfterKVHardFailover (120.91s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	11895.282s

Rebalance tests took 3 hours, 18 minutes and 17 seconds.

Testing Succeeded


Version: versions-04.01.2022-09.41.cfg
Build Log: make-04.01.2022-09.41.log
Server Log: logs-04.01.2022-09.41.tar.gz

Finished