Building

Started building at 2021/12/25 09:22:34
Calculating base
Updating mirror
Basing run on 7.1.0-1982 e1c637755
Updating tree for run 25.12.2021-09.22
gocb is at 635fa6c, changes since last good build: none
libcouchbase is at f6822fc, changes since last good build: none
indexing is at 8d3522b, changes since last good build: none
kv_engine is at cda4d73, changes since last good build: none
ns_server is at fadbef1, changes since last good build: none
couchstore is at 0bf3a4b, changes since last good build: none
couchdb is at fca2e6b, changes since last good build: none
testrunner is at a23e488, changes since last good build: none
Switching eventing to unstable
eventing is at ee5930d, changes since last good build: none
Switching eventing-ee to unstable
eventing-ee is at 80089ff, changes since last good build: none
Pulling in uncommitted change 160397 at refs/changes/97/160397/3
Total 23 (delta 15), reused 17 (delta 15)
[unstable 60c492fa] MB-100 : Do not fail n1ql timeout test if we are catching timeout exceptions successfully
 Author: abhijpes 
 Date: Mon Aug 30 08:24:38 2021 +0530
 1 file changed, 2 insertions(+), 2 deletions(-)
Pulling in uncommitted change 163449 at refs/changes/49/163449/1
Total 48 (delta 27), reused 39 (delta 27)
[unstable 45d98f7e] MB-100: collect data when test fails
 Author: AnkitPrabhu 
 Date: Tue Oct 12 14:02:31 2021 +0530
 1 file changed, 2 insertions(+)
Pulling in uncommitted change 166698 at refs/changes/98/166698/3
Total 4 (delta 3), reused 4 (delta 3)
[unstable 42429112] MB-48334 : Fail rebalance unless all functions deployed on current encryption level
 Author: abhijpes 
 Date: Wed Dec 1 14:51:29 2021 +0530
 1 file changed, 9 insertions(+)
Building cmakefiles and deps
Building main product

Testing

Started testing at 2021/12/25 09:37:55
Testing mode: rebalance,n1ql,functional
Starting server
Starting server: attempt 1

Functional tests

2021/12/25 09:39:23 Started functional
Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:54168->127.0.0.1:9000: read: connection reset by peer
Quota setup Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:54168->127.0.0.1:9000: read: connection reset by peer
2021/12/25 09:39:32 Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2021/12/25 09:39:37 Error in adding nodes : , response: {"otpNode":"n_1@127.0.0.1"}
2021/12/25 09:39:37 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 09:39:43 Removing node(s): [] from the cluster
2021/12/25 09:39:48 Rebalance progress: 0
2021/12/25 09:39:53 Rebalance progress: 0.1808449074074074
2021/12/25 09:39:58 Rebalance progress: 4.810474537037037
2021/12/25 09:40:03 Rebalance progress: 9.25925925925926
2021/12/25 09:40:08 Rebalance progress: 12.83998842592593
2021/12/25 09:40:13 Rebalance progress: 17.61429398148148
2021/12/25 09:40:18 Rebalance progress: 20.92375578703703
2021/12/25 09:40:23 Rebalance progress: 25.55338541666667
2021/12/25 09:40:28 Rebalance progress: 100
2021/12/25 09:40:31 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:40:46 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:41:01 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:41:16 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:41:31 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:41:46 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:42:01 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:42:16 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:42:31 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:42:46 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:43:01 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:43:16 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:43:31 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:43:46 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:44:01 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:44:16 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:44:31 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:44:46 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:45:01 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:45:16 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:45:31 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/25 09:45:46 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
=== RUN   TestAdvancedGetOps
2021/12/25 09:46:03 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/25 09:46:18 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/25 09:46:33 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/25 09:46:48 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/25 09:47:03 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/25 09:47:18 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/25 09:47:33 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/25 09:47:48 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/25 09:48:03 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/25 09:48:18 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/25 09:48:33 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/25 09:48:48 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/25 09:49:03 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/25 09:49:18 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/25 09:49:33 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/25 09:49:48 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/25 09:50:04 Deploying app: TestAdvancedGetOps. Item count src bucket: 0 dst bucket: 0
2021/12/25 09:50:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedGetOps stored in temp store"
}
2021/12/25 09:50:10 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/25 09:50:15 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/25 09:50:20 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/25 09:50:25 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/25 09:50:25 App: TestAdvancedGetOps got deployed
2021/12/25 09:50:25 Starting bucket ops to source bucket
2021/12/25 09:50:30 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/25 09:50:35 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/25 09:50:35 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/25 09:50:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 09:50:35 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 09:50:40 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/25 09:50:45 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/25 09:50:50 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/25 09:50:55 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/25 09:50:55 App: TestAdvancedGetOps got un-deployed
2021/12/25 09:50:55 No eventing-con process running
2021/12/25 09:50:55 Function: TestAdvancedGetOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedGetOps deleting in background"
}
2021/12/25 09:50:57 Context: Bucket flush, response code: 200 dump: 
2021/12/25 09:51:07 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 09:51:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 09:51:09 Context: Bucket flush, response code: 200 dump: 
2021/12/25 09:51:19 Waiting for dst bucket item count to get to: 0 curr count: 89
2021/12/25 09:51:24 Waiting for dst bucket item count to get to: 0 curr count: 39
2021/12/25 09:51:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedGetOps (320.22s)
=== RUN   TestAdvancedInsertOps
2021/12/25 09:51:24 Deploying app: TestAdvancedInsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/25 09:51:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps stored in temp store"
}
2021/12/25 09:51:30 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/25 09:51:35 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/25 09:51:40 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/25 09:51:45 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/25 09:51:45 App: TestAdvancedInsertOps got deployed
2021/12/25 09:51:45 Starting bucket ops to source bucket
2021/12/25 09:51:51 Waiting for dst bucket item count to get to: 1024 curr count: 0
2021/12/25 09:51:56 Waiting for dst bucket item count to get to: 1024 curr count: 512
2021/12/25 09:51:56 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2021/12/25 09:51:56 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 09:51:56 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 09:52:01 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/25 09:52:06 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/25 09:52:11 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/25 09:52:16 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/25 09:52:16 App: TestAdvancedInsertOps got un-deployed
2021/12/25 09:52:16 No eventing-con process running
2021/12/25 09:52:16 Function: TestAdvancedInsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps deleting in background"
}
2021/12/25 09:52:18 Context: Bucket flush, response code: 200 dump: 
2021/12/25 09:52:28 Waiting for dst bucket item count to get to: 0 curr count: 512
2021/12/25 09:52:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 09:52:29 Context: Bucket flush, response code: 200 dump: 
2021/12/25 09:52:39 Waiting for dst bucket item count to get to: 0 curr count: 512
2021/12/25 09:52:44 Waiting for dst bucket item count to get to: 0 curr count: 512
2021/12/25 09:52:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 09:52:44 Testing insert operation on source bucket
2021/12/25 09:52:44 Deploying app: TestAdvancedInsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/25 09:52:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps stored in temp store"
}
2021/12/25 09:52:51 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/25 09:52:56 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/25 09:53:01 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/25 09:53:06 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/25 09:53:06 App: TestAdvancedInsertOps got deployed
2021/12/25 09:53:06 Starting bucket ops to source bucket
2021/12/25 09:53:12 Waiting for dst bucket item count to get to: 2048 curr count: 0
2021/12/25 09:53:12 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2021/12/25 09:53:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 09:53:12 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 09:53:17 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/25 09:53:22 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/25 09:53:27 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/25 09:53:32 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/25 09:53:32 App: TestAdvancedInsertOps got un-deployed
2021/12/25 09:53:32 No eventing-con process running
2021/12/25 09:53:32 Function: TestAdvancedInsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps deleting in background"
}
2021/12/25 09:53:33 Context: Bucket flush, response code: 200 dump: 
2021/12/25 09:53:43 Waiting for dst bucket item count to get to: 0 curr count: 2048
2021/12/25 09:53:48 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/25 09:53:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 09:53:50 Context: Bucket flush, response code: 200 dump: 
2021/12/25 09:53:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedInsertOps (151.52s)
=== RUN   TestAdvancedUpsertOps
2021/12/25 09:53:55 Starting bucket ops to source bucket
2021/12/25 09:53:56 Deploying app: TestAdvancedUpsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/25 09:53:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps stored in temp store"
}
2021/12/25 09:54:02 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/25 09:54:07 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/25 09:54:12 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/25 09:54:17 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/25 09:54:17 App: TestAdvancedUpsertOps got deployed
2021/12/25 09:54:17 Starting bucket ops to source bucket
2021/12/25 09:54:23 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/25 09:54:28 Waiting for dst bucket item count to get to: 0 curr count: 439
2021/12/25 09:54:33 Waiting for dst bucket item count to get to: 0 curr count: 439
2021/12/25 09:54:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 09:54:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 09:54:33 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 09:54:38 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/25 09:54:43 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/25 09:54:48 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/25 09:54:53 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/25 09:54:53 App: TestAdvancedUpsertOps got un-deployed
2021/12/25 09:54:53 No eventing-con process running
2021/12/25 09:54:53 Function: TestAdvancedUpsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps deleting in background"
}
2021/12/25 09:54:55 Context: Bucket flush, response code: 200 dump: 
2021/12/25 09:55:05 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/25 09:55:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 09:55:07 Context: Bucket flush, response code: 200 dump: 
2021/12/25 09:55:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 09:55:12 Testing upsert operation on source bucket
2021/12/25 09:55:12 Deploying app: TestAdvancedUpsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/25 09:55:13 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps stored in temp store"
}
2021/12/25 09:55:18 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/25 09:55:23 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/25 09:55:28 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/25 09:55:33 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/25 09:55:33 App: TestAdvancedUpsertOps got deployed
2021/12/25 09:55:33 Starting bucket ops to source bucket
2021/12/25 09:55:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 09:55:34 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 09:55:34 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 09:55:39 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/25 09:55:44 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/25 09:55:49 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/25 09:55:54 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/25 09:55:54 App: TestAdvancedUpsertOps got un-deployed
2021/12/25 09:55:54 No eventing-con process running
2021/12/25 09:55:54 Function: TestAdvancedUpsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps deleting in background"
}
2021/12/25 09:55:56 Context: Bucket flush, response code: 200 dump: 
2021/12/25 09:56:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 09:56:03 Context: Bucket flush, response code: 200 dump: 
2021/12/25 09:56:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedUpsertOps (132.96s)
=== RUN   TestAdvancedReplaceOps
2021/12/25 09:56:08 Starting bucket ops to source bucket
2021/12/25 09:56:09 Deploying app: TestAdvancedReplaceOps. Item count src bucket: 0 dst bucket: 0
2021/12/25 09:56:10 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps stored in temp store"
}
2021/12/25 09:56:15 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/25 09:56:20 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/25 09:56:25 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/25 09:56:30 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/25 09:56:30 App: TestAdvancedReplaceOps got deployed
2021/12/25 09:56:30 Starting bucket ops to source bucket
2021/12/25 09:56:36 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/25 09:56:41 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/25 09:56:46 Waiting for dst bucket item count to get to: 0 curr count: 512
2021/12/25 09:56:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 09:56:46 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 09:56:46 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 09:56:51 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/25 09:56:56 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/25 09:57:01 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/25 09:57:06 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/25 09:57:06 App: TestAdvancedReplaceOps got un-deployed
2021/12/25 09:57:06 No eventing-con process running
2021/12/25 09:57:07 Function: TestAdvancedReplaceOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps deleting in background"
}
2021/12/25 09:57:08 Context: Bucket flush, response code: 200 dump: 
2021/12/25 09:57:18 Waiting for dst bucket item count to get to: 0 curr count: 771
2021/12/25 09:57:23 Waiting for dst bucket item count to get to: 0 curr count: 259
2021/12/25 09:57:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 09:57:25 Context: Bucket flush, response code: 200 dump: 
2021/12/25 09:57:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 09:57:30 Testing upsert operation on source bucket
2021/12/25 09:57:30 Deploying app: TestAdvancedReplaceOps. Item count src bucket: 0 dst bucket: 0
2021/12/25 09:57:31 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps stored in temp store"
}
2021/12/25 09:57:36 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/25 09:57:41 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/25 09:57:46 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/25 09:57:51 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/25 09:57:51 App: TestAdvancedReplaceOps got deployed
2021/12/25 09:57:51 Starting bucket ops to source bucket
2021/12/25 09:57:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 09:57:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 09:57:52 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 09:57:57 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/25 09:58:02 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/25 09:58:07 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/25 09:58:12 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/25 09:58:12 App: TestAdvancedReplaceOps got un-deployed
2021/12/25 09:58:12 No eventing-con process running
2021/12/25 09:58:12 Function: TestAdvancedReplaceOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps deleting in background"
}
2021/12/25 09:58:14 Context: Bucket flush, response code: 200 dump: 
2021/12/25 09:58:24 Waiting for dst bucket item count to get to: 0 curr count: 326
2021/12/25 09:58:29 Waiting for dst bucket item count to get to: 0 curr count: 121
2021/12/25 09:58:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 09:58:31 Context: Bucket flush, response code: 200 dump: 
2021/12/25 09:58:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedReplaceOps (147.73s)
=== RUN   TestAdvancedDeleteOps
2021/12/25 09:58:36 Starting bucket ops to source bucket
2021/12/25 09:58:36 Deploying app: TestAdvancedDeleteOps. Item count src bucket: 0 dst bucket: 0
2021/12/25 09:58:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps stored in temp store"
}
2021/12/25 09:58:42 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/25 09:58:47 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/25 09:58:52 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/25 09:58:57 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/25 09:58:57 App: TestAdvancedDeleteOps got deployed
2021/12/25 09:58:57 Starting bucket ops to source bucket
2021/12/25 09:59:02 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 09:59:07 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/25 09:59:12 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/25 09:59:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 09:59:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 09:59:12 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 09:59:18 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/25 09:59:23 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/25 09:59:28 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/25 09:59:33 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/25 09:59:33 App: TestAdvancedDeleteOps got un-deployed
2021/12/25 09:59:33 No eventing-con process running
2021/12/25 09:59:33 Function: TestAdvancedDeleteOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps deleting in background"
}
2021/12/25 09:59:34 Context: Bucket flush, response code: 200 dump: 
2021/12/25 09:59:44 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 09:59:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 09:59:46 Context: Bucket flush, response code: 200 dump: 
2021/12/25 09:59:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 09:59:51 Testing delete operation on source bucket
2021/12/25 09:59:51 Deploying app: TestAdvancedDeleteOps. Item count src bucket: 0 dst bucket: 0
2021/12/25 09:59:52 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps stored in temp store"
}
2021/12/25 09:59:57 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/25 10:00:02 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/25 10:00:07 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/25 10:00:12 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/25 10:00:12 App: TestAdvancedDeleteOps got deployed
2021/12/25 10:00:12 Starting bucket ops to source bucket
2021/12/25 10:00:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:00:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:00:12 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:00:17 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/25 10:00:23 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/25 10:00:28 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/25 10:00:33 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/25 10:00:33 App: TestAdvancedDeleteOps got un-deployed
2021/12/25 10:00:33 No eventing-con process running
2021/12/25 10:00:33 Function: TestAdvancedDeleteOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps deleting in background"
}
2021/12/25 10:00:34 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:00:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:00:42 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:00:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedDeleteOps (130.65s)
=== RUN   TestEnoentAdvancedGet
2021/12/25 10:00:47 Deploying app: TestEnoentAdvancedGet. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:00:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet stored in temp store"
}
2021/12/25 10:00:53 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/25 10:00:58 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/25 10:01:03 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/25 10:01:08 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/25 10:01:08 App: TestEnoentAdvancedGet got deployed
2021/12/25 10:01:08 Starting bucket ops to source bucket
2021/12/25 10:01:13 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/25 10:01:18 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/25 10:01:23 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/25 10:01:23 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/25 10:01:23 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:01:23 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:01:28 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/25 10:01:33 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/25 10:01:38 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/25 10:01:43 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/25 10:01:43 App: TestEnoentAdvancedGet got un-deployed
2021/12/25 10:01:43 No eventing-con process running
2021/12/25 10:01:43 Function: TestEnoentAdvancedGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet deleting in background"
}
2021/12/25 10:01:45 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:01:55 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:01:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:01:57 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:02:07 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:02:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:02:07 Testing get enoent operation on source bucket
2021/12/25 10:02:07 Deploying app: TestEnoentAdvancedGet. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:02:08 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet stored in temp store"
}
2021/12/25 10:02:13 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/25 10:02:18 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/25 10:02:23 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/25 10:02:28 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/25 10:02:28 App: TestEnoentAdvancedGet got deployed
2021/12/25 10:02:28 Starting bucket ops to source bucket
2021/12/25 10:02:33 Waiting for dst bucket item count to get to: 200 curr count: 0
2021/12/25 10:02:38 Waiting for dst bucket item count to get to: 200 curr count: 100
2021/12/25 10:02:43 Waiting for dst bucket item count to get to: 200 curr count: 100
2021/12/25 10:02:43 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2021/12/25 10:02:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:02:43 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:02:48 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/25 10:02:53 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/25 10:02:58 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/25 10:03:03 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/25 10:03:03 App: TestEnoentAdvancedGet got un-deployed
2021/12/25 10:03:03 No eventing-con process running
2021/12/25 10:03:03 Function: TestEnoentAdvancedGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet deleting in background"
}
2021/12/25 10:03:05 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:03:15 Waiting for dst bucket item count to get to: 0 curr count: 200
2021/12/25 10:03:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:03:17 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:03:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedGet (155.05s)
=== RUN   TestEnoentAdvancedReplace
2021/12/25 10:03:22 Deploying app: TestEnoentAdvancedReplace. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:03:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace stored in temp store"
}
2021/12/25 10:03:28 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/25 10:03:33 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/25 10:03:38 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/25 10:03:43 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/25 10:03:43 App: TestEnoentAdvancedReplace got deployed
2021/12/25 10:03:43 Starting bucket ops to source bucket
2021/12/25 10:03:48 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/25 10:03:53 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/25 10:03:53 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/25 10:03:53 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:03:53 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:03:58 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/25 10:04:03 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/25 10:04:08 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/25 10:04:13 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/25 10:04:13 App: TestEnoentAdvancedReplace got un-deployed
2021/12/25 10:04:13 No eventing-con process running
2021/12/25 10:04:13 Function: TestEnoentAdvancedReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace deleting in background"
}
2021/12/25 10:04:15 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:04:25 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:04:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:04:26 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:04:36 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:04:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:04:37 Testing get enoent operation on source bucket
2021/12/25 10:04:37 Deploying app: TestEnoentAdvancedReplace. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:04:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace stored in temp store"
}
2021/12/25 10:04:43 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/25 10:04:48 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/25 10:04:53 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/25 10:04:58 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/25 10:04:58 App: TestEnoentAdvancedReplace got deployed
2021/12/25 10:04:58 Starting bucket ops to source bucket
2021/12/25 10:05:03 Waiting for dst bucket item count to get to: 200 curr count: 0
2021/12/25 10:05:08 Waiting for dst bucket item count to get to: 200 curr count: 100
2021/12/25 10:05:13 Waiting for dst bucket item count to get to: 200 curr count: 100
2021/12/25 10:05:13 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2021/12/25 10:05:13 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:05:13 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:05:18 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/25 10:05:23 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/25 10:05:28 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/25 10:05:33 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/25 10:05:33 App: TestEnoentAdvancedReplace got un-deployed
2021/12/25 10:05:33 No eventing-con process running
2021/12/25 10:05:33 Function: TestEnoentAdvancedReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace deleting in background"
}
2021/12/25 10:05:35 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:05:45 Waiting for dst bucket item count to get to: 0 curr count: 200
2021/12/25 10:05:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:05:47 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:05:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedReplace (150.02s)
=== RUN   TestEnoentAdvancedDelete
2021/12/25 10:05:52 Deploying app: TestEnoentAdvancedDelete. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:05:53 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete stored in temp store"
}
2021/12/25 10:05:58 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/25 10:06:03 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/25 10:06:08 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/25 10:06:13 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/25 10:06:13 App: TestEnoentAdvancedDelete got deployed
2021/12/25 10:06:13 Starting bucket ops to source bucket
2021/12/25 10:06:18 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/25 10:06:23 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/25 10:06:23 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/25 10:06:23 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:06:23 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:06:28 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/25 10:06:33 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/25 10:06:38 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/25 10:06:43 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/25 10:06:43 App: TestEnoentAdvancedDelete got un-deployed
2021/12/25 10:06:43 No eventing-con process running
2021/12/25 10:06:43 Function: TestEnoentAdvancedDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete deleting in background"
}
2021/12/25 10:06:45 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:06:55 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:06:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:06:57 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:07:07 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:07:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:07:07 Testing get enoent operation on source bucket
2021/12/25 10:07:07 Deploying app: TestEnoentAdvancedDelete. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:07:08 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete stored in temp store"
}
2021/12/25 10:07:13 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/25 10:07:18 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/25 10:07:23 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/25 10:07:28 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/25 10:07:28 App: TestEnoentAdvancedDelete got deployed
2021/12/25 10:07:28 Starting bucket ops to source bucket
2021/12/25 10:07:33 Waiting for dst bucket item count to get to: 200 curr count: 0
2021/12/25 10:07:38 Waiting for dst bucket item count to get to: 200 curr count: 100
2021/12/25 10:07:43 Waiting for dst bucket item count to get to: 200 curr count: 100
2021/12/25 10:07:43 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2021/12/25 10:07:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:07:43 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:07:48 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/25 10:07:53 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/25 10:07:58 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/25 10:08:03 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/25 10:08:03 App: TestEnoentAdvancedDelete got un-deployed
2021/12/25 10:08:03 No eventing-con process running
2021/12/25 10:08:03 Function: TestEnoentAdvancedDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete deleting in background"
}
2021/12/25 10:08:05 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:08:15 Waiting for dst bucket item count to get to: 0 curr count: 200
2021/12/25 10:08:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:08:17 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:08:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedDelete (149.97s)
=== RUN   TestAdvancedInsertKeyExist
2021/12/25 10:08:22 Deploying app: TestAdvancedInsertKeyExist. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:08:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist stored in temp store"
}
2021/12/25 10:08:28 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/25 10:08:33 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/25 10:08:38 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/25 10:08:43 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/25 10:08:43 App: TestAdvancedInsertKeyExist got deployed
2021/12/25 10:08:43 Starting bucket ops to source bucket
2021/12/25 10:08:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:08:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:08:43 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:08:48 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/25 10:08:53 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/25 10:08:58 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/25 10:09:03 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/25 10:09:03 App: TestAdvancedInsertKeyExist got un-deployed
2021/12/25 10:09:03 No eventing-con process running
2021/12/25 10:09:03 Function: TestAdvancedInsertKeyExist delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist deleting in background"
}
2021/12/25 10:09:05 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:09:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:09:12 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:09:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:09:17 Pumping document in the destination bucket
2021/12/25 10:09:17 Starting bucket ops to source bucket
2021/12/25 10:09:17 Deploying app: TestAdvancedInsertKeyExist. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:09:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist stored in temp store"
}
2021/12/25 10:09:23 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/25 10:09:29 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/25 10:09:34 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/25 10:09:39 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/25 10:09:39 App: TestAdvancedInsertKeyExist got deployed
2021/12/25 10:09:39 Starting bucket ops to source bucket
2021/12/25 10:09:44 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:09:49 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/25 10:09:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:09:49 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:09:49 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:09:54 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/25 10:09:59 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/25 10:10:04 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/25 10:10:09 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/25 10:10:09 App: TestAdvancedInsertKeyExist got un-deployed
2021/12/25 10:10:09 No eventing-con process running
2021/12/25 10:10:09 Function: TestAdvancedInsertKeyExist delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist deleting in background"
}
2021/12/25 10:10:11 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:10:21 Waiting for dst bucket item count to get to: 0 curr count: 86
2021/12/25 10:10:26 Waiting for dst bucket item count to get to: 0 curr count: 86
2021/12/25 10:10:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:10:27 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:10:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedInsertKeyExist (130.84s)
=== RUN   TestExipryGet
2021/12/25 10:10:32 Deploying app: TestExipryGet. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:10:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet stored in temp store"
}
2021/12/25 10:10:39 Waiting for app: TestExipryGet to get deployed
2021/12/25 10:10:44 Waiting for app: TestExipryGet to get deployed
2021/12/25 10:10:49 Waiting for app: TestExipryGet to get deployed
2021/12/25 10:10:54 Waiting for app: TestExipryGet to get deployed
2021/12/25 10:10:54 App: TestExipryGet got deployed
2021/12/25 10:10:54 Starting bucket ops to source bucket
2021/12/25 10:11:39 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:11:44 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/25 10:11:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:11:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:11:44 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:11:49 Waiting for app: TestExipryGet to get un-deployed
2021/12/25 10:11:54 Waiting for app: TestExipryGet to get un-deployed
2021/12/25 10:11:59 Waiting for app: TestExipryGet to get un-deployed
2021/12/25 10:12:04 Waiting for app: TestExipryGet to get un-deployed
2021/12/25 10:12:04 App: TestExipryGet got un-deployed
2021/12/25 10:12:04 No eventing-con process running
2021/12/25 10:12:04 Function: TestExipryGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet deleting in background"
}
2021/12/25 10:12:06 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:12:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:12:13 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:12:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:12:18 Pumping document in the destination bucket for expiry get
2021/12/25 10:12:18 Starting bucket ops to source bucket
2021/12/25 10:12:18 Deploying app: TestExipryGet. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:12:19 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet stored in temp store"
}
2021/12/25 10:12:24 Waiting for app: TestExipryGet to get deployed
2021/12/25 10:12:29 Waiting for app: TestExipryGet to get deployed
2021/12/25 10:12:34 Waiting for app: TestExipryGet to get deployed
2021/12/25 10:12:39 Waiting for app: TestExipryGet to get deployed
2021/12/25 10:12:39 App: TestExipryGet got deployed
2021/12/25 10:12:39 Starting bucket ops to source bucket
2021/12/25 10:13:25 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:13:30 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:13:35 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/25 10:13:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:13:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:13:35 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:13:40 Waiting for app: TestExipryGet to get un-deployed
2021/12/25 10:13:45 Waiting for app: TestExipryGet to get un-deployed
2021/12/25 10:13:50 Waiting for app: TestExipryGet to get un-deployed
2021/12/25 10:13:55 Waiting for app: TestExipryGet to get un-deployed
2021/12/25 10:13:55 App: TestExipryGet got un-deployed
2021/12/25 10:13:55 No eventing-con process running
2021/12/25 10:13:55 Function: TestExipryGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet deleting in background"
}
2021/12/25 10:13:56 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:14:07 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:14:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:14:08 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:14:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryGet (220.92s)
=== RUN   TestExipryInsert
2021/12/25 10:14:13 Deploying app: TestExipryInsert. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:14:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert stored in temp store"
}
2021/12/25 10:14:20 Waiting for app: TestExipryInsert to get deployed
2021/12/25 10:14:25 Waiting for app: TestExipryInsert to get deployed
2021/12/25 10:14:30 Waiting for app: TestExipryInsert to get deployed
2021/12/25 10:14:35 Waiting for app: TestExipryInsert to get deployed
2021/12/25 10:14:35 App: TestExipryInsert got deployed
2021/12/25 10:14:35 Starting bucket ops to source bucket
2021/12/25 10:15:20 Waiting for dst bucket item count to get to: 0 curr count: 200
2021/12/25 10:15:25 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:15:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:15:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:15:25 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:15:30 Waiting for app: TestExipryInsert to get un-deployed
2021/12/25 10:15:35 Waiting for app: TestExipryInsert to get un-deployed
2021/12/25 10:15:40 Waiting for app: TestExipryInsert to get un-deployed
2021/12/25 10:15:45 Waiting for app: TestExipryInsert to get un-deployed
2021/12/25 10:15:45 App: TestExipryInsert got un-deployed
2021/12/25 10:15:45 No eventing-con process running
2021/12/25 10:15:45 Function: TestExipryInsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert deleting in background"
}
2021/12/25 10:15:47 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:15:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:15:54 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:15:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:15:59 Testing on the destination bucket for expiry insert
2021/12/25 10:15:59 Deploying app: TestExipryInsert. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:16:00 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert stored in temp store"
}
2021/12/25 10:16:05 Waiting for app: TestExipryInsert to get deployed
2021/12/25 10:16:10 Waiting for app: TestExipryInsert to get deployed
2021/12/25 10:16:15 Waiting for app: TestExipryInsert to get deployed
2021/12/25 10:16:20 Waiting for app: TestExipryInsert to get deployed
2021/12/25 10:16:20 App: TestExipryInsert got deployed
2021/12/25 10:16:20 Starting bucket ops to source bucket
2021/12/25 10:17:05 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:17:10 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:17:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:17:10 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:17:10 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:17:15 Waiting for app: TestExipryInsert to get un-deployed
2021/12/25 10:17:21 Waiting for app: TestExipryInsert to get un-deployed
2021/12/25 10:17:26 Waiting for app: TestExipryInsert to get un-deployed
2021/12/25 10:17:31 Waiting for app: TestExipryInsert to get un-deployed
2021/12/25 10:17:31 App: TestExipryInsert got un-deployed
2021/12/25 10:17:31 No eventing-con process running
2021/12/25 10:17:31 Function: TestExipryInsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert deleting in background"
}
2021/12/25 10:17:32 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:17:42 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:17:47 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/25 10:17:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:17:49 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:17:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryInsert (220.77s)
=== RUN   TestExipryReplace
2021/12/25 10:17:54 Deploying app: TestExipryReplace. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:17:55 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace stored in temp store"
}
2021/12/25 10:18:00 Waiting for app: TestExipryReplace to get deployed
2021/12/25 10:18:05 Waiting for app: TestExipryReplace to get deployed
2021/12/25 10:18:10 Waiting for app: TestExipryReplace to get deployed
2021/12/25 10:18:15 Waiting for app: TestExipryReplace to get deployed
2021/12/25 10:18:15 App: TestExipryReplace got deployed
2021/12/25 10:18:15 Starting bucket ops to source bucket
2021/12/25 10:19:01 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:19:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:19:01 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:19:01 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:19:06 Waiting for app: TestExipryReplace to get un-deployed
2021/12/25 10:19:11 Waiting for app: TestExipryReplace to get un-deployed
2021/12/25 10:19:16 Waiting for app: TestExipryReplace to get un-deployed
2021/12/25 10:19:21 Waiting for app: TestExipryReplace to get un-deployed
2021/12/25 10:19:21 App: TestExipryReplace got un-deployed
2021/12/25 10:19:21 No eventing-con process running
2021/12/25 10:19:21 Function: TestExipryReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace deleting in background"
}
2021/12/25 10:19:22 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:19:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:19:30 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:19:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:19:35 Testing on the destination bucket for expiry insert
2021/12/25 10:19:35 Deploying app: TestExipryReplace. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:19:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace stored in temp store"
}
2021/12/25 10:19:41 Waiting for app: TestExipryReplace to get deployed
2021/12/25 10:19:46 Waiting for app: TestExipryReplace to get deployed
2021/12/25 10:19:51 Waiting for app: TestExipryReplace to get deployed
2021/12/25 10:19:56 Waiting for app: TestExipryReplace to get deployed
2021/12/25 10:19:56 App: TestExipryReplace got deployed
2021/12/25 10:19:56 Starting bucket ops to source bucket
2021/12/25 10:20:41 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/25 10:20:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:20:41 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:20:41 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:20:46 Waiting for app: TestExipryReplace to get un-deployed
2021/12/25 10:20:51 Waiting for app: TestExipryReplace to get un-deployed
2021/12/25 10:20:56 Waiting for app: TestExipryReplace to get un-deployed
2021/12/25 10:21:01 Waiting for app: TestExipryReplace to get un-deployed
2021/12/25 10:21:01 App: TestExipryReplace got un-deployed
2021/12/25 10:21:01 No eventing-con process running
2021/12/25 10:21:01 Function: TestExipryReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace deleting in background"
}
2021/12/25 10:21:03 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:21:13 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:21:18 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/25 10:21:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:21:20 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:21:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryReplace (210.49s)
=== RUN   TestExipryUpsert
2021/12/25 10:21:25 Deploying app: TestExipryUpsert. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:21:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert stored in temp store"
}
2021/12/25 10:21:31 Waiting for app: TestExipryUpsert to get deployed
2021/12/25 10:21:36 Waiting for app: TestExipryUpsert to get deployed
2021/12/25 10:21:41 Waiting for app: TestExipryUpsert to get deployed
2021/12/25 10:21:46 Waiting for app: TestExipryUpsert to get deployed
2021/12/25 10:21:46 App: TestExipryUpsert got deployed
2021/12/25 10:21:46 Starting bucket ops to source bucket
2021/12/25 10:22:31 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:22:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:22:31 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:22:31 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:22:36 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/25 10:22:41 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/25 10:22:46 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/25 10:22:51 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/25 10:22:51 App: TestExipryUpsert got un-deployed
2021/12/25 10:22:51 No eventing-con process running
2021/12/25 10:22:51 Function: TestExipryUpsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert deleting in background"
}
2021/12/25 10:22:53 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:22:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:23:00 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:23:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:23:05 Testing on the destination bucket for expiry insert
2021/12/25 10:23:05 Deploying app: TestExipryUpsert. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:23:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert stored in temp store"
}
2021/12/25 10:23:11 Waiting for app: TestExipryUpsert to get deployed
2021/12/25 10:23:16 Waiting for app: TestExipryUpsert to get deployed
2021/12/25 10:23:21 Waiting for app: TestExipryUpsert to get deployed
2021/12/25 10:23:26 Waiting for app: TestExipryUpsert to get deployed
2021/12/25 10:23:26 App: TestExipryUpsert got deployed
2021/12/25 10:23:26 Starting bucket ops to source bucket
2021/12/25 10:24:12 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:24:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:24:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:24:12 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:24:17 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/25 10:24:22 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/25 10:24:27 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/25 10:24:32 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/25 10:24:32 App: TestExipryUpsert got un-deployed
2021/12/25 10:24:32 No eventing-con process running
2021/12/25 10:24:32 Function: TestExipryUpsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert deleting in background"
}
2021/12/25 10:24:34 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:24:44 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:24:49 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/25 10:24:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:24:50 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:24:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryUpsert (210.72s)
=== RUN   TestCasReplace
2021/12/25 10:24:55 Deploying app: TestCasReplace. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:24:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace stored in temp store"
}
2021/12/25 10:25:02 Waiting for app: TestCasReplace to get deployed
2021/12/25 10:25:07 Waiting for app: TestCasReplace to get deployed
2021/12/25 10:25:12 Waiting for app: TestCasReplace to get deployed
2021/12/25 10:25:17 Waiting for app: TestCasReplace to get deployed
2021/12/25 10:25:17 App: TestCasReplace got deployed
2021/12/25 10:25:17 Starting bucket ops to source bucket
2021/12/25 10:25:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:25:17 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:25:17 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:25:22 Waiting for app: TestCasReplace to get un-deployed
2021/12/25 10:25:27 Waiting for app: TestCasReplace to get un-deployed
2021/12/25 10:25:32 Waiting for app: TestCasReplace to get un-deployed
2021/12/25 10:25:37 Waiting for app: TestCasReplace to get un-deployed
2021/12/25 10:25:37 App: TestCasReplace got un-deployed
2021/12/25 10:25:37 No eventing-con process running
2021/12/25 10:25:37 Function: TestCasReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace deleting in background"
}
2021/12/25 10:25:39 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:25:49 Waiting for dst bucket item count to get to: 0 curr count: 4
2021/12/25 10:25:54 Waiting for dst bucket item count to get to: 0 curr count: 4
2021/12/25 10:25:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:25:55 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:26:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:26:00 Testing on the destination bucket for upsert with cas
2021/12/25 10:26:00 Starting bucket ops to source bucket
2021/12/25 10:26:01 Deploying app: TestCasReplace. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:26:02 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace stored in temp store"
}
2021/12/25 10:26:07 Waiting for app: TestCasReplace to get deployed
2021/12/25 10:26:12 Waiting for app: TestCasReplace to get deployed
2021/12/25 10:26:17 Waiting for app: TestCasReplace to get deployed
2021/12/25 10:26:22 Waiting for app: TestCasReplace to get deployed
2021/12/25 10:26:22 App: TestCasReplace got deployed
2021/12/25 10:26:22 Starting bucket ops to source bucket
2021/12/25 10:26:27 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:26:32 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:26:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:26:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:26:32 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:26:37 Waiting for app: TestCasReplace to get un-deployed
2021/12/25 10:26:42 Waiting for app: TestCasReplace to get un-deployed
2021/12/25 10:26:47 Waiting for app: TestCasReplace to get un-deployed
2021/12/25 10:26:52 Waiting for app: TestCasReplace to get un-deployed
2021/12/25 10:26:52 App: TestCasReplace got un-deployed
2021/12/25 10:26:52 No eventing-con process running
2021/12/25 10:26:52 Function: TestCasReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace deleting in background"
}
2021/12/25 10:26:54 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:27:04 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:27:09 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/25 10:27:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:27:11 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:27:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCasReplace (140.26s)
=== RUN   TestCasDelete
2021/12/25 10:27:16 Deploying app: TestCasDelete. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:27:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete stored in temp store"
}
2021/12/25 10:27:22 Waiting for app: TestCasDelete to get deployed
2021/12/25 10:27:27 Waiting for app: TestCasDelete to get deployed
2021/12/25 10:27:32 Waiting for app: TestCasDelete to get deployed
2021/12/25 10:27:37 Waiting for app: TestCasDelete to get deployed
2021/12/25 10:27:37 App: TestCasDelete got deployed
2021/12/25 10:27:37 Starting bucket ops to source bucket
2021/12/25 10:27:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:27:37 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:27:37 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:27:42 Waiting for app: TestCasDelete to get un-deployed
2021/12/25 10:27:47 Waiting for app: TestCasDelete to get un-deployed
2021/12/25 10:27:52 Waiting for app: TestCasDelete to get un-deployed
2021/12/25 10:27:57 Waiting for app: TestCasDelete to get un-deployed
2021/12/25 10:27:57 App: TestCasDelete got un-deployed
2021/12/25 10:27:57 No eventing-con process running
2021/12/25 10:27:57 Function: TestCasDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete deleting in background"
}
2021/12/25 10:27:59 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:28:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:28:06 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:28:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:28:11 Testing on the destination bucket for delete with cas
2021/12/25 10:28:11 Starting bucket ops to source bucket
2021/12/25 10:28:11 Deploying app: TestCasDelete. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:28:12 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete stored in temp store"
}
2021/12/25 10:28:17 Waiting for app: TestCasDelete to get deployed
2021/12/25 10:28:22 Waiting for app: TestCasDelete to get deployed
2021/12/25 10:28:27 Waiting for app: TestCasDelete to get deployed
2021/12/25 10:28:32 Waiting for app: TestCasDelete to get deployed
2021/12/25 10:28:32 App: TestCasDelete got deployed
2021/12/25 10:28:32 Starting bucket ops to source bucket
2021/12/25 10:28:38 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:28:43 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:28:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:28:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:28:43 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 10:28:48 Waiting for app: TestCasDelete to get un-deployed
2021/12/25 10:28:53 Waiting for app: TestCasDelete to get un-deployed
2021/12/25 10:28:58 Waiting for app: TestCasDelete to get un-deployed
2021/12/25 10:29:03 Waiting for app: TestCasDelete to get un-deployed
2021/12/25 10:29:03 App: TestCasDelete got un-deployed
2021/12/25 10:29:03 No eventing-con process running
2021/12/25 10:29:03 Function: TestCasDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete deleting in background"
}
2021/12/25 10:29:05 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:29:15 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:29:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:29:16 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:29:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCasDelete (125.72s)
=== RUN   TestCountersIncrement
2021/12/25 10:29:21 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/25 10:29:27 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 10:29:28 Removing node(s): [] from the cluster
2021/12/25 10:29:33 Rebalance progress: 100
2021/12/25 10:29:33 Deploying app: TestCountersIncrement. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:29:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement stored in temp store"
}
2021/12/25 10:29:39 Waiting for app: TestCountersIncrement to get deployed
2021/12/25 10:29:44 Waiting for app: TestCountersIncrement to get deployed
2021/12/25 10:29:49 Waiting for app: TestCountersIncrement to get deployed
2021/12/25 10:29:54 Waiting for app: TestCountersIncrement to get deployed
2021/12/25 10:29:54 App: TestCountersIncrement got deployed
2021/12/25 10:29:54 Starting bucket ops to source bucket
2021/12/25 10:30:00 Waiting for dst bucket item count to get to: 1024 curr count: 0
2021/12/25 10:30:05 Waiting for dst bucket item count to get to: 1024 curr count: 0
2021/12/25 10:30:05 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2021/12/25 10:30:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:30:10 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/25 10:30:15 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/25 10:30:20 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/25 10:30:25 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/25 10:30:25 App: TestCountersIncrement got un-deployed
2021/12/25 10:30:25 No eventing-con process running
2021/12/25 10:30:25 Function: TestCountersIncrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement deleting in background"
}
2021/12/25 10:30:27 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:30:37 Waiting for dst bucket item count to get to: 0 curr count: 1025
2021/12/25 10:30:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:30:39 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:30:49 Waiting for dst bucket item count to get to: 0 curr count: 967
2021/12/25 10:30:54 Waiting for dst bucket item count to get to: 0 curr count: 455
2021/12/25 10:30:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:30:54 Deploying app: TestCountersIncrement. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:30:55 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement stored in temp store"
}
2021/12/25 10:31:00 Waiting for app: TestCountersIncrement to get deployed
2021/12/25 10:31:05 Waiting for app: TestCountersIncrement to get deployed
2021/12/25 10:31:10 Waiting for app: TestCountersIncrement to get deployed
2021/12/25 10:31:15 Waiting for app: TestCountersIncrement to get deployed
2021/12/25 10:31:15 App: TestCountersIncrement got deployed
2021/12/25 10:31:15 Starting bucket ops to source bucket
2021/12/25 10:31:21 Waiting for dst bucket item count to get to: 2048 curr count: 0
2021/12/25 10:31:26 Waiting for dst bucket item count to get to: 2048 curr count: 1024
2021/12/25 10:31:26 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2021/12/25 10:31:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:31:31 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/25 10:31:36 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/25 10:31:41 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/25 10:31:46 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/25 10:31:46 App: TestCountersIncrement got un-deployed
2021/12/25 10:31:46 No eventing-con process running
2021/12/25 10:31:46 Function: TestCountersIncrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement deleting in background"
}
2021/12/25 10:31:48 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:31:58 Waiting for dst bucket item count to get to: 0 curr count: 1543
2021/12/25 10:32:03 Waiting for dst bucket item count to get to: 0 curr count: 519
2021/12/25 10:32:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:32:05 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:32:15 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/25 10:32:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:32:15 Removing node(s): [http://127.0.0.1:19002 http://127.0.0.1:19003] from the cluster
2021/12/25 10:32:20 Rebalance progress: 100
--- PASS: TestCountersIncrement (178.74s)
=== RUN   TestCountersDecrement
2021/12/25 10:32:20 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/25 10:32:21 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 10:32:21 Removing node(s): [] from the cluster
2021/12/25 10:32:26 Rebalance progress: 100
2021/12/25 10:32:26 Deploying app: TestCountersDecrement. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:32:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement stored in temp store"
}
2021/12/25 10:32:32 Waiting for app: TestCountersDecrement to get deployed
2021/12/25 10:32:37 Waiting for app: TestCountersDecrement to get deployed
2021/12/25 10:32:42 Waiting for app: TestCountersDecrement to get deployed
2021/12/25 10:32:47 Waiting for app: TestCountersDecrement to get deployed
2021/12/25 10:32:47 App: TestCountersDecrement got deployed
2021/12/25 10:32:47 Starting bucket ops to source bucket
2021/12/25 10:32:53 Waiting for dst bucket item count to get to: 1024 curr count: 0
2021/12/25 10:32:58 Waiting for dst bucket item count to get to: 1024 curr count: 512
2021/12/25 10:33:03 Waiting for dst bucket item count to get to: 1024 curr count: 512
2021/12/25 10:33:03 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2021/12/25 10:33:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:33:08 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/25 10:33:14 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/25 10:33:19 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/25 10:33:24 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/25 10:33:24 App: TestCountersDecrement got un-deployed
2021/12/25 10:33:24 No eventing-con process running
2021/12/25 10:33:24 Function: TestCountersDecrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement deleting in background"
}
2021/12/25 10:33:25 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:33:35 Waiting for dst bucket item count to get to: 0 curr count: 1025
2021/12/25 10:33:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:33:37 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:33:47 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/25 10:33:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:33:47 Deploying app: TestCountersDecrement. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:33:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement stored in temp store"
}
2021/12/25 10:33:53 Waiting for app: TestCountersDecrement to get deployed
2021/12/25 10:33:58 Waiting for app: TestCountersDecrement to get deployed
2021/12/25 10:34:03 Waiting for app: TestCountersDecrement to get deployed
2021/12/25 10:34:08 Waiting for app: TestCountersDecrement to get deployed
2021/12/25 10:34:08 App: TestCountersDecrement got deployed
2021/12/25 10:34:08 Starting bucket ops to source bucket
2021/12/25 10:34:15 Waiting for dst bucket item count to get to: 2048 curr count: 0
2021/12/25 10:34:20 Waiting for dst bucket item count to get to: 2048 curr count: 813
2021/12/25 10:34:25 Waiting for dst bucket item count to get to: 2048 curr count: 1837
2021/12/25 10:34:25 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2021/12/25 10:34:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:34:30 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/25 10:34:35 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/25 10:34:40 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/25 10:34:45 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/25 10:34:45 App: TestCountersDecrement got un-deployed
2021/12/25 10:34:45 No eventing-con process running
2021/12/25 10:34:45 Function: TestCountersDecrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement deleting in background"
}
2021/12/25 10:34:47 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:34:57 Waiting for dst bucket item count to get to: 0 curr count: 2048
2021/12/25 10:34:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:34:58 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:35:08 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/25 10:35:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:35:08 Removing node(s): [http://127.0.0.1:19002 http://127.0.0.1:19003] from the cluster
2021/12/25 10:35:13 Rebalance progress: 100
--- PASS: TestCountersDecrement (173.40s)
=== RUN   TestCacheGet
2021/12/25 10:35:13 Deploying app: TestCacheGet. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:35:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheGet stored in temp store"
}
2021/12/25 10:35:20 Waiting for app: TestCacheGet to get deployed
2021/12/25 10:35:25 Waiting for app: TestCacheGet to get deployed
2021/12/25 10:35:30 Waiting for app: TestCacheGet to get deployed
2021/12/25 10:35:35 Waiting for app: TestCacheGet to get deployed
2021/12/25 10:35:35 App: TestCacheGet got deployed
2021/12/25 10:35:35 Starting bucket ops to source bucket
2021/12/25 10:35:40 Waiting for dst bucket item count to get to: 20 curr count: 0
2021/12/25 10:35:45 Waiting for dst bucket item count to get to: 20 curr count: 0
2021/12/25 10:35:50 Waiting for dst bucket item count to get to: 20 curr count: 0
2021/12/25 10:35:55 Waiting for dst bucket item count to get to: 20 curr count: 4
2021/12/25 10:36:00 Waiting for dst bucket item count to get to: 20 curr count: 12
2021/12/25 10:36:05 Waiting for dst bucket item count to get to: 20 curr count: 18
2021/12/25 10:36:05 src & dst bucket item count matched up. src bucket count: 20 dst bucket count: 20
2021/12/25 10:36:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:36:10 Waiting for app: TestCacheGet to get un-deployed
2021/12/25 10:36:15 Waiting for app: TestCacheGet to get un-deployed
2021/12/25 10:36:20 Waiting for app: TestCacheGet to get un-deployed
2021/12/25 10:36:25 Waiting for app: TestCacheGet to get un-deployed
2021/12/25 10:36:25 App: TestCacheGet got un-deployed
2021/12/25 10:36:25 No eventing-con process running
2021/12/25 10:36:25 Function: TestCacheGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheGet deleting in background"
}
2021/12/25 10:36:27 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:36:37 Waiting for dst bucket item count to get to: 0 curr count: 20
2021/12/25 10:36:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:36:39 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:36:49 Waiting for dst bucket item count to get to: 0 curr count: 17
2021/12/25 10:36:54 Waiting for dst bucket item count to get to: 0 curr count: 7
2021/12/25 10:36:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheGet (100.15s)
=== RUN   TestCacheRYOW
2021/12/25 10:36:54 Deploying app: TestCacheRYOW. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:36:55 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheRYOW stored in temp store"
}
2021/12/25 10:37:00 Waiting for app: TestCacheRYOW to get deployed
2021/12/25 10:37:05 Waiting for app: TestCacheRYOW to get deployed
2021/12/25 10:37:10 Waiting for app: TestCacheRYOW to get deployed
2021/12/25 10:37:15 Waiting for app: TestCacheRYOW to get deployed
2021/12/25 10:37:15 App: TestCacheRYOW got deployed
2021/12/25 10:37:15 Starting bucket ops to source bucket
2021/12/25 10:37:20 Waiting for dst bucket item count to get to: 50 curr count: 0
2021/12/25 10:37:25 Waiting for dst bucket item count to get to: 50 curr count: 25
2021/12/25 10:37:25 src & dst bucket item count matched up. src bucket count: 50 dst bucket count: 50
2021/12/25 10:37:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:37:30 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/25 10:37:35 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/25 10:37:40 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/25 10:37:45 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/25 10:37:45 App: TestCacheRYOW got un-deployed
2021/12/25 10:37:45 No eventing-con process running
2021/12/25 10:37:45 Function: TestCacheRYOW delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheRYOW deleting in background"
}
2021/12/25 10:37:47 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:37:57 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/25 10:37:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:37:59 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:38:09 Waiting for dst bucket item count to get to: 0 curr count: 47
2021/12/25 10:38:14 Waiting for dst bucket item count to get to: 0 curr count: 22
2021/12/25 10:38:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheRYOW (80.19s)
=== RUN   TestCacheExpiry
2021/12/25 10:38:14 Deploying app: TestCacheExpiry. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:38:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiry stored in temp store"
}
2021/12/25 10:38:20 Waiting for app: TestCacheExpiry to get deployed
2021/12/25 10:38:25 Waiting for app: TestCacheExpiry to get deployed
2021/12/25 10:38:30 Waiting for app: TestCacheExpiry to get deployed
2021/12/25 10:38:35 Waiting for app: TestCacheExpiry to get deployed
2021/12/25 10:38:35 App: TestCacheExpiry got deployed
2021/12/25 10:38:35 Starting bucket ops to source bucket
2021/12/25 10:38:40 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/25 10:38:45 Waiting for dst bucket item count to get to: 100 curr count: 13
2021/12/25 10:38:50 Waiting for dst bucket item count to get to: 100 curr count: 37
2021/12/25 10:38:55 Waiting for dst bucket item count to get to: 100 curr count: 97
2021/12/25 10:39:00 Waiting for dst bucket item count to get to: 100 curr count: 97
2021/12/25 10:39:00 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/25 10:39:00 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:39:05 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/25 10:39:11 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/25 10:39:16 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/25 10:39:21 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/25 10:39:21 App: TestCacheExpiry got un-deployed
2021/12/25 10:39:21 No eventing-con process running
2021/12/25 10:39:21 Function: TestCacheExpiry delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiry deleting in background"
}
2021/12/25 10:39:22 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:39:32 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/25 10:39:37 Waiting for dst bucket item count to get to: 0 curr count: 25
2021/12/25 10:39:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:39:39 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:39:49 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:39:54 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/25 10:39:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheExpiry (100.28s)
=== RUN   TestCacheExpiryCustom
2021/12/25 10:39:54 Deploying app: TestCacheExpiryCustom. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:39:55 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiryCustom stored in temp store"
}
2021/12/25 10:40:00 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/25 10:40:05 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/25 10:40:10 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/25 10:40:15 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/25 10:40:15 App: TestCacheExpiryCustom got deployed
2021/12/25 10:40:15 Starting bucket ops to source bucket
2021/12/25 10:40:21 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/25 10:40:26 Waiting for dst bucket item count to get to: 100 curr count: 19
2021/12/25 10:40:31 Waiting for dst bucket item count to get to: 100 curr count: 19
2021/12/25 10:40:36 Waiting for dst bucket item count to get to: 100 curr count: 94
2021/12/25 10:40:41 Waiting for dst bucket item count to get to: 100 curr count: 94
2021/12/25 10:40:41 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/25 10:40:41 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:40:46 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/25 10:40:51 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/25 10:40:56 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/25 10:41:01 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/25 10:41:01 App: TestCacheExpiryCustom got un-deployed
2021/12/25 10:41:01 No eventing-con process running
2021/12/25 10:41:01 Function: TestCacheExpiryCustom delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiryCustom deleting in background"
}
2021/12/25 10:41:03 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:41:13 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/25 10:41:18 Waiting for dst bucket item count to get to: 0 curr count: 25
2021/12/25 10:41:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:41:19 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:41:29 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/25 10:41:34 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/25 10:41:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheExpiryCustom (100.35s)
=== RUN   TestCacheOverflowCustom
2021/12/25 10:41:34 Deploying app: TestCacheOverflowCustom. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:41:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheOverflowCustom stored in temp store"
}
2021/12/25 10:41:41 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/25 10:41:46 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/25 10:41:51 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/25 10:41:56 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/25 10:41:56 App: TestCacheOverflowCustom got deployed
2021/12/25 10:41:56 Starting bucket ops to source bucket
2021/12/25 10:42:01 Waiting for dst bucket item count to get to: 35 curr count: 0
2021/12/25 10:42:06 Waiting for dst bucket item count to get to: 35 curr count: 13
2021/12/25 10:42:11 Waiting for dst bucket item count to get to: 35 curr count: 13
2021/12/25 10:42:16 Waiting for dst bucket item count to get to: 35 curr count: 27
2021/12/25 10:42:21 Waiting for dst bucket item count to get to: 35 curr count: 27
2021/12/25 10:42:21 src & dst bucket item count matched up. src bucket count: 35 dst bucket count: 35
2021/12/25 10:42:21 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:42:26 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/25 10:42:31 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/25 10:42:36 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/25 10:42:41 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/25 10:42:41 App: TestCacheOverflowCustom got un-deployed
2021/12/25 10:42:41 No eventing-con process running
2021/12/25 10:42:41 Function: TestCacheOverflowCustom delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheOverflowCustom deleting in background"
}
2021/12/25 10:42:43 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:42:53 Waiting for dst bucket item count to get to: 0 curr count: 5
2021/12/25 10:42:58 Waiting for dst bucket item count to get to: 0 curr count: 3
2021/12/25 10:42:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:43:00 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:43:10 Waiting for dst bucket item count to get to: 0 curr count: 17
2021/12/25 10:43:15 Waiting for dst bucket item count to get to: 0 curr count: 17
2021/12/25 10:43:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheOverflowCustom (100.22s)
=== RUN   TestStrictMode
2021/12/25 10:43:15 Deploying app: TestStrictMode. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:43:16 Context: Post to main store, response code: 422 dump: {
 "name": "ERR_HANDLER_COMPILATION",
 "code": 27,
 "description": {
  "area": "handlerCode",
  "column_number": 63,
  "compile_success": false,
  "description": "        destination[meta.id] = 00000000000000000000000000000101;\n                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nSyntaxError: Octal literals are not allowed in strict mode.\n",
  "index": 132,
  "language": "JavaScript",
  "line_number": 4
 }
}
--- PASS: TestStrictMode (1.06s)
=== RUN   TestDataTypes
2021/12/25 10:43:16 Deploying app: TestDataTypes. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:43:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDataTypes stored in temp store"
}
2021/12/25 10:43:22 Waiting for app: TestDataTypes to get deployed
2021/12/25 10:43:27 Waiting for app: TestDataTypes to get deployed
2021/12/25 10:43:32 Waiting for app: TestDataTypes to get deployed
2021/12/25 10:43:37 Waiting for app: TestDataTypes to get deployed
2021/12/25 10:43:37 App: TestDataTypes got deployed
2021/12/25 10:43:37 Starting bucket ops to source bucket
2021/12/25 10:43:42 Waiting for dst bucket item count to get to: 18 curr count: 0
2021/12/25 10:43:42 src & dst bucket item count matched up. src bucket count: 18 dst bucket count: 18
2021/12/25 10:43:42 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:43:47 Waiting for app: TestDataTypes to get un-deployed
2021/12/25 10:43:52 Waiting for app: TestDataTypes to get un-deployed
2021/12/25 10:43:57 Waiting for app: TestDataTypes to get un-deployed
2021/12/25 10:43:57 App: TestDataTypes got un-deployed
2021/12/25 10:43:57 No eventing-con process running
2021/12/25 10:43:57 Function: TestDataTypes delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDataTypes deleting in background"
}
2021/12/25 10:43:59 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:44:09 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/25 10:44:14 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/25 10:44:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:44:16 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:44:26 Waiting for dst bucket item count to get to: 0 curr count: 18
2021/12/25 10:44:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDataTypes (70.19s)
=== RUN   TestEnoentGet
2021/12/25 10:44:26 Deploying app: TestEnoentGet. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:44:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet stored in temp store"
}
2021/12/25 10:44:32 Waiting for app: TestEnoentGet to get deployed
2021/12/25 10:44:37 Waiting for app: TestEnoentGet to get deployed
2021/12/25 10:44:42 Waiting for app: TestEnoentGet to get deployed
2021/12/25 10:44:47 Waiting for app: TestEnoentGet to get deployed
2021/12/25 10:44:47 App: TestEnoentGet got deployed
2021/12/25 10:44:47 Starting bucket ops to source bucket
2021/12/25 10:44:52 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/25 10:44:57 Waiting for dst bucket item count to get to: 100 curr count: 81
2021/12/25 10:45:02 Waiting for dst bucket item count to get to: 100 curr count: 81
2021/12/25 10:45:02 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/25 10:45:02 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:45:07 Waiting for app: TestEnoentGet to get un-deployed
2021/12/25 10:45:13 Waiting for app: TestEnoentGet to get un-deployed
2021/12/25 10:45:18 Waiting for app: TestEnoentGet to get un-deployed
2021/12/25 10:45:23 Waiting for app: TestEnoentGet to get un-deployed
2021/12/25 10:45:23 App: TestEnoentGet got un-deployed
2021/12/25 10:45:23 No eventing-con process running
2021/12/25 10:45:23 Function: TestEnoentGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet deleting in background"
}
2021/12/25 10:45:24 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:45:34 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:45:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:45:36 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:45:46 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:45:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:45:46 Deploying app: TestEnoentGet. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:45:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet stored in temp store"
}
2021/12/25 10:45:52 Waiting for app: TestEnoentGet to get deployed
2021/12/25 10:45:57 Waiting for app: TestEnoentGet to get deployed
2021/12/25 10:46:02 Waiting for app: TestEnoentGet to get deployed
2021/12/25 10:46:07 Waiting for app: TestEnoentGet to get deployed
2021/12/25 10:46:07 App: TestEnoentGet got deployed
2021/12/25 10:46:07 Starting bucket ops to source bucket
2021/12/25 10:46:12 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/25 10:46:17 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/25 10:46:22 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/25 10:46:22 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/25 10:46:22 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:46:28 Waiting for app: TestEnoentGet to get un-deployed
2021/12/25 10:46:33 Waiting for app: TestEnoentGet to get un-deployed
2021/12/25 10:46:38 Waiting for app: TestEnoentGet to get un-deployed
2021/12/25 10:46:43 Waiting for app: TestEnoentGet to get un-deployed
2021/12/25 10:46:43 App: TestEnoentGet got un-deployed
2021/12/25 10:46:43 No eventing-con process running
2021/12/25 10:46:43 Function: TestEnoentGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet deleting in background"
}
2021/12/25 10:46:44 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:46:54 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:46:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:46:56 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:47:06 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:47:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentGet (160.40s)
=== RUN   TestEnoentDelete
2021/12/25 10:47:06 Deploying app: TestEnoentDelete. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:47:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete stored in temp store"
}
2021/12/25 10:47:12 Waiting for app: TestEnoentDelete to get deployed
2021/12/25 10:47:17 Waiting for app: TestEnoentDelete to get deployed
2021/12/25 10:47:22 Waiting for app: TestEnoentDelete to get deployed
2021/12/25 10:47:27 Waiting for app: TestEnoentDelete to get deployed
2021/12/25 10:47:27 App: TestEnoentDelete got deployed
2021/12/25 10:47:27 Starting bucket ops to source bucket
2021/12/25 10:47:33 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/25 10:47:38 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/25 10:47:43 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/25 10:47:43 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/25 10:47:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:47:48 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/25 10:47:53 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/25 10:47:58 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/25 10:48:03 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/25 10:48:03 App: TestEnoentDelete got un-deployed
2021/12/25 10:48:03 No eventing-con process running
2021/12/25 10:48:03 Function: TestEnoentDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete deleting in background"
}
2021/12/25 10:48:05 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:48:15 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:48:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:48:17 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:48:27 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:48:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:48:27 Deploying app: TestEnoentDelete. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:48:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete stored in temp store"
}
2021/12/25 10:48:33 Waiting for app: TestEnoentDelete to get deployed
2021/12/25 10:48:38 Waiting for app: TestEnoentDelete to get deployed
2021/12/25 10:48:43 Waiting for app: TestEnoentDelete to get deployed
2021/12/25 10:48:48 Waiting for app: TestEnoentDelete to get deployed
2021/12/25 10:48:48 App: TestEnoentDelete got deployed
2021/12/25 10:48:48 Starting bucket ops to source bucket
2021/12/25 10:48:53 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/25 10:48:58 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/25 10:49:03 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/25 10:49:03 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/25 10:49:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:49:08 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/25 10:49:13 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/25 10:49:18 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/25 10:49:23 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/25 10:49:23 App: TestEnoentDelete got un-deployed
2021/12/25 10:49:23 No eventing-con process running
2021/12/25 10:49:23 Function: TestEnoentDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete deleting in background"
}
2021/12/25 10:49:25 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:49:35 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:49:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:49:37 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:49:47 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:49:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentDelete (160.58s)
=== RUN   TestError
2021/12/25 10:49:57 Waiting for app: TestError to get un-deployed
2021/12/25 10:49:57 App: TestError got un-deployed
2021/12/25 10:49:57 No eventing-con process running
2021/12/25 10:49:57 Function: TestError delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestError not found"
}
2021/12/25 10:49:59 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:50:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:50:05 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:50:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:50:10 Deploying app: TestError. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:50:11 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestError stored in temp store"
}
2021/12/25 10:50:16 Waiting for app: TestError to get deployed
2021/12/25 10:50:22 Waiting for app: TestError to get deployed
2021/12/25 10:50:27 Waiting for app: TestError to get deployed
2021/12/25 10:50:32 Waiting for app: TestError to get deployed
2021/12/25 10:50:32 App: TestError got deployed
2021/12/25 10:50:32 Starting bucket ops to source bucket
2021/12/25 10:50:37 Waiting for dst bucket item count to get to: 300 curr count: 0
2021/12/25 10:50:42 Waiting for dst bucket item count to get to: 300 curr count: 0
2021/12/25 10:50:42 src & dst bucket item count matched up. src bucket count: 300 dst bucket count: 300
2021/12/25 10:50:42 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:50:47 Waiting for app: TestError to get un-deployed
2021/12/25 10:50:52 Waiting for app: TestError to get un-deployed
2021/12/25 10:50:57 Waiting for app: TestError to get un-deployed
2021/12/25 10:51:02 Waiting for app: TestError to get un-deployed
2021/12/25 10:51:02 App: TestError got un-deployed
2021/12/25 10:51:02 No eventing-con process running
2021/12/25 10:51:02 Function: TestError delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestError deleting in background"
}
2021/12/25 10:51:04 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:51:14 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:51:19 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/25 10:51:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:51:21 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:51:31 Waiting for dst bucket item count to get to: 0 curr count: 256
2021/12/25 10:51:36 Waiting for dst bucket item count to get to: 0 curr count: 256
2021/12/25 10:51:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestError (108.77s)
=== RUN   TestCRLF
2021/12/25 10:51:46 Waiting for app: TestCRLF to get un-deployed
2021/12/25 10:51:46 App: TestCRLF got un-deployed
2021/12/25 10:51:46 No eventing-con process running
2021/12/25 10:51:46 Function: TestCRLF delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCRLF not found"
}
2021/12/25 10:51:47 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:51:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:51:54 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:51:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:51:59 Deploying app: TestCRLF. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:52:00 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCRLF stored in temp store"
}
2021/12/25 10:52:05 Waiting for app: TestCRLF to get deployed
2021/12/25 10:52:10 Waiting for app: TestCRLF to get deployed
2021/12/25 10:52:15 Waiting for app: TestCRLF to get deployed
2021/12/25 10:52:20 Waiting for app: TestCRLF to get deployed
2021/12/25 10:52:20 App: TestCRLF got deployed
2021/12/25 10:52:20 Starting bucket ops to source bucket
2021/12/25 10:52:26 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/25 10:52:31 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/25 10:52:31 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/25 10:52:31 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:52:36 Waiting for app: TestCRLF to get un-deployed
2021/12/25 10:52:41 Waiting for app: TestCRLF to get un-deployed
2021/12/25 10:52:46 Waiting for app: TestCRLF to get un-deployed
2021/12/25 10:52:51 Waiting for app: TestCRLF to get un-deployed
2021/12/25 10:52:51 App: TestCRLF got un-deployed
2021/12/25 10:52:51 No eventing-con process running
2021/12/25 10:52:51 Function: TestCRLF delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCRLF deleting in background"
}
2021/12/25 10:52:53 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:53:03 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 10:53:08 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/25 10:53:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:53:09 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:53:20 Waiting for dst bucket item count to get to: 0 curr count: 44
2021/12/25 10:53:25 Waiting for dst bucket item count to get to: 0 curr count: 44
2021/12/25 10:53:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCRLF (108.91s)
=== RUN   TestImportExport
2021/12/25 10:53:35 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/25 10:53:35 App: TestImportExport_n1ql_insert_on_update got un-deployed
2021/12/25 10:53:35 No eventing-con process running
2021/12/25 10:53:35 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestImportExport_n1ql_insert_on_update not found"
}
2021/12/25 10:53:36 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:53:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:53:43 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:53:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:53:53 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/25 10:53:53 App: TestImportExport_bucket_op_on_update got un-deployed
2021/12/25 10:53:53 No eventing-con process running
2021/12/25 10:53:53 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestImportExport_bucket_op_on_update not found"
}
2021/12/25 10:53:55 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:54:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:54:02 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:54:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:54:07 Deploying app: TestImportExport_n1ql_insert_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:54:08 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update stored in temp store"
}
2021/12/25 10:54:08 Deploying app: TestImportExport_bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:54:09 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update stored in temp store"
}
2021/12/25 10:54:14 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/25 10:54:19 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/25 10:54:24 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/25 10:54:29 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/25 10:54:29 App: TestImportExport_n1ql_insert_on_update got deployed
2021/12/25 10:54:34 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2021/12/25 10:54:39 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2021/12/25 10:54:44 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2021/12/25 10:54:44 App: TestImportExport_bucket_op_on_update got deployed
2021/12/25 10:54:49 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/25 10:54:54 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/25 10:54:59 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/25 10:55:04 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/25 10:55:04 App: TestImportExport_n1ql_insert_on_update got un-deployed
2021/12/25 10:55:04 No eventing-con process running
2021/12/25 10:55:05 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update deleting in background"
}
2021/12/25 10:55:10 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/25 10:55:15 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/25 10:55:20 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/25 10:55:25 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/25 10:55:25 App: TestImportExport_bucket_op_on_update got un-deployed
2021/12/25 10:55:25 No eventing-con process running
2021/12/25 10:55:25 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update deleting in background"
}
2021/12/25 10:55:42 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/25 10:55:42 App: TestImportExport_bucket_op_on_update got un-deployed
2021/12/25 10:55:42 No eventing-con process running
2021/12/25 10:55:42 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update deleting in background"
}
2021/12/25 10:55:44 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:55:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:55:51 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:55:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:56:01 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/25 10:56:01 App: TestImportExport_n1ql_insert_on_update got un-deployed
2021/12/25 10:56:01 No eventing-con process running
2021/12/25 10:56:01 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update deleting in background"
}
2021/12/25 10:56:03 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:56:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:56:09 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:56:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestImportExport (169.75s)
=== RUN   TestDeployUndeployLoopNonDefaultSettings
2021/12/25 10:56:24 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 10:56:24 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/25 10:56:24 No eventing-con process running
2021/12/25 10:56:24 Function: TestDeployUndeployLoopNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeployUndeployLoopNonDefaultSettings not found"
}
2021/12/25 10:56:26 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:56:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:56:33 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:56:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:56:38 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:56:39 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/25 10:56:39 Starting bucket ops to source bucket
2021/12/25 10:56:47 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 10:56:52 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 10:56:57 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 10:57:02 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 10:57:07 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/25 10:57:07 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 10:57:12 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/25 10:57:12 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/25 10:57:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:57:12 Undeploying app: bucket_op_on_update
2021/12/25 10:57:17 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 10:57:22 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 10:57:27 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 10:57:32 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 10:57:32 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/25 10:57:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:57:32 No eventing-con process running
2021/12/25 10:57:34 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:57:41 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:58:16 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:58:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/25 10:58:18 Starting bucket ops to source bucket
2021/12/25 10:58:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 10:58:30 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 10:58:35 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 10:58:40 Waiting for dst bucket item count to get to: 5000 curr count: 708
2021/12/25 10:58:45 Waiting for dst bucket item count to get to: 5000 curr count: 708
2021/12/25 10:58:45 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 10:58:50 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/25 10:58:50 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/25 10:58:50 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 10:58:50 Undeploying app: bucket_op_on_update
2021/12/25 10:58:56 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 10:59:01 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 10:59:06 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 10:59:11 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 10:59:11 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/25 10:59:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 10:59:11 No eventing-con process running
2021/12/25 10:59:12 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:59:20 Context: Bucket flush, response code: 200 dump: 
2021/12/25 10:59:55 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/25 10:59:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/25 10:59:56 Starting bucket ops to source bucket
2021/12/25 11:00:04 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:00:09 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:00:14 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:00:19 Waiting for dst bucket item count to get to: 5000 curr count: 2420
2021/12/25 11:00:24 Waiting for dst bucket item count to get to: 5000 curr count: 2420
2021/12/25 11:00:24 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:00:29 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/25 11:00:29 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/25 11:00:29 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:00:29 Undeploying app: bucket_op_on_update
2021/12/25 11:00:34 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 11:00:39 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 11:00:44 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 11:00:49 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 11:00:49 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/25 11:00:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:00:49 No eventing-con process running
2021/12/25 11:00:51 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:00:58 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:01:33 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:01:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/25 11:01:34 Starting bucket ops to source bucket
2021/12/25 11:01:42 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:01:47 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:01:52 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:01:57 Waiting for dst bucket item count to get to: 5000 curr count: 1313
2021/12/25 11:02:02 Waiting for dst bucket item count to get to: 5000 curr count: 3813
2021/12/25 11:02:02 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:02:07 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/25 11:02:07 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/25 11:02:07 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:02:07 Undeploying app: bucket_op_on_update
2021/12/25 11:02:12 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 11:02:17 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 11:02:22 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 11:02:27 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 11:02:27 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/25 11:02:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:02:27 No eventing-con process running
2021/12/25 11:02:29 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:02:36 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:03:11 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:03:13 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/25 11:03:13 Starting bucket ops to source bucket
2021/12/25 11:03:21 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:03:26 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:03:31 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:03:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:03:36 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:03:41 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/25 11:03:41 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/25 11:03:41 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:03:41 Undeploying app: bucket_op_on_update
2021/12/25 11:03:46 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 11:03:51 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 11:03:56 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 11:04:01 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/25 11:04:01 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/25 11:04:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:04:01 No eventing-con process running
2021/12/25 11:04:03 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:04:10 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:04:45 Function: TestDeployUndeployLoopNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings deleting in background"
}
--- PASS: TestDeployUndeployLoopNonDefaultSettings (510.62s)
=== RUN   TestOnUpdateN1QLOp
2021/12/25 11:04:55 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/25 11:04:55 App: TestOnUpdateN1QLOp got un-deployed
2021/12/25 11:04:55 No eventing-con process running
2021/12/25 11:04:55 Function: TestOnUpdateN1QLOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateN1QLOp not found"
}
2021/12/25 11:04:57 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:05:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:05:03 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:05:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:05:08 Deploying app: TestOnUpdateN1QLOp. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:05:10 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateN1QLOp stored in temp store"
}
2021/12/25 11:05:10 Starting bucket ops to source bucket
2021/12/25 11:05:17 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:05:22 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:05:27 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:05:32 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:05:37 Waiting for dst bucket item count to get to: 5000 curr count: 2514
2021/12/25 11:05:37 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:05:37 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:05:43 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/25 11:05:48 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/25 11:05:53 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/25 11:05:58 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/25 11:05:58 App: TestOnUpdateN1QLOp got un-deployed
2021/12/25 11:05:58 No eventing-con process running
2021/12/25 11:05:58 Function: TestOnUpdateN1QLOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateN1QLOp deleting in background"
}
2021/12/25 11:06:00 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:06:10 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/25 11:06:15 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/25 11:06:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:06:16 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:06:26 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 11:06:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateN1QLOp (101.40s)
=== RUN   TestOnUpdateBucketOpDefaultSettings
2021/12/25 11:06:36 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/25 11:06:36 App: TestOnUpdateBucketOpDefaultSettings got un-deployed
2021/12/25 11:06:36 No eventing-con process running
2021/12/25 11:06:36 Function: TestOnUpdateBucketOpDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings not found"
}
2021/12/25 11:06:38 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:06:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:06:45 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:06:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:06:50 Deploying app: TestOnUpdateBucketOpDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:06:51 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings stored in temp store"
}
2021/12/25 11:06:51 Starting bucket ops to source bucket
2021/12/25 11:06:59 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:07:04 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:07:09 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:07:14 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:07:14 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:07:14 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:07:19 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/25 11:07:24 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/25 11:07:29 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/25 11:07:34 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/25 11:07:34 App: TestOnUpdateBucketOpDefaultSettings got un-deployed
2021/12/25 11:07:34 No eventing-con process running
2021/12/25 11:07:34 Function: TestOnUpdateBucketOpDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings deleting in background"
}
2021/12/25 11:07:36 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:07:46 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 11:07:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:07:48 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:07:58 Waiting for dst bucket item count to get to: 0 curr count: 3132
2021/12/25 11:08:03 Waiting for dst bucket item count to get to: 0 curr count: 632
2021/12/25 11:08:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings (96.52s)
=== RUN   TestOnUpdateBucketOpNonDefaultSettings
2021/12/25 11:08:13 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/25 11:08:13 App: TestOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/25 11:08:13 No eventing-con process running
2021/12/25 11:08:13 Function: TestOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpNonDefaultSettings not found"
}
2021/12/25 11:08:15 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:08:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:08:21 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:08:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:08:26 Deploying app: TestOnUpdateBucketOpNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:08:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpNonDefaultSettings stored in temp store"
}
2021/12/25 11:08:28 Starting bucket ops to source bucket
2021/12/25 11:08:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:08:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:08:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:08:51 Waiting for dst bucket item count to get to: 5000 curr count: 364
2021/12/25 11:08:56 Waiting for dst bucket item count to get to: 5000 curr count: 364
2021/12/25 11:08:56 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:08:56 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:09:01 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/25 11:09:06 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/25 11:09:11 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/25 11:09:16 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/25 11:09:16 App: TestOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/25 11:09:16 No eventing-con process running
2021/12/25 11:09:16 Function: TestOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpNonDefaultSettings deleting in background"
}
2021/12/25 11:09:18 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:09:28 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/25 11:09:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:09:29 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:09:39 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/25 11:09:44 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/25 11:09:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpNonDefaultSettings (101.65s)
=== RUN   TestOnUpdateBucketOpDefaultSettings10K
2021/12/25 11:09:54 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/25 11:09:54 App: TestOnUpdateBucketOpDefaultSettings10K got un-deployed
2021/12/25 11:09:54 No eventing-con process running
2021/12/25 11:09:54 Function: TestOnUpdateBucketOpDefaultSettings10K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings10K not found"
}
2021/12/25 11:09:56 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:10:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:10:03 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:10:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:10:08 Deploying app: TestOnUpdateBucketOpDefaultSettings10K. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:10:09 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings10K stored in temp store"
}
2021/12/25 11:10:09 Starting bucket ops to source bucket
2021/12/25 11:10:17 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:10:22 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:10:27 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:10:32 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:10:37 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/25 11:10:37 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:10:37 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:10:42 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/25 11:10:47 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/25 11:10:52 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/25 11:10:57 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/25 11:10:57 App: TestOnUpdateBucketOpDefaultSettings10K got un-deployed
2021/12/25 11:10:57 No eventing-con process running
2021/12/25 11:10:57 Function: TestOnUpdateBucketOpDefaultSettings10K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings10K deleting in background"
}
2021/12/25 11:10:59 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:11:09 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 11:11:14 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/25 11:11:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:11:16 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:11:26 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 11:11:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings10K (101.51s)
=== RUN   TestOnUpdateBucketOpDefaultSettings100K
2021/12/25 11:11:36 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/25 11:11:36 App: TestOnUpdateBucketOpDefaultSettings100K got un-deployed
2021/12/25 11:11:36 No eventing-con process running
2021/12/25 11:11:36 Function: TestOnUpdateBucketOpDefaultSettings100K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings100K not found"
}
2021/12/25 11:11:38 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:11:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:11:45 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:11:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:11:50 Deploying app: TestOnUpdateBucketOpDefaultSettings100K. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:11:51 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings100K stored in temp store"
}
2021/12/25 11:11:51 Starting bucket ops to source bucket
2021/12/25 11:11:59 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:12:04 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:12:09 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:12:14 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:12:14 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:12:14 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:12:19 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/25 11:12:24 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/25 11:12:29 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/25 11:12:34 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/25 11:12:34 App: TestOnUpdateBucketOpDefaultSettings100K got un-deployed
2021/12/25 11:12:34 No eventing-con process running
2021/12/25 11:12:34 Function: TestOnUpdateBucketOpDefaultSettings100K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings100K deleting in background"
}
2021/12/25 11:12:36 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:12:46 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 11:12:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:12:48 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:12:58 Waiting for dst bucket item count to get to: 0 curr count: 3366
2021/12/25 11:13:03 Waiting for dst bucket item count to get to: 0 curr count: 866
2021/12/25 11:13:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings100K (96.98s)
=== RUN   TestOnDeleteBucketOp
2021/12/25 11:13:13 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/25 11:13:13 App: TestOnDeleteBucketOp got un-deployed
2021/12/25 11:13:13 No eventing-con process running
2021/12/25 11:13:13 Function: TestOnDeleteBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteBucketOp not found"
}
2021/12/25 11:13:15 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:13:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:13:21 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:13:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:13:26 Deploying app: TestOnDeleteBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:13:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp stored in temp store"
}
2021/12/25 11:13:28 Starting bucket ops to source bucket
2021/12/25 11:13:38 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:13:43 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:13:48 Waiting for dst bucket item count to get to: 5000 curr count: 420
2021/12/25 11:13:53 Waiting for dst bucket item count to get to: 5000 curr count: 420
2021/12/25 11:13:53 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:13:53 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:13:59 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/25 11:14:04 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/25 11:14:09 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/25 11:14:14 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/25 11:14:14 App: TestOnDeleteBucketOp got un-deployed
2021/12/25 11:14:14 No eventing-con process running
2021/12/25 11:14:14 Function: TestOnDeleteBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp deleting in background"
}
2021/12/25 11:14:15 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:14:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:14:23 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:14:33 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 11:14:38 Waiting for dst bucket item count to get to: 0 curr count: 2496
2021/12/25 11:14:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteBucketOp (94.83s)
=== RUN   TestOnDeleteBucketOp5K
2021/12/25 11:14:48 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/25 11:14:48 App: TestOnDeleteBucketOp5K got un-deployed
2021/12/25 11:14:48 No eventing-con process running
2021/12/25 11:14:48 Function: TestOnDeleteBucketOp5K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteBucketOp5K not found"
}
2021/12/25 11:14:50 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:14:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:14:56 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:15:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:15:01 Deploying app: TestOnDeleteBucketOp5K. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:15:03 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp5K stored in temp store"
}
2021/12/25 11:15:03 Starting bucket ops to source bucket
2021/12/25 11:15:13 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:15:18 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:15:23 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:15:23 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:15:23 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:15:28 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/25 11:15:34 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/25 11:15:39 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/25 11:15:44 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/25 11:15:44 App: TestOnDeleteBucketOp5K got un-deployed
2021/12/25 11:15:44 No eventing-con process running
2021/12/25 11:15:44 Function: TestOnDeleteBucketOp5K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp5K deleting in background"
}
2021/12/25 11:15:45 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:15:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:15:53 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:16:03 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 11:16:08 Waiting for dst bucket item count to get to: 0 curr count: 2496
2021/12/25 11:16:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteBucketOp5K (89.85s)
=== RUN   TestTimerBucketOp
2021/12/25 11:16:18 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/25 11:16:18 App: TestTimerBucketOp got un-deployed
2021/12/25 11:16:18 No eventing-con process running
2021/12/25 11:16:18 Function: TestTimerBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerBucketOp not found"
}
2021/12/25 11:16:19 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:16:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:16:26 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:16:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:16:31 Deploying app: TestTimerBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:16:32 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerBucketOp stored in temp store"
}
2021/12/25 11:16:32 Starting bucket ops to source bucket
2021/12/25 11:16:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:16:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:16:50 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:16:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:17:00 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:17:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:17:10 Waiting for dst bucket item count to get to: 5000 curr count: 672
2021/12/25 11:17:15 Waiting for dst bucket item count to get to: 5000 curr count: 672
2021/12/25 11:17:15 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:17:15 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:17:20 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/25 11:17:25 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/25 11:17:30 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/25 11:17:36 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/25 11:17:36 App: TestTimerBucketOp got un-deployed
2021/12/25 11:17:36 No eventing-con process running
2021/12/25 11:17:36 Function: TestTimerBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerBucketOp deleting in background"
}
2021/12/25 11:17:37 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:17:47 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 11:17:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:17:49 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:17:59 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 11:18:04 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/25 11:18:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerBucketOp (116.41s)
=== RUN   TestTimerInPastBucketOp
2021/12/25 11:18:14 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/25 11:18:14 App: TestTimerInPastBucketOp got un-deployed
2021/12/25 11:18:14 No eventing-con process running
2021/12/25 11:18:14 Function: TestTimerInPastBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerInPastBucketOp not found"
}
2021/12/25 11:18:16 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:18:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:18:23 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:18:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:18:28 Deploying app: TestTimerInPastBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:18:29 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerInPastBucketOp stored in temp store"
}
2021/12/25 11:18:29 Starting bucket ops to source bucket
2021/12/25 11:18:37 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:18:42 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:18:47 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:18:52 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:18:57 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:19:02 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:19:07 Waiting for dst bucket item count to get to: 5000 curr count: 2249
2021/12/25 11:19:12 Waiting for dst bucket item count to get to: 5000 curr count: 4749
2021/12/25 11:19:12 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:19:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:19:17 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/25 11:19:22 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/25 11:19:27 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/25 11:19:32 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/25 11:19:32 App: TestTimerInPastBucketOp got un-deployed
2021/12/25 11:19:32 No eventing-con process running
2021/12/25 11:19:32 Function: TestTimerInPastBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerInPastBucketOp deleting in background"
}
2021/12/25 11:19:34 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:19:44 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 11:19:49 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/25 11:19:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:19:51 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:20:01 Waiting for dst bucket item count to get to: 0 curr count: 4206
2021/12/25 11:20:06 Waiting for dst bucket item count to get to: 0 curr count: 4206
2021/12/25 11:20:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerInPastBucketOp (121.53s)
=== RUN   TestDeployUndeployLoopTimer
2021/12/25 11:20:16 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:20:16 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/25 11:20:16 No eventing-con process running
2021/12/25 11:20:16 Function: TestDeployUndeployLoopTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeployUndeployLoopTimer not found"
}
2021/12/25 11:20:17 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:20:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:20:24 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:20:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:20:29 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:20:30 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/25 11:20:30 Starting bucket ops to source bucket
2021/12/25 11:20:38 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:20:43 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:20:48 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:20:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:20:58 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:21:03 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:21:08 Waiting for dst bucket item count to get to: 5000 curr count: 3115
2021/12/25 11:21:13 Waiting for dst bucket item count to get to: 5000 curr count: 3115
2021/12/25 11:21:13 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:21:18 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/25 11:21:18 App: TestDeployUndeployLoopTimer got deployed
2021/12/25 11:21:18 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:21:18 Undeploying app: bucket_op_with_timer
2021/12/25 11:21:23 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:21:28 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:21:33 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:21:38 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:21:38 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/25 11:21:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:21:38 No eventing-con process running
2021/12/25 11:21:40 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:21:47 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:22:22 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:22:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/25 11:22:23 Starting bucket ops to source bucket
2021/12/25 11:22:31 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:22:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:22:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:22:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:22:51 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:22:56 Waiting for dst bucket item count to get to: 5000 curr count: 1538
2021/12/25 11:23:01 Waiting for dst bucket item count to get to: 5000 curr count: 2432
2021/12/25 11:23:06 Waiting for dst bucket item count to get to: 5000 curr count: 3394
2021/12/25 11:23:06 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:23:11 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/25 11:23:11 App: TestDeployUndeployLoopTimer got deployed
2021/12/25 11:23:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:23:12 Undeploying app: bucket_op_with_timer
2021/12/25 11:23:17 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:23:22 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:23:27 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:23:32 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:23:32 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/25 11:23:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:23:32 No eventing-con process running
2021/12/25 11:23:33 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:23:41 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:24:16 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:24:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/25 11:24:17 Starting bucket ops to source bucket
2021/12/25 11:24:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:24:30 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:24:35 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:24:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:24:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:24:50 Waiting for dst bucket item count to get to: 5000 curr count: 278
2021/12/25 11:24:55 Waiting for dst bucket item count to get to: 5000 curr count: 278
2021/12/25 11:24:55 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:25:00 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/25 11:25:00 App: TestDeployUndeployLoopTimer got deployed
2021/12/25 11:25:00 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:25:00 Undeploying app: bucket_op_with_timer
2021/12/25 11:25:05 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:25:10 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:25:15 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:25:20 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:25:20 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/25 11:25:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:25:20 No eventing-con process running
2021/12/25 11:25:22 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:25:29 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:26:04 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:26:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/25 11:26:05 Starting bucket ops to source bucket
2021/12/25 11:26:13 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:26:18 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:26:23 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:26:28 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:26:33 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:26:38 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:26:43 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:26:43 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:26:48 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/25 11:26:48 App: TestDeployUndeployLoopTimer got deployed
2021/12/25 11:26:48 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:26:48 Undeploying app: bucket_op_with_timer
2021/12/25 11:26:53 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:26:58 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:27:03 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:27:08 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:27:08 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/25 11:27:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:27:08 No eventing-con process running
2021/12/25 11:27:10 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:27:18 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:27:53 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:27:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/25 11:27:54 Starting bucket ops to source bucket
2021/12/25 11:28:01 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:28:07 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:28:12 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:28:17 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:28:22 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:28:27 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:28:32 Waiting for dst bucket item count to get to: 5000 curr count: 309
2021/12/25 11:28:37 Waiting for dst bucket item count to get to: 5000 curr count: 2809
2021/12/25 11:28:37 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:28:42 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/25 11:28:42 App: TestDeployUndeployLoopTimer got deployed
2021/12/25 11:28:42 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:28:42 Undeploying app: bucket_op_with_timer
2021/12/25 11:28:47 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:28:52 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:28:57 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:29:02 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/25 11:29:02 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/25 11:29:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:29:02 No eventing-con process running
2021/12/25 11:29:03 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:29:11 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:29:46 Function: TestDeployUndeployLoopTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer deleting in background"
}
--- PASS: TestDeployUndeployLoopTimer (580.27s)
=== RUN   TestMultipleHandlers
2021/12/25 11:29:56 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/25 11:29:56 App: TestMultipleHandlers_bucket_op_on_update got un-deployed
2021/12/25 11:29:56 No eventing-con process running
2021/12/25 11:29:56 Function: TestMultipleHandlers_bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMultipleHandlers_bucket_op_on_update not found"
}
2021/12/25 11:29:58 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:30:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:30:04 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:30:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:30:14 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/25 11:30:14 App: TestMultipleHandlers_bucket_op_on_delete got un-deployed
2021/12/25 11:30:14 No eventing-con process running
2021/12/25 11:30:14 Function: TestMultipleHandlers_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMultipleHandlers_bucket_op_on_delete not found"
}
2021/12/25 11:30:16 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:30:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:30:23 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:30:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:30:28 Deploying app: TestMultipleHandlers_bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:30:29 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_update stored in temp store"
}
2021/12/25 11:30:29 Deploying app: TestMultipleHandlers_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:30:30 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_delete stored in temp store"
}
2021/12/25 11:30:35 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/25 11:30:40 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/25 11:30:45 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/25 11:30:50 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/25 11:30:50 App: TestMultipleHandlers_bucket_op_on_update got deployed
2021/12/25 11:30:55 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2021/12/25 11:31:00 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2021/12/25 11:31:05 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2021/12/25 11:31:05 App: TestMultipleHandlers_bucket_op_on_delete got deployed
2021/12/25 11:31:05 Starting bucket ops to source bucket
2021/12/25 11:31:15 Waiting for dst bucket item count to get to: 5000 curr count: 903
2021/12/25 11:31:20 Waiting for dst bucket item count to get to: 5000 curr count: 2871
2021/12/25 11:31:25 Waiting for dst bucket item count to get to: 5000 curr count: 4468
2021/12/25 11:31:25 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:31:25 Starting bucket ops to source bucket
2021/12/25 11:31:40 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/25 11:31:45 Waiting for dst bucket item count to get to: 10000 curr count: 7504
2021/12/25 11:31:45 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/25 11:31:45 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:31:45 Function: TestMultipleHandlers_bucket_op_on_update update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:31:46 Function: TestMultipleHandlers_bucket_op_on_delete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:31:51 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/25 11:31:56 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/25 11:32:01 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/25 11:32:06 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/25 11:32:06 App: TestMultipleHandlers_bucket_op_on_update got un-deployed
2021/12/25 11:32:06 No eventing-con process running
2021/12/25 11:32:06 Function: TestMultipleHandlers_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_update deleting in background"
}
2021/12/25 11:32:07 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:32:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:32:15 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:32:25 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/25 11:32:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:32:30 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/25 11:32:35 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/25 11:32:40 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/25 11:32:45 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/25 11:32:45 App: TestMultipleHandlers_bucket_op_on_delete got un-deployed
2021/12/25 11:32:45 No eventing-con process running
2021/12/25 11:32:45 Function: TestMultipleHandlers_bucket_op_on_delete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_delete deleting in background"
}
2021/12/25 11:32:47 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:32:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:32:53 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:32:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMultipleHandlers (192.61s)
=== RUN   TestPauseResumeLoopDefaultSettings
2021/12/25 11:33:08 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/25 11:33:08 App: TestPauseResumeLoopDefaultSettings got un-deployed
2021/12/25 11:33:08 No eventing-con process running
2021/12/25 11:33:08 Function: TestPauseResumeLoopDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeLoopDefaultSettings not found"
}
2021/12/25 11:33:10 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:33:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:33:17 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:33:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:33:22 Deploying app: TestPauseResumeLoopDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:33:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopDefaultSettings stored in temp store"
}
2021/12/25 11:33:23 Starting bucket ops to source bucket
2021/12/25 11:33:31 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:33:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:33:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:33:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:33:46 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:33:46 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:33:51 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/25 11:33:51 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/25 11:33:51 Pausing app: bucket_op_on_update
2021/12/25 11:33:51 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:33:56 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/25 11:33:56 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/25 11:33:56 Resuming app: bucket_op_on_update
2021/12/25 11:33:57 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:33:57 Starting bucket ops to source bucket
2021/12/25 11:34:05 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/25 11:34:10 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/25 11:34:15 Waiting for dst bucket item count to get to: 10000 curr count: 7500
2021/12/25 11:34:15 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/25 11:34:15 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:34:20 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/25 11:34:21 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/25 11:34:21 Pausing app: bucket_op_on_update
2021/12/25 11:34:21 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:34:26 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/25 11:34:26 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/25 11:34:26 Resuming app: bucket_op_on_update
2021/12/25 11:34:27 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:34:27 Starting bucket ops to source bucket
2021/12/25 11:34:35 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/25 11:34:40 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/25 11:34:45 Waiting for dst bucket item count to get to: 15000 curr count: 12500
2021/12/25 11:34:45 src & dst bucket item count matched up. src bucket count: 15000 dst bucket count: 15000
2021/12/25 11:34:45 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:34:50 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/25 11:34:50 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/25 11:34:50 Pausing app: bucket_op_on_update
2021/12/25 11:34:50 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:34:55 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/25 11:34:55 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/25 11:34:55 Resuming app: bucket_op_on_update
2021/12/25 11:34:56 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:34:56 Starting bucket ops to source bucket
2021/12/25 11:35:04 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/25 11:35:09 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/25 11:35:14 Waiting for dst bucket item count to get to: 20000 curr count: 17500
2021/12/25 11:35:19 Waiting for dst bucket item count to get to: 20000 curr count: 17500
2021/12/25 11:35:19 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2021/12/25 11:35:19 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:35:24 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/25 11:35:24 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/25 11:35:24 Pausing app: bucket_op_on_update
2021/12/25 11:35:24 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:35:29 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/25 11:35:29 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/25 11:35:29 Resuming app: bucket_op_on_update
2021/12/25 11:35:30 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:35:30 Starting bucket ops to source bucket
2021/12/25 11:35:38 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/25 11:35:43 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/25 11:35:48 Waiting for dst bucket item count to get to: 25000 curr count: 20410
2021/12/25 11:35:53 Waiting for dst bucket item count to get to: 25000 curr count: 22910
2021/12/25 11:35:53 src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2021/12/25 11:35:53 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:35:58 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/25 11:35:58 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/25 11:35:58 Pausing app: bucket_op_on_update
2021/12/25 11:35:58 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:36:03 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/25 11:36:03 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/25 11:36:08 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/25 11:36:14 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/25 11:36:19 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/25 11:36:24 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/25 11:36:24 App: TestPauseResumeLoopDefaultSettings got un-deployed
2021/12/25 11:36:24 No eventing-con process running
2021/12/25 11:36:24 Function: TestPauseResumeLoopDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopDefaultSettings deleting in background"
}
2021/12/25 11:36:25 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:36:35 Waiting for dst bucket item count to get to: 0 curr count: 25000
2021/12/25 11:36:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:36:37 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:36:47 Waiting for dst bucket item count to get to: 0 curr count: 25000
2021/12/25 11:36:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeLoopDefaultSettings (228.71s)
=== RUN   TestPauseResumeLoopNonDefaultSettings
2021/12/25 11:36:57 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/25 11:36:57 App: TestPauseResumeLoopNonDefaultSettings got un-deployed
2021/12/25 11:36:57 No eventing-con process running
2021/12/25 11:36:57 Function: TestPauseResumeLoopNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeLoopNonDefaultSettings not found"
}
2021/12/25 11:36:59 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:37:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:37:06 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:37:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:37:11 Deploying app: TestPauseResumeLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:37:12 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopNonDefaultSettings stored in temp store"
}
2021/12/25 11:37:12 Starting bucket ops to source bucket
2021/12/25 11:37:20 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:37:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:37:30 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:37:35 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:37:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:37:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:37:50 Waiting for dst bucket item count to get to: 5000 curr count: 2098
2021/12/25 11:37:55 Waiting for dst bucket item count to get to: 5000 curr count: 2098
2021/12/25 11:37:55 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:37:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:38:00 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/25 11:38:00 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/25 11:38:00 Pausing app: bucket_op_with_timer
2021/12/25 11:38:00 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:38:05 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/25 11:38:05 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/25 11:38:05 Resuming app: bucket_op_with_timer
2021/12/25 11:38:06 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:38:06 Starting bucket ops to source bucket
2021/12/25 11:38:14 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/25 11:38:19 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/25 11:38:24 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/25 11:38:29 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/25 11:38:34 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/25 11:38:39 Waiting for dst bucket item count to get to: 10000 curr count: 7967
2021/12/25 11:38:44 Waiting for dst bucket item count to get to: 10000 curr count: 7967
2021/12/25 11:38:44 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/25 11:38:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:38:49 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/25 11:38:49 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/25 11:38:49 Pausing app: bucket_op_with_timer
2021/12/25 11:38:50 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:38:55 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/25 11:38:55 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/25 11:38:55 Resuming app: bucket_op_with_timer
2021/12/25 11:38:56 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:38:56 Starting bucket ops to source bucket
2021/12/25 11:39:04 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/25 11:39:09 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/25 11:39:14 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/25 11:39:19 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/25 11:39:24 Waiting for dst bucket item count to get to: 15000 curr count: 11710
2021/12/25 11:39:29 Waiting for dst bucket item count to get to: 15000 curr count: 14210
2021/12/25 11:39:29 src & dst bucket item count matched up. src bucket count: 15000 dst bucket count: 15000
2021/12/25 11:39:29 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:39:34 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/25 11:39:34 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/25 11:39:34 Pausing app: bucket_op_with_timer
2021/12/25 11:39:34 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:39:39 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/25 11:39:39 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/25 11:39:39 Resuming app: bucket_op_with_timer
2021/12/25 11:39:40 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:39:40 Starting bucket ops to source bucket
2021/12/25 11:39:48 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/25 11:39:53 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/25 11:39:58 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/25 11:40:03 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/25 11:40:08 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/25 11:40:13 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/25 11:40:18 Waiting for dst bucket item count to get to: 20000 curr count: 17500
2021/12/25 11:40:18 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2021/12/25 11:40:18 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:40:23 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/25 11:40:23 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/25 11:40:23 Pausing app: bucket_op_with_timer
2021/12/25 11:40:23 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:40:28 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/25 11:40:28 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/25 11:40:28 Resuming app: bucket_op_with_timer
2021/12/25 11:40:29 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:40:29 Starting bucket ops to source bucket
2021/12/25 11:40:37 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/25 11:40:42 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/25 11:40:47 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/25 11:40:52 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/25 11:40:57 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/25 11:41:02 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/25 11:41:07 Waiting for dst bucket item count to get to: 25000 curr count: 22500
2021/12/25 11:41:07 src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2021/12/25 11:41:07 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:41:12 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/25 11:41:12 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/25 11:41:12 Pausing app: bucket_op_with_timer
2021/12/25 11:41:13 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:41:18 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/25 11:41:18 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/25 11:41:23 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/25 11:41:28 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/25 11:41:33 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/25 11:41:38 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/25 11:41:38 App: TestPauseResumeLoopNonDefaultSettings got un-deployed
2021/12/25 11:41:38 No eventing-con process running
2021/12/25 11:41:38 Function: TestPauseResumeLoopNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopNonDefaultSettings deleting in background"
}
2021/12/25 11:41:39 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:41:49 Waiting for dst bucket item count to get to: 0 curr count: 12500
2021/12/25 11:41:54 Waiting for dst bucket item count to get to: 0 curr count: 12500
2021/12/25 11:41:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:41:56 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:42:06 Waiting for dst bucket item count to get to: 0 curr count: 25000
2021/12/25 11:42:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeLoopNonDefaultSettings (319.06s)
=== RUN   TestPauseAndResumeWithWorkerCountChange
2021/12/25 11:42:16 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/25 11:42:16 App: TestPauseAndResumeWithWorkerCountChange got un-deployed
2021/12/25 11:42:16 No eventing-con process running
2021/12/25 11:42:16 Function: TestPauseAndResumeWithWorkerCountChange delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseAndResumeWithWorkerCountChange not found"
}
2021/12/25 11:42:18 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:42:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:42:25 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:42:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:42:30 Deploying app: TestPauseAndResumeWithWorkerCountChange. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:42:31 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseAndResumeWithWorkerCountChange stored in temp store"
}
2021/12/25 11:42:36 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/25 11:42:41 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/25 11:42:46 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/25 11:42:51 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/25 11:42:51 App: TestPauseAndResumeWithWorkerCountChange got deployed
2021/12/25 11:42:51 Starting bucket ops to source bucket
2021/12/25 11:43:00 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:43:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:43:10 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:43:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:43:20 Waiting for dst bucket item count to get to: 5000 curr count: 3973
2021/12/25 11:43:25 Waiting for dst bucket item count to get to: 5000 curr count: 3973
2021/12/25 11:43:25 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:43:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:43:25 Pausing app: bucket_op_with_timer
2021/12/25 11:43:26 Function: TestPauseAndResumeWithWorkerCountChange update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:43:31 Waiting for function: TestPauseAndResumeWithWorkerCountChange status to change to paused
2021/12/25 11:43:31 Function: TestPauseAndResumeWithWorkerCountChange status changed to paused
2021/12/25 11:43:31 Resuming app: bucket_op_with_timer
2021/12/25 11:43:32 Function: TestPauseAndResumeWithWorkerCountChange update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:6] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:43:32 Starting bucket ops to source bucket
2021/12/25 11:43:43 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/25 11:43:48 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/25 11:43:53 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/25 11:43:58 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/25 11:44:03 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/25 11:44:08 Waiting for dst bucket item count to get to: 10000 curr count: 9970
2021/12/25 11:44:13 Waiting for dst bucket item count to get to: 10000 curr count: 9970
2021/12/25 11:44:13 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/25 11:44:18 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/25 11:44:24 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/25 11:44:29 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/25 11:44:34 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/25 11:44:34 App: TestPauseAndResumeWithWorkerCountChange got un-deployed
2021/12/25 11:44:34 No eventing-con process running
2021/12/25 11:44:34 Function: TestPauseAndResumeWithWorkerCountChange delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseAndResumeWithWorkerCountChange deleting in background"
}
2021/12/25 11:44:35 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:44:45 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/25 11:44:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:44:47 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:44:57 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/25 11:44:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseAndResumeWithWorkerCountChange (170.91s)
=== RUN   TestPauseResumeWithEventingReb
2021/12/25 11:45:07 Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/25 11:45:07 App: TestPauseResumeWithEventingReb got un-deployed
2021/12/25 11:45:07 No eventing-con process running
2021/12/25 11:45:07 Function: TestPauseResumeWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeWithEventingReb not found"
}
2021/12/25 11:45:09 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:45:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:45:16 Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:45:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:45:21 Deploying app: TestPauseResumeWithEventingReb. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:45:22 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeWithEventingReb stored in temp store"
}
2021/12/25 11:45:27 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/25 11:45:32 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/25 11:45:37 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/25 11:45:42 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/25 11:45:42 App: TestPauseResumeWithEventingReb got deployed
2021/12/25 11:45:42 Starting bucket ops to source bucket
2021/12/25 11:45:51 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:45:56 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:46:01 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:46:06 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:46:11 Waiting for dst bucket item count to get to: 5000 curr count: 557
2021/12/25 11:46:16 Waiting for dst bucket item count to get to: 5000 curr count: 557
2021/12/25 11:46:16 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:46:16 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:46:16 Pausing app: bucket_op_with_timer
2021/12/25 11:46:16 Function: TestPauseResumeWithEventingReb update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:46:21 Waiting for function: TestPauseResumeWithEventingReb status to change to paused
2021/12/25 11:46:21 Function: TestPauseResumeWithEventingReb status changed to paused
2021/12/25 11:46:21 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/25 11:46:22 Removing node(s): [] from the cluster
2021/12/25 11:46:27 Rebalance progress: 29.16666666666666
2021/12/25 11:46:32 Rebalance progress: 29.16666666666666
2021/12/25 11:46:37 Rebalance progress: 100
2021/12/25 11:46:37 Resuming app: bucket_op_with_timer
2021/12/25 11:46:38 Function: TestPauseResumeWithEventingReb update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:6] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:46:38 Starting bucket ops to source bucket
2021/12/25 11:46:50 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/25 11:46:55 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/25 11:47:00 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/25 11:47:05 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/25 11:47:10 Waiting for dst bucket item count to get to: 10000 curr count: 5498
2021/12/25 11:47:15 Waiting for dst bucket item count to get to: 10000 curr count: 7858
2021/12/25 11:47:15 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/25 11:47:15 Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/25 11:47:20 Rebalance progress: 29.16666666666666
2021/12/25 11:47:25 Rebalance progress: 29.16666666666666
2021/12/25 11:47:30 Rebalance progress: 100

VB distribution across eventing nodes and their workers::

2021/12/25 11:47:35 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:81} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/25 11:47:50 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:81} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/25 11:48:05 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:81} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/25 11:48:20 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:81} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/25 11:48:35 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:81} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/25 11:48:50 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:81} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/25 11:49:05 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:81} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/25 11:49:20 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:81} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/25 11:49:35 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:81} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/25 11:49:50 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:81} {Name:#primary Bucket:hello-world Completion:100}]

DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: a3922b84854ec9e1fbe77304ee4fb343
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [0-56]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [57-113]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [114-170]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [171-227]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [228-284]
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 57
	v: [285-341]
Producer node: 172.31.2.134:9300	Node UUID: 7cfe2f2d88596deb45cd4bf6c7da432b
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 56
	v: [968-1023]
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [683-739]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [740-796]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [797-853]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [854-910]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [911-967]
Producer node: 127.0.0.1:9303	Node UUID: 73fcaf5fbbd150fbe384962752f45b88
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [342-398]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [399-455]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [456-512]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [513-569]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [570-626]
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 56
	v: [627-682]


2021/12/25 11:50:05 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:50:10 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/25 11:50:15 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/25 11:50:20 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/25 11:50:25 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/25 11:50:25 clusterSetup.go:405: App: TestPauseResumeWithEventingReb got un-deployed
2021/12/25 11:50:25 eventingSetup.go:46: No eventing-con process running
2021/12/25 11:50:25 eventingSetup.go:418: Function: TestPauseResumeWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeWithEventingReb deleting in background"
}
2021/12/25 11:50:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:50:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/25 11:50:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:50:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:50:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9495
2021/12/25 11:50:54 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4495
2021/12/25 11:50:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeWithEventingReb (356.63s)
=== RUN   TestBucketDeleteAfterPause
2021/12/25 11:51:04 clusterSetup.go:397: Waiting for app: TestBucketDeleteAfterPause to get un-deployed
2021/12/25 11:51:04 clusterSetup.go:405: App: TestBucketDeleteAfterPause got un-deployed
2021/12/25 11:51:04 eventingSetup.go:46: No eventing-con process running
2021/12/25 11:51:04 eventingSetup.go:418: Function: TestBucketDeleteAfterPause delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketDeleteAfterPause not found"
}
2021/12/25 11:51:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:51:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:51:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:51:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:51:17 eventingSetup.go:125: Deploying app: TestBucketDeleteAfterPause. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:51:19 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteAfterPause stored in temp store"
}
2021/12/25 11:51:24 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/25 11:51:29 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/25 11:51:34 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/25 11:51:39 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/25 11:51:39 clusterSetup.go:354: App: TestBucketDeleteAfterPause got deployed
2021/12/25 11:51:39 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 11:51:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 353
2021/12/25 11:51:53 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2853
2021/12/25 11:51:53 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:51:53 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:51:53 handler_test.go:712: Pausing app: bucket_op_on_update
2021/12/25 11:51:53 eventingSetup.go:270: Function: TestBucketDeleteAfterPause update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:51:58 eventingSetup.go:719: Waiting for function: TestBucketDeleteAfterPause status to change to paused
2021/12/25 11:51:59 eventingSetup.go:727: Function: TestBucketDeleteAfterPause status changed to paused
2021/12/25 11:51:59 handler_test.go:716: Deleting source bucket: default
2021/12/25 11:52:05 eventingSetup.go:719: Waiting for function: TestBucketDeleteAfterPause status to change to undeployed
2021/12/25 11:52:05 eventingSetup.go:727: Function: TestBucketDeleteAfterPause status changed to undeployed
2021/12/25 11:52:10 clusterSetup.go:397: Waiting for app: TestBucketDeleteAfterPause to get un-deployed
2021/12/25 11:52:10 clusterSetup.go:405: App: TestBucketDeleteAfterPause got un-deployed
2021/12/25 11:52:10 eventingSetup.go:46: No eventing-con process running
2021/12/25 11:52:10 eventingSetup.go:418: Function: TestBucketDeleteAfterPause delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteAfterPause deleting in background"
}
2021/12/25 11:52:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:52:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:52:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:52:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3417
2021/12/25 11:52:33 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 917
2021/12/25 11:52:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBucketDeleteAfterPause (99.21s)
=== RUN   TestChangeFnCodeBetweenPauseResume
2021/12/25 11:52:43 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/25 11:52:43 clusterSetup.go:405: App: TestChangeFnCodeBetweenPauseResume got un-deployed
2021/12/25 11:52:43 eventingSetup.go:46: No eventing-con process running
2021/12/25 11:52:43 eventingSetup.go:418: Function: TestChangeFnCodeBetweenPauseResume delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestChangeFnCodeBetweenPauseResume not found"
}
2021/12/25 11:52:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:52:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:52:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:52:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:52:56 eventingSetup.go:125: Deploying app: TestChangeFnCodeBetweenPauseResume. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:52:57 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume stored in temp store"
}
2021/12/25 11:53:02 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/25 11:53:07 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/25 11:53:12 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/25 11:53:17 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/25 11:53:17 clusterSetup.go:354: App: TestChangeFnCodeBetweenPauseResume got deployed
2021/12/25 11:53:17 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 11:53:52 handler_test.go:739: Pausing function: TestChangeFnCodeBetweenPauseResume
2021/12/25 11:53:52 eventingSetup.go:270: Function: TestChangeFnCodeBetweenPauseResume update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:53:57 eventingSetup.go:719: Waiting for function: TestChangeFnCodeBetweenPauseResume status to change to paused
2021/12/25 11:53:57 eventingSetup.go:727: Function: TestChangeFnCodeBetweenPauseResume status changed to paused
2021/12/25 11:56:57 handler_test.go:748: Resuming function: TestChangeFnCodeBetweenPauseResume
2021/12/25 11:56:57 eventingSetup.go:125: Deploying app: TestChangeFnCodeBetweenPauseResume. Item count src bucket: 5000 dst bucket: 0
2021/12/25 11:56:58 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume stored in temp store"
}
2021/12/25 11:57:03 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2021/12/25 11:57:03 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:57:03 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 0 expected 5000
2021/12/25 11:57:08 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2021/12/25 11:57:08 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:57:09 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 3850 expected 5000
2021/12/25 11:57:14 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2021/12/25 11:57:14 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:57:14 eventingSetup.go:804: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 5000
2021/12/25 11:57:14 handler_test.go:753: Undeploying function: TestChangeFnCodeBetweenPauseResume
2021/12/25 11:57:14 eventingSetup.go:270: Function: TestChangeFnCodeBetweenPauseResume update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:57:24 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/25 11:57:29 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/25 11:57:34 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/25 11:57:34 clusterSetup.go:405: App: TestChangeFnCodeBetweenPauseResume got un-deployed
2021/12/25 11:57:34 eventingSetup.go:46: No eventing-con process running
2021/12/25 11:57:34 eventingSetup.go:418: Function: TestChangeFnCodeBetweenPauseResume delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume deleting in background"
}
2021/12/25 11:57:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:57:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 11:57:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:57:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:57:52 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestChangeFnCodeBetweenPauseResume (318.83s)
=== RUN   TestCommentUnCommentOnDelete
2021/12/25 11:58:02 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/25 11:58:02 clusterSetup.go:405: App: TestCommentUnCommentOnDelete got un-deployed
2021/12/25 11:58:02 eventingSetup.go:46: No eventing-con process running
2021/12/25 11:58:02 eventingSetup.go:418: Function: TestCommentUnCommentOnDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCommentUnCommentOnDelete not found"
}
2021/12/25 11:58:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:58:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:58:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 11:58:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 11:58:15 eventingSetup.go:125: Deploying app: TestCommentUnCommentOnDelete. Item count src bucket: 0 dst bucket: 0
2021/12/25 11:58:16 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete stored in temp store"
}
2021/12/25 11:58:21 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/25 11:58:26 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/25 11:58:31 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/25 11:58:36 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/25 11:58:36 clusterSetup.go:354: App: TestCommentUnCommentOnDelete got deployed
2021/12/25 11:58:36 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 11:58:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 11:58:50 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2595
2021/12/25 11:58:55 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2595
2021/12/25 11:58:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 11:58:55 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 11:58:55 handler_test.go:780: Undeploying app: TestCommentUnCommentOnDelete
2021/12/25 11:58:55 eventingSetup.go:270: Function: TestCommentUnCommentOnDelete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 11:59:25 eventingSetup.go:125: Deploying app: TestCommentUnCommentOnDelete. Item count src bucket: 5000 dst bucket: 5000
2021/12/25 11:59:26 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete stored in temp store"
}
2021/12/25 11:59:31 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/25 11:59:36 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/25 11:59:41 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/25 11:59:46 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/25 11:59:46 clusterSetup.go:354: App: TestCommentUnCommentOnDelete got deployed
2021/12/25 11:59:46 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 11:59:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 12:00:04 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 12:00:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:00:04 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:00:04 handler_test.go:799: Undeploying app: TestCommentUnCommentOnDelete
2021/12/25 12:00:04 eventingSetup.go:270: Function: TestCommentUnCommentOnDelete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 12:00:14 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/25 12:00:19 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/25 12:00:24 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/25 12:00:24 clusterSetup.go:405: App: TestCommentUnCommentOnDelete got un-deployed
2021/12/25 12:00:24 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:00:24 eventingSetup.go:418: Function: TestCommentUnCommentOnDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete deleting in background"
}
2021/12/25 12:00:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:00:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:00:32 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:00:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCommentUnCommentOnDelete (165.55s)
=== RUN   TestCPPWorkerCleanup
2021/12/25 12:00:47 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/25 12:00:47 clusterSetup.go:405: App: TestCPPWorkerCleanup got un-deployed
2021/12/25 12:00:47 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:00:47 eventingSetup.go:418: Function: TestCPPWorkerCleanup delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCPPWorkerCleanup not found"
}
2021/12/25 12:00:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:00:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:00:55 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:01:00 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:01:00 eventingSetup.go:125: Deploying app: TestCPPWorkerCleanup. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:01:02 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCPPWorkerCleanup stored in temp store"
}
2021/12/25 12:01:02 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 12:01:09 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:01:14 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:01:19 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:01:24 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:01:29 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 3668
2021/12/25 12:01:34 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 3668
2021/12/25 12:01:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 12:01:34 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:01:39 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/25 12:01:44 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/25 12:01:49 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/25 12:01:54 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/25 12:01:54 clusterSetup.go:405: App: TestCPPWorkerCleanup got un-deployed
2021/12/25 12:01:54 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:01:54 eventingSetup.go:418: Function: TestCPPWorkerCleanup delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCPPWorkerCleanup deleting in background"
}
2021/12/25 12:01:55 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:02:05 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 12:02:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:02:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:02:17 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 12:02:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCPPWorkerCleanup (129.72s)
=== RUN   TestWithUserXattrs
2021/12/25 12:02:57 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/25 12:02:57 clusterSetup.go:405: App: TestWithUserXattrs got un-deployed
2021/12/25 12:02:57 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:02:57 eventingSetup.go:418: Function: TestWithUserXattrs delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestWithUserXattrs not found"
}
2021/12/25 12:02:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:03:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:03:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:03:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:03:10 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 12:03:12 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 12:03:14 eventingSetup.go:125: Deploying app: TestWithUserXattrs. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:03:15 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestWithUserXattrs stored in temp store"
}
2021/12/25 12:03:20 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/25 12:03:25 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/25 12:03:30 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/25 12:03:35 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/25 12:03:35 clusterSetup.go:354: App: TestWithUserXattrs got deployed
2021/12/25 12:03:35 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 12:03:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:03:50 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 3481
2021/12/25 12:03:55 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 3481
2021/12/25 12:03:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 12:03:55 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:04:00 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/25 12:04:05 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/25 12:04:10 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/25 12:04:15 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/25 12:04:15 clusterSetup.go:405: App: TestWithUserXattrs got un-deployed
2021/12/25 12:04:15 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:04:15 eventingSetup.go:418: Function: TestWithUserXattrs delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestWithUserXattrs deleting in background"
}
2021/12/25 12:04:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:04:26 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 12:04:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:04:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:04:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3107
2021/12/25 12:04:43 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 607
2021/12/25 12:04:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestWithUserXattrs (115.73s)
=== RUN   TestEventProcessingPostBucketFlush
2021/12/25 12:04:53 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/25 12:04:53 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2021/12/25 12:04:53 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:04:53 eventingSetup.go:418: Function: TestEventProcessingPostBucketFlush delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventProcessingPostBucketFlush not found"
}
2021/12/25 12:04:54 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:04:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:05:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:05:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:05:06 eventingSetup.go:125: Deploying app: TestEventProcessingPostBucketFlush. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:05:07 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventProcessingPostBucketFlush stored in temp store"
}
2021/12/25 12:05:12 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/25 12:05:17 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/25 12:05:22 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/25 12:05:27 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/25 12:05:27 clusterSetup.go:354: App: TestEventProcessingPostBucketFlush got deployed
2021/12/25 12:05:27 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 12:05:36 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:05:41 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 1429
2021/12/25 12:05:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 1429
2021/12/25 12:05:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 12:05:46 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:05:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:06:00 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1660
2021/12/25 12:06:05 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1660
2021/12/25 12:06:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:06:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:06:17 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 12:06:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:06:17 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 12:06:42 eventingSetup.go:441: Waiting for dst bucket item count to get to: 25000 curr count: 13989
2021/12/25 12:06:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 25000 curr count: 20153
2021/12/25 12:06:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2021/12/25 12:06:47 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:06:47 eventingSetup.go:270: Function: TestEventProcessingPostBucketFlush update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 12:06:52 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/25 12:06:57 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/25 12:07:02 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/25 12:07:07 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/25 12:07:07 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2021/12/25 12:07:07 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:07:12 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/25 12:07:12 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2021/12/25 12:07:12 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:07:12 eventingSetup.go:418: Function: TestEventProcessingPostBucketFlush delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventProcessingPostBucketFlush deleting in background"
}
2021/12/25 12:07:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:07:23 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 25000
2021/12/25 12:07:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12500
2021/12/25 12:07:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:07:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:07:40 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 17586
2021/12/25 12:07:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 17586
2021/12/25 12:07:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventProcessingPostBucketFlush (182.35s)
=== RUN   TestMetaBucketDelete
2021/12/25 12:07:55 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2021/12/25 12:07:55 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2021/12/25 12:07:55 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:07:55 eventingSetup.go:418: Function: TestMetaBucketDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaBucketDelete not found"
}
2021/12/25 12:07:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:08:01 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:08:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:08:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:08:08 eventingSetup.go:125: Deploying app: TestMetaBucketDelete. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:08:09 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDelete stored in temp store"
}
2021/12/25 12:08:14 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/25 12:08:19 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/25 12:08:24 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/25 12:08:29 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/25 12:08:29 clusterSetup.go:354: App: TestMetaBucketDelete got deployed
2021/12/25 12:08:29 handler_test.go:902: Deleting metadata bucket: eventing
2021/12/25 12:08:31 handler_test.go:904: Deleted metadata bucket: eventing
2021/12/25 12:08:36 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2021/12/25 12:08:36 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2021/12/25 12:08:51 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2021/12/25 12:08:51 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2021/12/25 12:08:51 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:08:51 eventingSetup.go:418: Function: TestMetaBucketDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDelete deleting in background"
}
2021/12/25 12:08:52 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:08:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:08:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:09:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaBucketDelete (78.68s)
=== RUN   TestMetaBucketDeleteWithBootstrap
2021/12/25 12:09:14 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/25 12:09:14 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2021/12/25 12:09:14 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:09:14 eventingSetup.go:418: Function: TestMetaBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaBucketDeleteWithBootstrap not found"
}
2021/12/25 12:09:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:09:20 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:09:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:09:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:09:27 eventingSetup.go:125: Deploying app: TestMetaBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:09:28 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDeleteWithBootstrap stored in temp store"
}
2021/12/25 12:09:47 handler_test.go:923: Deleting metadata bucket: eventing
2021/12/25 12:09:48 handler_test.go:925: Deleted metadata bucket: eventing
2021/12/25 12:10:03 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/25 12:10:03 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2021/12/25 12:10:18 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/25 12:10:18 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2021/12/25 12:10:18 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:10:18 eventingSetup.go:418: Function: TestMetaBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDeleteWithBootstrap deleting in background"
}
2021/12/25 12:10:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:10:24 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:10:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:10:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaBucketDeleteWithBootstrap (87.05s)
=== RUN   TestSourceBucketDelete
2021/12/25 12:10:41 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2021/12/25 12:10:41 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2021/12/25 12:10:41 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:10:41 eventingSetup.go:418: Function: TestSourceBucketDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceBucketDelete not found"
}
2021/12/25 12:10:42 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:10:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:10:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:10:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:10:54 eventingSetup.go:125: Deploying app: TestSourceBucketDelete. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:10:55 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDelete stored in temp store"
}
2021/12/25 12:11:00 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/25 12:11:05 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/25 12:11:10 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/25 12:11:15 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/25 12:11:15 clusterSetup.go:354: App: TestSourceBucketDelete got deployed
2021/12/25 12:11:15 handler_test.go:945: Deleting source bucket: default
2021/12/25 12:11:17 handler_test.go:947: Deleted source bucket: default
2021/12/25 12:11:22 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2021/12/25 12:11:22 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2021/12/25 12:11:37 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2021/12/25 12:11:37 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2021/12/25 12:11:37 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:11:37 eventingSetup.go:418: Function: TestSourceBucketDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDelete deleting in background"
}
2021/12/25 12:11:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:11:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:11:45 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:11:50 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceBucketDelete (79.23s)
=== RUN   TestSourceBucketDeleteWithBootstrap
2021/12/25 12:12:00 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2021/12/25 12:12:00 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2021/12/25 12:12:00 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:12:00 eventingSetup.go:418: Function: TestSourceBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceBucketDeleteWithBootstrap not found"
}
2021/12/25 12:12:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:12:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:12:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:12:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:12:13 eventingSetup.go:125: Deploying app: TestSourceBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:12:14 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDeleteWithBootstrap stored in temp store"
}
2021/12/25 12:12:33 handler_test.go:966: Deleting source bucket: default
2021/12/25 12:12:35 handler_test.go:968: Deleted source bucket: default
2021/12/25 12:12:50 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2021/12/25 12:12:50 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2021/12/25 12:13:05 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2021/12/25 12:13:05 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2021/12/25 12:13:05 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:13:05 eventingSetup.go:418: Function: TestSourceBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDeleteWithBootstrap deleting in background"
}
2021/12/25 12:13:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:13:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:13:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:13:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceBucketDeleteWithBootstrap (87.64s)
=== RUN   TestSourceAndMetaBucketDeleteWithBootstrap
2021/12/25 12:13:28 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/25 12:13:28 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2021/12/25 12:13:28 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:13:28 eventingSetup.go:418: Function: TestSourceAndMetaBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceAndMetaBucketDeleteWithBootstrap not found"
}
2021/12/25 12:13:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:13:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:13:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:13:41 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:13:41 eventingSetup.go:125: Deploying app: TestSourceAndMetaBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:13:42 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceAndMetaBucketDeleteWithBootstrap stored in temp store"
}
2021/12/25 12:14:01 handler_test.go:988: Deleting source bucket: default
2021/12/25 12:14:02 handler_test.go:990: Deleted source bucket: default
2021/12/25 12:14:02 handler_test.go:992: Deleting metadata bucket: eventing
2021/12/25 12:14:03 handler_test.go:994: Deleted metadata bucket: eventing
2021/12/25 12:14:18 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/25 12:14:18 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2021/12/25 12:14:33 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/25 12:14:33 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2021/12/25 12:14:33 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:14:33 eventingSetup.go:418: Function: TestSourceAndMetaBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceAndMetaBucketDeleteWithBootstrap deleting in background"
}
2021/12/25 12:14:34 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:14:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:14:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:14:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceAndMetaBucketDeleteWithBootstrap (88.45s)
=== RUN   TestUndeployDuringBootstrap
2021/12/25 12:14:56 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/25 12:14:56 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2021/12/25 12:14:56 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:14:56 eventingSetup.go:418: Function: TestUndeployDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployDuringBootstrap not found"
}
2021/12/25 12:14:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:15:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:15:04 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:15:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:15:09 eventingSetup.go:125: Deploying app: TestUndeployDuringBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:15:10 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployDuringBootstrap stored in temp store"
}
2021/12/25 12:15:10 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 12:15:22 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:15:23 clusterSetup.go:375: Apps undergoing bootstrap: true
2021/12/25 12:15:23 clusterSetup.go:378: App: TestUndeployDuringBootstrap started bootstrap
2021/12/25 12:15:23 clusterSetup.go:375: Apps undergoing bootstrap: true
2021/12/25 12:15:28 clusterSetup.go:367: No apps undergoing bootstrap
2021/12/25 12:15:33 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/25 12:15:38 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/25 12:15:43 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/25 12:15:43 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2021/12/25 12:15:43 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:16:08 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/25 12:16:08 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2021/12/25 12:16:08 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:16:08 eventingSetup.go:418: Function: TestUndeployDuringBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployDuringBootstrap deleting in background"
}
2021/12/25 12:16:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:16:19 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 12:16:24 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/25 12:16:24 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:16:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:16:36 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3889
2021/12/25 12:16:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployDuringBootstrap (109.58s)
=== RUN   TestDeleteBeforeUndeploy
2021/12/25 12:16:41 eventingSetup.go:125: Deploying app: TestDeleteBeforeUndeploy. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:16:42 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeleteBeforeUndeploy stored in temp store"
}
2021/12/25 12:16:47 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/25 12:16:52 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/25 12:16:57 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/25 12:17:02 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/25 12:17:02 clusterSetup.go:354: App: TestDeleteBeforeUndeploy got deployed
2021/12/25 12:17:02 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 422 dump: {
 "name": "ERR_APP_NOT_UNDEPLOYED",
 "code": 22,
 "description": "Function: TestDeleteBeforeUndeploy skipping delete request as it hasn't been undeployed"
}
2021/12/25 12:17:02 eventingSetup.go:270: Function: TestDeleteBeforeUndeploy update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 12:17:02 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeleteBeforeUndeploy deleting in background"
}
2021/12/25 12:17:07 clusterSetup.go:397: Waiting for app: TestDeleteBeforeUndeploy to get un-deployed
2021/12/25 12:17:07 clusterSetup.go:405: App: TestDeleteBeforeUndeploy got un-deployed
2021/12/25 12:17:07 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:17:07 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeleteBeforeUndeploy not found"
}
2021/12/25 12:17:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:17:14 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:17:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:17:20 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDeleteBeforeUndeploy (44.56s)
=== RUN   TestUndeployWhenTimersAreFired
2021/12/25 12:17:30 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/25 12:17:30 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2021/12/25 12:17:30 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:17:30 eventingSetup.go:418: Function: TestUndeployWhenTimersAreFired delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployWhenTimersAreFired not found"
}
2021/12/25 12:17:32 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:17:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:17:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:17:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:17:43 eventingSetup.go:125: Deploying app: TestUndeployWhenTimersAreFired. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:17:45 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWhenTimersAreFired stored in temp store"
}
2021/12/25 12:17:50 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/25 12:17:55 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/25 12:18:00 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/25 12:18:05 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/25 12:18:05 clusterSetup.go:354: App: TestUndeployWhenTimersAreFired got deployed
2021/12/25 12:18:05 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 12:18:40 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/25 12:18:45 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/25 12:18:50 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/25 12:18:50 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2021/12/25 12:18:50 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:20:35 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/25 12:20:35 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2021/12/25 12:20:35 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:20:35 eventingSetup.go:418: Function: TestUndeployWhenTimersAreFired delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWhenTimersAreFired deleting in background"
}
2021/12/25 12:20:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:20:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 12:20:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:20:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:20:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4313
2021/12/25 12:21:03 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1813
2021/12/25 12:21:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployWhenTimersAreFired (223.14s)
=== RUN   TestUndeployWithKVFailover
2021/12/25 12:21:13 clusterSetup.go:397: Waiting for app: TestUndeployWithKVFailover to get un-deployed
2021/12/25 12:21:14 clusterSetup.go:405: App: TestUndeployWithKVFailover got un-deployed
2021/12/25 12:21:14 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:21:14 eventingSetup.go:418: Function: TestUndeployWithKVFailover delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployWithKVFailover not found"
}
2021/12/25 12:21:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:21:20 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:21:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:21:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:21:27 eventingSetup.go:125: Deploying app: TestUndeployWithKVFailover. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:21:28 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWithKVFailover stored in temp store"
}
2021/12/25 12:21:28 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 12:21:35 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:21:40 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:21:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:21:50 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:21:55 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:22:00 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:22:05 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:22:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 12:22:05 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/25 12:22:05 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 12:22:10 Rebalance progress: 29.16666666666666
2021/12/25 12:22:15 Rebalance progress: 29.16666666666666
2021/12/25 12:22:20 Rebalance progress: 100
2021/12/25 12:22:20 Failing over: [127.0.0.1:19003]
2021/12/25 12:22:30 Function: TestUndeployWithKVFailover update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/25 12:23:30 Removing node(s): [] from the cluster
2021/12/25 12:23:35 Rebalance progress: 29.16666666666666
2021/12/25 12:23:40 Rebalance progress: 29.16666666666666
2021/12/25 12:23:45 Rebalance progress: 100
2021/12/25 12:23:50 Waiting for app: TestUndeployWithKVFailover to get un-deployed
2021/12/25 12:23:50 App: TestUndeployWithKVFailover got un-deployed
2021/12/25 12:23:50 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:23:55 Waiting for app: TestUndeployWithKVFailover to get un-deployed
2021/12/25 12:23:55 App: TestUndeployWithKVFailover got un-deployed
2021/12/25 12:23:55 No eventing-con process running
2021/12/25 12:23:55 Function: TestUndeployWithKVFailover delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWithKVFailover deleting in background"
}
2021/12/25 12:23:56 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:24:06 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 12:24:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:24:08 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:24:18 Waiting for dst bucket item count to get to: 0 curr count: 3967
2021/12/25 12:24:23 Waiting for dst bucket item count to get to: 0 curr count: 1467
2021/12/25 12:24:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployWithKVFailover (199.75s)
=== RUN   TestBucketFlushWhileFnDeployed
2021/12/25 12:24:33 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/25 12:24:33 App: TestBucketFlushWhileFnDeployed got un-deployed
2021/12/25 12:24:33 No eventing-con process running
2021/12/25 12:24:33 Function: TestBucketFlushWhileFnDeployed delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketFlushWhileFnDeployed not found"
}
2021/12/25 12:24:35 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:24:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:24:41 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:24:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:24:46 Deploying app: TestBucketFlushWhileFnDeployed. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:24:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketFlushWhileFnDeployed stored in temp store"
}
2021/12/25 12:24:53 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/25 12:24:58 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/25 12:25:03 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/25 12:25:08 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/25 12:25:08 App: TestBucketFlushWhileFnDeployed got deployed
2021/12/25 12:25:08 Starting bucket ops to source bucket
2021/12/25 12:25:28 Waiting for dst bucket item count to get to: 20000 curr count: 13696
2021/12/25 12:25:33 Waiting for dst bucket item count to get to: 20000 curr count: 13696
2021/12/25 12:25:33 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2021/12/25 12:25:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:25:36 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:25:46 Waiting for dst bucket item count to get to: 0 curr count: 20000
2021/12/25 12:25:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:25:48 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:25:58 Waiting for dst bucket item count to get to: 0 curr count: 13275
2021/12/25 12:26:03 Waiting for dst bucket item count to get to: 0 curr count: 3275
2021/12/25 12:26:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:26:03 Starting bucket ops to source bucket
2021/12/25 12:26:16 Waiting for dst bucket item count to get to: 10000 curr count: 2696
2021/12/25 12:26:21 Waiting for dst bucket item count to get to: 10000 curr count: 6792
2021/12/25 12:26:26 Waiting for dst bucket item count to get to: 10000 curr count: 9096
2021/12/25 12:26:26 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/25 12:26:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:26:31 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/25 12:26:36 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/25 12:26:41 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/25 12:26:46 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/25 12:26:46 App: TestBucketFlushWhileFnDeployed got un-deployed
2021/12/25 12:26:46 No eventing-con process running
2021/12/25 12:26:46 Function: TestBucketFlushWhileFnDeployed delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketFlushWhileFnDeployed deleting in background"
}
2021/12/25 12:26:47 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:26:57 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/25 12:26:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:26:59 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:27:09 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/25 12:27:14 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 12:27:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBucketFlushWhileFnDeployed (170.69s)
=== RUN   TestTimerOverwrite
2021/12/25 12:27:24 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/25 12:27:24 App: TestTimerOverwrite got un-deployed
2021/12/25 12:27:24 No eventing-con process running
2021/12/25 12:27:24 Function: TestTimerOverwrite delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerOverwrite not found"
}
2021/12/25 12:27:25 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:27:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:27:32 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:27:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:27:37 Deploying app: TestTimerOverwrite. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:27:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverwrite stored in temp store"
}
2021/12/25 12:27:43 Waiting for app: TestTimerOverwrite to get deployed
2021/12/25 12:27:48 Waiting for app: TestTimerOverwrite to get deployed
2021/12/25 12:27:53 Waiting for app: TestTimerOverwrite to get deployed
2021/12/25 12:27:58 Waiting for app: TestTimerOverwrite to get deployed
2021/12/25 12:27:58 App: TestTimerOverwrite got deployed
2021/12/25 12:28:08 Starting bucket ops to source bucket
2021/12/25 12:28:18 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:28:23 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:28:28 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:28:33 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:28:38 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:28:43 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:28:48 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:28:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:28:58 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:29:03 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:29:08 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:29:13 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 12:29:18 Waiting for dst bucket item count to get to: 5000 curr count: 2510
2021/12/25 12:29:18 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 12:29:28 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:29:33 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/25 12:29:38 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/25 12:29:43 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/25 12:29:48 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/25 12:29:48 App: TestTimerOverwrite got un-deployed
2021/12/25 12:29:48 No eventing-con process running
2021/12/25 12:29:48 Function: TestTimerOverwrite delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverwrite deleting in background"
}
2021/12/25 12:29:49 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:29:59 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/25 12:30:04 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/25 12:30:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:30:06 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:30:16 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 12:30:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerOverwrite (182.32s)
=== RUN   TestUndeployBackdoorDuringBootstrap
2021/12/25 12:30:21 Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/25 12:30:22 Removing node(s): [] from the cluster
2021/12/25 12:30:27 Rebalance progress: 100
2021/12/25 12:30:27 Failing over: [127.0.0.1:19003]
2021/12/25 12:30:32 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2021/12/25 12:30:32 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2021/12/25 12:30:32 No eventing-con process running
2021/12/25 12:30:32 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployBackdoorDuringBootstrap not found"
}
2021/12/25 12:30:33 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:30:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:30:40 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:30:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:30:45 Deploying app: TestUndeployBackdoorDuringBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:30:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployBackdoorDuringBootstrap stored in temp store"
}
2021/12/25 12:30:46 Starting bucket ops to source bucket
2021/12/25 12:30:56 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:30:56 Context: Post to set retry counter, response code: 200 dump: {
 "code": 0
}
2021/12/25 12:30:56 set retry counter, response &{[123 10 32 34 99 111 100 101 34 58 32 48 10 125] }
2021/12/25 12:32:01 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2021/12/25 12:32:01 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2021/12/25 12:32:01 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:32:01 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployBackdoorDuringBootstrap deleting in background"
}
2021/12/25 12:32:06 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2021/12/25 12:32:06 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2021/12/25 12:32:06 No eventing-con process running
2021/12/25 12:32:06 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployBackdoorDuringBootstrap not found"
}
2021/12/25 12:32:07 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:32:17 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/25 12:32:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:32:19 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:32:29 Waiting for dst bucket item count to get to: 0 curr count: 2695
2021/12/25 12:32:34 Waiting for dst bucket item count to get to: 0 curr count: 195
2021/12/25 12:32:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:32:34 Removing node(s): [] from the cluster
2021/12/25 12:32:39 Rebalance progress: 100
--- PASS: TestUndeployBackdoorDuringBootstrap (143.06s)
=== RUN   TestOnUpdateSrcMutation
2021/12/25 12:32:49 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/25 12:32:49 App: TestOnUpdateSrcMutation got un-deployed
2021/12/25 12:32:49 No eventing-con process running
2021/12/25 12:32:49 Function: TestOnUpdateSrcMutation delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateSrcMutation not found"
}
2021/12/25 12:32:51 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:32:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:32:57 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:33:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:33:02 Deploying app: TestOnUpdateSrcMutation. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:33:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutation stored in temp store"
}
2021/12/25 12:33:04 Starting bucket ops to source bucket
2021/12/25 12:33:26 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/25 12:33:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:33:31 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/25 12:33:36 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/25 12:33:41 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/25 12:33:46 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/25 12:33:46 App: TestOnUpdateSrcMutation got un-deployed
2021/12/25 12:33:46 No eventing-con process running
2021/12/25 12:33:46 Function: TestOnUpdateSrcMutation delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutation deleting in background"
}
2021/12/25 12:33:47 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:33:57 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/25 12:33:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:33:59 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:34:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateSrcMutation (84.56s)
=== RUN   TestOnDeleteSrcMutation
2021/12/25 12:34:14 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/25 12:34:14 App: TestOnDeleteSrcMutation got un-deployed
2021/12/25 12:34:14 No eventing-con process running
2021/12/25 12:34:14 Function: TestOnDeleteSrcMutation delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteSrcMutation not found"
}
2021/12/25 12:34:15 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:34:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:34:22 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:34:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:34:27 Deploying app: TestOnDeleteSrcMutation. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:34:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutation stored in temp store"
}
2021/12/25 12:34:28 Starting bucket ops to source bucket
2021/12/25 12:34:57 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 12:34:57 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:35:02 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/25 12:35:07 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/25 12:35:12 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/25 12:35:17 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/25 12:35:17 App: TestOnDeleteSrcMutation got un-deployed
2021/12/25 12:35:17 No eventing-con process running
2021/12/25 12:35:17 Function: TestOnDeleteSrcMutation delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutation deleting in background"
}
2021/12/25 12:35:18 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:35:28 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 12:35:33 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/25 12:35:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:35:35 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:35:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteSrcMutation (96.25s)
=== RUN   TestOnUpdateSrcMutationWithTimer
2021/12/25 12:35:50 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/25 12:35:50 App: TestOnUpdateSrcMutationWithTimer got un-deployed
2021/12/25 12:35:50 No eventing-con process running
2021/12/25 12:35:50 Function: TestOnUpdateSrcMutationWithTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateSrcMutationWithTimer not found"
}
2021/12/25 12:35:51 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:35:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:35:58 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:36:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:36:03 Deploying app: TestOnUpdateSrcMutationWithTimer. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:36:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutationWithTimer stored in temp store"
}
2021/12/25 12:36:04 Starting bucket ops to source bucket
2021/12/25 12:36:46 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/25 12:36:46 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:36:51 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/25 12:36:57 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/25 12:37:02 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/25 12:37:07 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/25 12:37:07 App: TestOnUpdateSrcMutationWithTimer got un-deployed
2021/12/25 12:37:07 No eventing-con process running
2021/12/25 12:37:07 Function: TestOnUpdateSrcMutationWithTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutationWithTimer deleting in background"
}
2021/12/25 12:37:08 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:37:18 Waiting for dst bucket item count to get to: 0 curr count: 7007
2021/12/25 12:37:23 Waiting for dst bucket item count to get to: 0 curr count: 2007
2021/12/25 12:37:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:37:25 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:37:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateSrcMutationWithTimer (109.51s)
=== RUN   TestOnDeleteSrcMutationsWithTimer
2021/12/25 12:37:40 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/25 12:37:40 App: TestOnDeleteSrcMutationsWithTimer got un-deployed
2021/12/25 12:37:40 No eventing-con process running
2021/12/25 12:37:40 Function: TestOnDeleteSrcMutationsWithTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteSrcMutationsWithTimer not found"
}
2021/12/25 12:37:41 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:37:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:37:48 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:37:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:37:53 Deploying app: TestOnDeleteSrcMutationsWithTimer. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:37:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutationsWithTimer stored in temp store"
}
2021/12/25 12:37:54 Starting bucket ops to source bucket
2021/12/25 12:38:37 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 12:38:37 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:38:43 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/25 12:38:48 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/25 12:38:53 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/25 12:38:58 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/25 12:38:58 App: TestOnDeleteSrcMutationsWithTimer got un-deployed
2021/12/25 12:38:58 No eventing-con process running
2021/12/25 12:38:58 Function: TestOnDeleteSrcMutationsWithTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutationsWithTimer deleting in background"
}
2021/12/25 12:38:59 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:39:09 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 12:39:14 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/25 12:39:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:39:16 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:39:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteSrcMutationsWithTimer (111.30s)
=== RUN   TestInterHandlerRecursion
2021/12/25 12:39:31 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/25 12:39:31 App: TestInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/25 12:39:31 No eventing-con process running
2021/12/25 12:39:31 Function: TestInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_source_bucket_update_op not found"
}
2021/12/25 12:39:32 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:39:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:39:39 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:39:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:39:49 Waiting for app: TestInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/25 12:39:49 App: TestInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/25 12:39:49 No eventing-con process running
2021/12/25 12:39:49 Function: TestInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2021/12/25 12:39:50 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:39:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:39:57 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:40:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:40:02 Deploying app: TestInterHandlerRecursion_source_bucket_update_op. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:40:03 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op stored in temp store"
}
2021/12/25 12:40:03 response body {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op stored in temp store"
} err 
2021/12/25 12:40:08 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/25 12:40:13 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/25 12:40:18 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/25 12:40:23 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/25 12:40:23 App: TestInterHandlerRecursion_source_bucket_update_op got deployed
2021/12/25 12:40:23 Deploying app: TestInterHandlerRecursion_src_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:40:23 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_FUNCTION_RECURSION",
 "code": 50,
 "description": "Inter handler recursion error"
}
2021/12/25 12:40:23 response body {
 "name": "ERR_INTER_FUNCTION_RECURSION",
 "code": 50,
 "description": "Inter handler recursion error"
} err 
2021/12/25 12:40:28 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/25 12:40:34 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/25 12:40:39 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/25 12:40:44 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/25 12:40:44 App: TestInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/25 12:40:44 No eventing-con process running
2021/12/25 12:40:44 Function: TestInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op deleting in background"
}
2021/12/25 12:40:45 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:40:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:40:51 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:40:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:41:02 Waiting for app: TestInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/25 12:41:02 App: TestInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/25 12:41:02 No eventing-con process running
2021/12/25 12:41:02 Function: TestInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2021/12/25 12:41:03 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:41:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:41:10 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:41:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterHandlerRecursion (113.63s)
=== RUN   TestInterBucketRecursion
2021/12/25 12:41:20 Deploying app: TestInterBucketRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:41:21 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 stored in temp store"
}
2021/12/25 12:41:21 response body {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 stored in temp store"
} err 
2021/12/25 12:41:21 Deploying app: TestInterBucketRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:41:21 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestInterBucketRecursion_function2 causes a cycle involving functions: [TestInterBucketRecursion_function1], hence deployment is disallowed"
}
2021/12/25 12:41:26 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/25 12:41:31 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/25 12:41:36 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/25 12:41:41 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/25 12:41:41 App: TestInterBucketRecursion_function1 got deployed
2021/12/25 12:41:46 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/25 12:41:51 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/25 12:41:56 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/25 12:42:01 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/25 12:42:01 App: TestInterBucketRecursion_function1 got un-deployed
2021/12/25 12:42:01 No eventing-con process running
2021/12/25 12:42:01 Function: TestInterBucketRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 deleting in background"
}
2021/12/25 12:42:02 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:42:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:42:09 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:42:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:42:19 Waiting for app: TestInterBucketRecursion_function2 to get un-deployed
2021/12/25 12:42:19 App: TestInterBucketRecursion_function2 got un-deployed
2021/12/25 12:42:19 No eventing-con process running
2021/12/25 12:42:19 Function: TestInterBucketRecursion_function2 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterBucketRecursion_function2 not found"
}
2021/12/25 12:42:20 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:42:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:42:27 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:42:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterBucketRecursion (77.55s)
=== RUN   TestLargeHandler
2021/12/25 12:42:32 Changed force_compress value to false
2021/12/25 12:42:32 Deploying app: TestLargeHandler_function. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:42:32 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_APPCODE_SIZE",
 "code": 39,
 "description": "Function: TestLargeHandler_function handler Code size is more than 131072. Code Size: 131768"
}
2021/12/25 12:42:32 Changed force_compress value to true
2021/12/25 12:42:32 Deploying app: TestLargeHandler_function. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:42:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestLargeHandler_function stored in temp store"
}
2021/12/25 12:42:39 Waiting for app: TestLargeHandler_function to get deployed
2021/12/25 12:42:44 Waiting for app: TestLargeHandler_function to get deployed
2021/12/25 12:42:49 Waiting for app: TestLargeHandler_function to get deployed
2021/12/25 12:42:54 Waiting for app: TestLargeHandler_function to get deployed
2021/12/25 12:42:54 App: TestLargeHandler_function got deployed
2021/12/25 12:43:00 Waiting for app: TestLargeHandler_function to get un-deployed
2021/12/25 12:43:05 Waiting for app: TestLargeHandler_function to get un-deployed
2021/12/25 12:43:10 Waiting for app: TestLargeHandler_function to get un-deployed
2021/12/25 12:43:15 Waiting for app: TestLargeHandler_function to get un-deployed
2021/12/25 12:43:15 App: TestLargeHandler_function got un-deployed
2021/12/25 12:43:15 No eventing-con process running
2021/12/25 12:43:15 Function: TestLargeHandler_function delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestLargeHandler_function deleting in background"
}
2021/12/25 12:43:16 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:43:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:43:23 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:43:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestLargeHandler (55.56s)
=== RUN   TestAllowInterHandlerRecursion
2021/12/25 12:43:38 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/25 12:43:38 App: TestAllowInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/25 12:43:38 No eventing-con process running
2021/12/25 12:43:38 Function: TestAllowInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op not found"
}
2021/12/25 12:43:39 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:43:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:43:46 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:43:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:43:56 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/25 12:43:56 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/25 12:43:56 No eventing-con process running
2021/12/25 12:43:56 Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2021/12/25 12:43:57 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:44:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:44:04 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:44:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:44:09 Deploying app: TestAllowInterHandlerRecursion_source_bucket_update_op. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:44:10 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op stored in temp store"
}
2021/12/25 12:44:10 response body {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op stored in temp store"
} err 
2021/12/25 12:44:15 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/25 12:44:20 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/25 12:44:25 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/25 12:44:30 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/25 12:44:30 App: TestAllowInterHandlerRecursion_source_bucket_update_op got deployed
2021/12/25 12:44:30 Deploying app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:44:31 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete stored in temp store"
}
2021/12/25 12:44:31 response body {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete stored in temp store"
} err 
2021/12/25 12:44:36 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/25 12:44:41 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/25 12:44:46 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/25 12:44:51 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/25 12:44:51 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got deployed
2021/12/25 12:44:51 TestAllowInterHandlerRecursion_src_bucket_op_on_delete is deployed
2021/12/25 12:44:57 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/25 12:45:02 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/25 12:45:07 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/25 12:45:12 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/25 12:45:12 App: TestAllowInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/25 12:45:12 No eventing-con process running
2021/12/25 12:45:12 Function: TestAllowInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op deleting in background"
}
2021/12/25 12:45:14 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:45:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:45:21 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:45:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:45:31 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/25 12:45:36 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/25 12:45:41 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/25 12:45:46 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/25 12:45:46 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/25 12:45:46 No eventing-con process running
2021/12/25 12:45:46 Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete deleting in background"
}
2021/12/25 12:45:47 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:45:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:45:54 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:45:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAllowInterHandlerRecursion (151.40s)
=== RUN   TestAllowInterBucketRecursion
2021/12/25 12:46:04 Deploying app: TestAllowInterBucketRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:46:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 stored in temp store"
}
2021/12/25 12:46:05 response body {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 stored in temp store"
} err 
2021/12/25 12:46:10 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/25 12:46:15 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/25 12:46:20 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/25 12:46:25 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/25 12:46:25 App: TestAllowInterBucketRecursion_function1 got deployed
2021/12/25 12:46:25 Deploying app: TestAllowInterBucketRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:46:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 stored in temp store"
}
2021/12/25 12:46:26 response body {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 stored in temp store"
} err 
2021/12/25 12:46:31 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/25 12:46:37 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/25 12:46:42 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/25 12:46:47 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/25 12:46:47 App: TestAllowInterBucketRecursion_function2 got deployed
2021/12/25 12:46:47 TestAllowInterBucketRecursion_function2 is deployed
2021/12/25 12:46:52 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/25 12:46:57 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/25 12:47:02 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/25 12:47:07 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/25 12:47:07 App: TestAllowInterBucketRecursion_function1 got un-deployed
2021/12/25 12:47:07 No eventing-con process running
2021/12/25 12:47:07 Function: TestAllowInterBucketRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 deleting in background"
}
2021/12/25 12:47:08 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:47:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:47:16 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:47:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:47:26 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/25 12:47:31 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/25 12:47:37 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/25 12:47:42 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/25 12:47:42 App: TestAllowInterBucketRecursion_function2 got un-deployed
2021/12/25 12:47:42 No eventing-con process running
2021/12/25 12:47:42 Function: TestAllowInterBucketRecursion_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 deleting in background"
}
2021/12/25 12:47:43 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:47:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:47:50 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:47:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAllowInterBucketRecursion (115.54s)
=== RUN   TestInterBucketRecursion2
2021/12/25 12:48:01 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:48:07 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:48:13 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:48:19 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:48:24 Deploying app: TestInterBucketRecursion2_function1. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:48:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function1 stored in temp store"
}
2021/12/25 12:48:30 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/25 12:48:35 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/25 12:48:40 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/25 12:48:45 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/25 12:48:45 App: TestInterBucketRecursion2_function1 got deployed
2021/12/25 12:48:45 Deploying app: TestInterBucketRecursion2_function2. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:48:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function2 stored in temp store"
}
2021/12/25 12:48:52 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/25 12:48:57 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/25 12:49:02 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/25 12:49:07 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/25 12:49:07 App: TestInterBucketRecursion2_function2 got deployed
2021/12/25 12:49:07 Deploying app: TestInterBucketRecursion2_function3. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:49:08 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function3 stored in temp store"
}
2021/12/25 12:49:13 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/25 12:49:18 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/25 12:49:23 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/25 12:49:28 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/25 12:49:28 App: TestInterBucketRecursion2_function3 got deployed
2021/12/25 12:49:28 Deploying app: TestInterBucketRecursion2_function4. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:49:28 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestInterBucketRecursion2_function4 causes a cycle involving functions: [TestInterBucketRecursion2_function1 TestInterBucketRecursion2_function2 TestInterBucketRecursion2_function3], hence deployment is disallowed"
}
2021/12/25 12:49:33 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/25 12:49:38 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/25 12:49:43 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/25 12:49:48 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/25 12:49:48 App: TestInterBucketRecursion2_function1 got un-deployed
2021/12/25 12:49:48 No eventing-con process running
2021/12/25 12:49:48 Function: TestInterBucketRecursion2_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function1 deleting in background"
}
2021/12/25 12:49:50 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:49:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:49:56 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:50:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:50:06 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/25 12:50:12 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/25 12:50:17 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/25 12:50:22 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/25 12:50:22 App: TestInterBucketRecursion2_function2 got un-deployed
2021/12/25 12:50:22 No eventing-con process running
2021/12/25 12:50:22 Function: TestInterBucketRecursion2_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function2 deleting in background"
}
2021/12/25 12:50:23 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:50:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:50:30 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:50:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:50:40 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/25 12:50:45 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/25 12:50:50 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/25 12:50:55 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/25 12:50:55 App: TestInterBucketRecursion2_function3 got un-deployed
2021/12/25 12:50:55 No eventing-con process running
2021/12/25 12:50:55 Function: TestInterBucketRecursion2_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function3 deleting in background"
}
2021/12/25 12:50:57 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:51:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:51:03 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:51:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:51:13 Waiting for app: TestInterBucketRecursion2_function4 to get un-deployed
2021/12/25 12:51:13 App: TestInterBucketRecursion2_function4 got un-deployed
2021/12/25 12:51:13 No eventing-con process running
2021/12/25 12:51:13 Function: TestInterBucketRecursion2_function4 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterBucketRecursion2_function4 not found"
}
2021/12/25 12:51:15 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:51:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:51:22 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:51:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterBucketRecursion2 (213.74s)
=== RUN   TestBucketDeleteWithRebOut
2021/12/25 12:51:33 Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/25 12:51:38 Rebalance progress: 100

VB distribution across eventing nodes and their workers::

2021/12/25 12:51:42 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/25 12:51:57 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/25 12:52:12 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/25 12:52:27 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/25 12:52:42 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/25 12:52:57 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/25 12:53:12 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/25 12:53:27 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/25 12:53:42 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/25 12:53:57 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]

DCP Stream statuses:

vbucket curr owner:


2021/12/25 12:54:12 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:54:12 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 12:54:12 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 12:54:17 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:

vbucket curr owner:


2021/12/25 12:54:17 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:54:17 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 12:54:17 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 12:54:22 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:

vbucket curr owner:


2021/12/25 12:54:22 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:54:27 clusterSetup.go:397: Waiting for app: TestBucketDeleteWithRebOut to get un-deployed
2021/12/25 12:54:27 clusterSetup.go:405: App: TestBucketDeleteWithRebOut got un-deployed
2021/12/25 12:54:27 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:54:27 eventingSetup.go:418: Function: TestBucketDeleteWithRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketDeleteWithRebOut not found"
}
2021/12/25 12:54:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:54:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:54:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:54:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:54:45 eventingSetup.go:125: Deploying app: TestBucketDeleteWithRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:54:46 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteWithRebOut stored in temp store"
}
2021/12/25 12:54:51 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/25 12:54:56 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/25 12:55:01 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/25 12:55:06 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/25 12:55:06 clusterSetup.go:354: App: TestBucketDeleteWithRebOut got deployed

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: a3922b84854ec9e1fbe77304ee4fb343
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [0-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [114-227]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 114
	v: [228-341]
Producer node: 172.31.2.134:9300	Node UUID: 7cfe2f2d88596deb45cd4bf6c7da432b
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [797-910]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [911-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [683-796]
Producer node: 127.0.0.1:9303	Node UUID: 73fcaf5fbbd150fbe384962752f45b88
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [570-682]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [342-455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [456-569]


2021/12/25 12:55:07 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:55:07 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 12:55:12 Rebalance progress: 29.16666666666666
2021/12/25 12:55:17 Rebalance progress: 29.16666666666666
2021/12/25 12:55:22 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: a3922b84854ec9e1fbe77304ee4fb343
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 114
	v: [228-341]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [0-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [114-227]
Producer node: 172.31.2.134:9300	Node UUID: 7cfe2f2d88596deb45cd4bf6c7da432b
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [797-910]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [911-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [683-796]
Producer node: 127.0.0.1:9303	Node UUID: 73fcaf5fbbd150fbe384962752f45b88
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [342-455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [456-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [570-682]


2021/12/25 12:55:22 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:55:22 handler_test.go:1674: Deleting source bucket: default
2021/12/25 12:55:23 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 12:55:24 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 12:55:29 Rebalance progress: 29.16666666666666
2021/12/25 12:55:34 Rebalance progress: 29.16666666666666
2021/12/25 12:55:39 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 908
	vb list dump: [0-3, 5-13, 15-19, 21-40, 43-47, 49-50, 52-56, 58-63, 65-80, 82-88, 90, 92-102, 104-115, 117-127, 129-138, 140, 142, 144, 146-150, 153-179, 181-183, 185-193, 195-211, 213-216, 218-227, 229-230, 232-241, 243-263, 265-267, 269-272, 274-277, 279-281, 283-286, 288-293, 295-297, 299-307, 309-333, 335-365, 368-370, 372-386, 388-392, 395-410, 413-434, 436-441, 443, 445-446, 448-453, 455-457, 459-460, 462, 465-466, 468-469, 471, 473-482, 484, 486-489, 491-501, 504, 506-507, 509-577, 579-580, 582-585, 587, 589-593, 595-600, 602-626, 628-631, 633-646, 648-655, 657-668, 670-672, 674-686, 688-701, 704, 706-708, 710, 712-713, 715-718, 720-721, 723-729, 731-750, 752-754, 756-784, 786-798, 800, 802-804, 806-813, 815-822, 824-829, 831-833, 835-837, 839-858, 860-868, 870-885, 888-891, 893-912, 914-922, 924-927, 929-933, 936-942, 944-957, 959, 961-972, 974-985, 987-990, 992-1002, 1004-1023]
	stream status: stopped
	len: 116
	vb list dump: [4, 14, 20, 41-42, 48, 51, 57, 64, 81, 89, 91, 103, 116, 128, 139, 141, 143, 145, 151-152, 180, 184, 194, 212, 217, 228, 231, 242, 264, 268, 273, 278, 282, 287, 294, 298, 308, 334, 366-367, 371, 387, 393-394, 411-412, 435, 442, 444, 447, 454, 458, 461, 463-464, 467, 470, 472, 483, 485, 490, 502-503, 505, 508, 578, 581, 586, 588, 594, 601, 627, 632, 647, 656, 669, 673, 687, 702-703, 705, 709, 711, 714, 719, 722, 730, 751, 755, 785, 799, 801, 805, 814, 823, 830, 834, 838, 859, 869, 886-887, 892, 913, 923, 928, 934-935, 943, 958, 960, 973, 986, 991, 1003]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: a3922b84854ec9e1fbe77304ee4fb343
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 101
	v: [0-3, 5-13, 15-19, 21-40, 43-47, 49-50, 52-56, 58-63, 65-80, 82-88, 90, 92-102, 104-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 101
	v: [114-115, 117-127, 129-138, 140, 142, 144, 146-150, 153-179, 181-183, 185-193, 195-211, 213-216, 218-227]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 101
	v: [229-230, 232-241, 243-263, 265-267, 269-272, 274-277, 279-281, 283-286, 288-293, 295-297, 299-307, 309-333, 335-341]
Producer node: 172.31.2.134:9300	Node UUID: 7cfe2f2d88596deb45cd4bf6c7da432b
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 101
	v: [911-912, 914-922, 924-927, 929-933, 936-942, 944-957, 959, 961-972, 974-985, 987-990, 992-1002, 1004-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 101
	v: [683-686, 688-701, 704, 706-708, 710, 712-713, 715-718, 720-721, 723-729, 731-750, 752-754, 756-784, 786-796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 101
	v: [797-798, 800, 802-804, 806-813, 815-822, 824-829, 831-833, 835-837, 839-858, 860-868, 870-885, 888-891, 893-910]
Producer node: 127.0.0.1:9303	Node UUID: 73fcaf5fbbd150fbe384962752f45b88
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 101
	v: [342-365, 368-370, 372-386, 388-392, 395-410, 413-434, 436-441, 443, 445-446, 448-453, 455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 100
	v: [456-457, 459-460, 462, 465-466, 468-469, 471, 473-482, 484, 486-489, 491-501, 504, 506-507, 509-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 101
	v: [570-577, 579-580, 582-585, 587, 589-593, 595-600, 602-626, 628-631, 633-646, 648-655, 657-668, 670-672, 674-682]


2021/12/25 12:55:39 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 12:55:44 eventingSetup.go:719: Waiting for function: TestBucketDeleteWithRebOut status to change to undeployed
2021/12/25 12:55:44 eventingSetup.go:727: Function: TestBucketDeleteWithRebOut status changed to undeployed
2021/12/25 12:55:49 clusterSetup.go:397: Waiting for app: TestBucketDeleteWithRebOut to get un-deployed
2021/12/25 12:55:49 clusterSetup.go:405: App: TestBucketDeleteWithRebOut got un-deployed
2021/12/25 12:55:49 eventingSetup.go:46: No eventing-con process running
2021/12/25 12:55:49 eventingSetup.go:418: Function: TestBucketDeleteWithRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteWithRebOut deleting in background"
}
2021/12/25 12:55:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:55:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:55:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:56:02 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:56:02 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2021/12/25 12:56:03 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 12:56:08 Rebalance progress: 100
--- PASS: TestBucketDeleteWithRebOut (281.98s)
=== RUN   TestN1QLRecursion
2021/12/25 12:56:10 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/25 12:56:11 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2021/12/25 12:56:11 Removing node(s): [] from the cluster
2021/12/25 12:56:16 Rebalance progress: 100
2021/12/25 12:56:22 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:56:28 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:56:34 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:56:39 Deploying app: TestN1QLRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:56:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 stored in temp store"
}
2021/12/25 12:56:40 response body {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 stored in temp store"
} err 
2021/12/25 12:56:45 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/25 12:56:50 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/25 12:56:55 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/25 12:57:00 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/25 12:57:00 App: TestN1QLRecursion_function1 got deployed
2021/12/25 12:57:00 TestN1QLRecursion_function1 is deployed
2021/12/25 12:57:00 Deploying app: TestN1QLRecursion_function3. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:57:01 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 stored in temp store"
}
2021/12/25 12:57:01 response body {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 stored in temp store"
} err 
2021/12/25 12:57:06 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/25 12:57:11 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/25 12:57:16 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/25 12:57:22 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/25 12:57:22 App: TestN1QLRecursion_function3 got deployed
2021/12/25 12:57:22 TestN1QLRecursion_function3 is deployed
2021/12/25 12:57:22 Deploying app: TestN1QLRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:57:22 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestN1QLRecursion_function2 causes a cycle involving functions: [TestN1QLRecursion_function3 TestN1QLRecursion_function1], hence deployment is disallowed"
}
2021/12/25 12:57:22 response body {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestN1QLRecursion_function2 causes a cycle involving functions: [TestN1QLRecursion_function3 TestN1QLRecursion_function1], hence deployment is disallowed"
} err 
2021/12/25 12:57:22 Success: TestN1QLRecursion_function2 is not deployed
2021/12/25 12:57:27 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/25 12:57:32 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/25 12:57:37 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/25 12:57:42 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/25 12:57:42 App: TestN1QLRecursion_function1 got un-deployed
2021/12/25 12:57:42 No eventing-con process running
2021/12/25 12:57:42 Function: TestN1QLRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 deleting in background"
}
2021/12/25 12:57:44 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:57:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:57:50 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:57:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:58:01 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/25 12:58:06 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/25 12:58:11 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/25 12:58:16 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/25 12:58:16 App: TestN1QLRecursion_function3 got un-deployed
2021/12/25 12:58:16 No eventing-con process running
2021/12/25 12:58:16 Function: TestN1QLRecursion_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 deleting in background"
}
2021/12/25 12:58:18 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:58:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:58:24 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:58:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 12:58:31 Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/25 12:58:36 Rebalance progress: 100
--- PASS: TestN1QLRecursion (145.48s)
=== RUN   TestN1QLAllowRecursion
2021/12/25 12:58:36 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/25 12:58:36 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2021/12/25 12:58:36 Removing node(s): [] from the cluster
2021/12/25 12:58:41 Rebalance progress: 100
2021/12/25 12:58:47 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:58:53 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:58:59 Context: Bucket flush, response code: 200 dump: 
2021/12/25 12:59:04 Deploying app: TestN1QLAllowRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:59:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 stored in temp store"
}
2021/12/25 12:59:05 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 stored in temp store"
} err 
2021/12/25 12:59:10 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/25 12:59:15 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/25 12:59:20 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/25 12:59:25 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/25 12:59:25 App: TestN1QLAllowRecursion_function1 got deployed
2021/12/25 12:59:25 TestN1QLAllowRecursion_function1 is deployed
2021/12/25 12:59:25 Deploying app: TestN1QLAllowRecursion_function3. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:59:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 stored in temp store"
}
2021/12/25 12:59:26 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 stored in temp store"
} err 
2021/12/25 12:59:31 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/25 12:59:36 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/25 12:59:41 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/25 12:59:46 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/25 12:59:46 App: TestN1QLAllowRecursion_function3 got deployed
2021/12/25 12:59:46 TestN1QLAllowRecursion_function3 is deployed
2021/12/25 12:59:47 Deploying app: TestN1QLAllowRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/25 12:59:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 stored in temp store"
}
2021/12/25 12:59:48 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 stored in temp store"
} err 
2021/12/25 12:59:53 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/25 12:59:58 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/25 13:00:03 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/25 13:00:08 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/25 13:00:08 App: TestN1QLAllowRecursion_function2 got deployed
2021/12/25 13:00:08 Success: TestN1QLAllowRecursion_function2 is deployed after allow_interbucket_recursion
2021/12/25 13:00:13 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/25 13:00:18 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/25 13:00:23 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/25 13:00:28 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/25 13:00:28 App: TestN1QLAllowRecursion_function1 got un-deployed
2021/12/25 13:00:28 No eventing-con process running
2021/12/25 13:00:28 Function: TestN1QLAllowRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 deleting in background"
}
2021/12/25 13:00:30 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:00:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:00:37 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:00:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:00:47 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/25 13:00:52 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/25 13:00:57 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/25 13:01:02 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/25 13:01:02 App: TestN1QLAllowRecursion_function2 got un-deployed
2021/12/25 13:01:02 No eventing-con process running
2021/12/25 13:01:02 Function: TestN1QLAllowRecursion_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 deleting in background"
}
2021/12/25 13:01:04 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:01:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:01:11 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:01:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:01:21 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2021/12/25 13:01:26 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2021/12/25 13:01:31 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2021/12/25 13:01:36 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2021/12/25 13:01:36 App: TestN1QLAllowRecursion_function3 got un-deployed
2021/12/25 13:01:36 No eventing-con process running
2021/12/25 13:01:36 Function: TestN1QLAllowRecursion_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 deleting in background"
}
2021/12/25 13:01:38 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:01:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:01:45 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:01:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:01:51 Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/25 13:01:56 Rebalance progress: 100
--- PASS: TestN1QLAllowRecursion (200.34s)
=== RUN   TestOnDeleteExpiryBucketOp
2021/12/25 13:01:56 Sleeping for some time
2021/12/25 13:02:06 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/25 13:02:06 App: TestOnDeleteExpiryBucketOp got un-deployed
2021/12/25 13:02:06 No eventing-con process running
2021/12/25 13:02:06 Function: TestOnDeleteExpiryBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteExpiryBucketOp not found"
}
2021/12/25 13:02:08 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:02:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:02:15 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:02:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:02:20 Deploying app: TestOnDeleteExpiryBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:02:21 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteExpiryBucketOp stored in temp store"
}
2021/12/25 13:02:21 Starting bucket ops to source bucket
2021/12/25 13:03:10 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 13:03:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/25 13:03:15 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 13:03:15 Starting bucket ops to source bucket
2021/12/25 13:03:16 Starting bucket ops to source bucket
2021/12/25 13:04:22 Waiting for dst bucket item count to get to: 7000 curr count: 5000
2021/12/25 13:04:27 Waiting for dst bucket item count to get to: 7000 curr count: 6998
2021/12/25 13:04:32 Waiting for dst bucket item count to get to: 7000 curr count: 6998
2021/12/25 13:04:32 src & dst bucket item count matched up. src bucket count: 7000 dst bucket count: 7000
2021/12/25 13:04:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 13:04:37 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/25 13:04:43 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/25 13:04:48 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/25 13:04:53 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/25 13:04:53 App: TestOnDeleteExpiryBucketOp got un-deployed
2021/12/25 13:04:53 No eventing-con process running
2021/12/25 13:04:53 Function: TestOnDeleteExpiryBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteExpiryBucketOp deleting in background"
}
2021/12/25 13:04:54 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:05:04 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/25 13:05:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:05:06 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:05:16 Waiting for dst bucket item count to get to: 0 curr count: 7000
2021/12/25 13:05:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteExpiryBucketOp (200.01s)
=== RUN   TestTimerOverWriteSameReference
2021/12/25 13:05:21 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/25 13:05:21 App: TestTimerOverWriteSameReference got un-deployed
2021/12/25 13:05:21 No eventing-con process running
2021/12/25 13:05:21 Function: TestTimerOverWriteSameReference delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerOverWriteSameReference not found"
}
2021/12/25 13:05:23 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:05:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:05:30 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:05:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:05:35 Deploying app: TestTimerOverWriteSameReference. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:05:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverWriteSameReference stored in temp store"
}
2021/12/25 13:05:41 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/25 13:05:46 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/25 13:05:51 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/25 13:05:56 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/25 13:05:56 App: TestTimerOverWriteSameReference got deployed
2021/12/25 13:06:06 Starting bucket ops to source bucket
2021/12/25 13:07:07 src & dst bucket item count matched up. src bucket count: 1 dst bucket count: 1
2021/12/25 13:07:17 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 13:07:22 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/25 13:07:27 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/25 13:07:32 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/25 13:07:37 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/25 13:07:37 App: TestTimerOverWriteSameReference got un-deployed
2021/12/25 13:07:37 No eventing-con process running
2021/12/25 13:07:37 Function: TestTimerOverWriteSameReference delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverWriteSameReference deleting in background"
}
2021/12/25 13:07:39 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:07:49 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/25 13:07:54 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/25 13:07:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:07:56 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:08:06 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/25 13:08:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerOverWriteSameReference (169.82s)
=== RUN   TestCancelTimerBucketop
2021/12/25 13:08:11 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/25 13:08:11 App: TestCancelTimerBucketop got un-deployed
2021/12/25 13:08:11 No eventing-con process running
2021/12/25 13:08:11 Function: TestCancelTimerBucketop delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCancelTimerBucketop not found"
}
2021/12/25 13:08:13 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:08:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:08:20 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:08:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:08:25 Deploying app: TestCancelTimerBucketop. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:08:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCancelTimerBucketop stored in temp store"
}
2021/12/25 13:08:31 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/25 13:08:36 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/25 13:08:41 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/25 13:08:46 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/25 13:08:46 App: TestCancelTimerBucketop got deployed
2021/12/25 13:08:46 Starting bucket ops to source bucket
2021/12/25 13:08:53 Starting bucket ops to source bucket
2021/12/25 13:09:55 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/25 13:09:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 13:10:00 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/25 13:10:05 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/25 13:10:10 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/25 13:10:15 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/25 13:10:15 App: TestCancelTimerBucketop got un-deployed
2021/12/25 13:10:15 No eventing-con process running
2021/12/25 13:10:15 Function: TestCancelTimerBucketop delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCancelTimerBucketop deleting in background"
}
2021/12/25 13:10:17 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:10:27 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/25 13:10:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:10:29 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:10:39 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/25 13:10:44 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/25 13:10:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCancelTimerBucketop (158.17s)
=== RUN   TestJSExpiryDate
2021/12/25 13:10:49 Starting bucket ops to source bucket
2021/12/25 13:11:02 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 13:11:02 Deploying app: TestJSExpiryDate. Item count src bucket: 5000 dst bucket: 0
2021/12/25 13:11:03 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestJSExpiryDate stored in temp store"
}
2021/12/25 13:11:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:11:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 13:11:39 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/25 13:11:44 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/25 13:11:49 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/25 13:11:54 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/25 13:11:54 App: TestJSExpiryDate got un-deployed
2021/12/25 13:11:54 No eventing-con process running
2021/12/25 13:11:54 Function: TestJSExpiryDate delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestJSExpiryDate deleting in background"
}
2021/12/25 13:11:55 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:12:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:12:03 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:12:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestJSExpiryDate (83.72s)
=== RUN   TestBinaryDoc
2021/12/25 13:12:13 Starting bucket ops to source bucket
2021/12/25 13:12:13 Deploying app: TestBinaryDoc. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:12:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBinaryDoc stored in temp store"
}
2021/12/25 13:12:14 Starting bucket ops to source bucket
2021/12/25 13:12:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:12:14 Deleting source bucket docs now
2021/12/25 13:12:14 Starting bucket ops to source bucket
2021/12/25 13:12:51 Waiting for dst bucket item count to get to: 32 curr count: 23
2021/12/25 13:12:56 Waiting for dst bucket item count to get to: 32 curr count: 28
2021/12/25 13:12:56 src & dst bucket item count matched up. src bucket count: 32 dst bucket count: 32
2021/12/25 13:12:56 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 13:13:01 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/25 13:13:06 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/25 13:13:11 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/25 13:13:17 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/25 13:13:17 App: TestBinaryDoc got un-deployed
2021/12/25 13:13:17 No eventing-con process running
2021/12/25 13:13:17 Function: TestBinaryDoc delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBinaryDoc deleting in background"
}
2021/12/25 13:13:18 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:13:28 Waiting for dst bucket item count to get to: 0 curr count: 25
2021/12/25 13:13:33 Waiting for dst bucket item count to get to: 0 curr count: 7
2021/12/25 13:13:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:13:35 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:13:45 Waiting for dst bucket item count to get to: 0 curr count: 32
2021/12/25 13:13:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBinaryDoc (97.23s)
=== RUN   TestConstantBindings
2021/12/25 13:13:45 Deploying app: TestConstantBindings. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:13:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestConstantBindings stored in temp store"
}
2021/12/25 13:13:46 Starting bucket ops to source bucket
2021/12/25 13:13:52 Waiting for dst bucket item count to get to: 6000 curr count: 0
2021/12/25 13:13:57 Waiting for dst bucket item count to get to: 6000 curr count: 0
2021/12/25 13:14:02 Waiting for dst bucket item count to get to: 6000 curr count: 0
2021/12/25 13:14:07 Waiting for dst bucket item count to get to: 6000 curr count: 1766
2021/12/25 13:14:12 Waiting for dst bucket item count to get to: 6000 curr count: 1766
2021/12/25 13:14:12 src & dst bucket item count matched up. src bucket count: 6000 dst bucket count: 6000
2021/12/25 13:14:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 13:14:17 Waiting for app: TestConstantBindings to get un-deployed
2021/12/25 13:14:22 Waiting for app: TestConstantBindings to get un-deployed
2021/12/25 13:14:27 Waiting for app: TestConstantBindings to get un-deployed
2021/12/25 13:14:32 Waiting for app: TestConstantBindings to get un-deployed
2021/12/25 13:14:32 App: TestConstantBindings got un-deployed
2021/12/25 13:14:32 No eventing-con process running
2021/12/25 13:14:32 Function: TestConstantBindings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestConstantBindings deleting in background"
}
2021/12/25 13:14:34 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:14:44 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/25 13:14:49 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/25 13:14:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:14:51 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:15:01 Waiting for dst bucket item count to get to: 0 curr count: 5476
2021/12/25 13:15:06 Waiting for dst bucket item count to get to: 0 curr count: 5476
2021/12/25 13:15:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestConstantBindings (80.69s)
=== RUN   TestCodeInsight
2021/12/25 13:15:11 Waiting for app: TestCodeInsight to get un-deployed
2021/12/25 13:15:11 App: TestCodeInsight got un-deployed
2021/12/25 13:15:11 No eventing-con process running
2021/12/25 13:15:11 Function: TestCodeInsight delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCodeInsight not found"
}
2021/12/25 13:15:13 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:15:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:15:19 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:15:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:15:24 Starting bucket ops to source bucket
2021/12/25 13:15:25 Deploying app: TestCodeInsight. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:15:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCodeInsight stored in temp store"
}
2021/12/25 13:15:31 Waiting for app: TestCodeInsight to get deployed
2021/12/25 13:15:36 Waiting for app: TestCodeInsight to get deployed
2021/12/25 13:15:41 Waiting for app: TestCodeInsight to get deployed
2021/12/25 13:15:46 Waiting for app: TestCodeInsight to get deployed
2021/12/25 13:15:46 App: TestCodeInsight got deployed
2021/12/25 13:15:51 Waiting for dst bucket item count to get to: 1000 curr count: 351
2021/12/25 13:15:51 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/25 13:15:56 Waiting for app: TestCodeInsight to get un-deployed
2021/12/25 13:16:02 Waiting for app: TestCodeInsight to get un-deployed
2021/12/25 13:16:07 Waiting for app: TestCodeInsight to get un-deployed
2021/12/25 13:16:12 Waiting for app: TestCodeInsight to get un-deployed
2021/12/25 13:16:12 App: TestCodeInsight got un-deployed
2021/12/25 13:16:12 No eventing-con process running
2021/12/25 13:16:12 Function: TestCodeInsight delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCodeInsight deleting in background"
}
2021/12/25 13:16:13 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:16:23 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/25 13:16:28 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/25 13:16:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:16:30 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:16:40 Waiting for dst bucket item count to get to: 0 curr count: 707
2021/12/25 13:16:45 Waiting for dst bucket item count to get to: 0 curr count: 707
2021/12/25 13:16:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCodeInsight (99.38s)
=== RUN   TestParserTransform
--- PASS: TestParserTransform (0.05s)
=== RUN   TestParserDetect
--- PASS: TestParserDetect (0.00s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	13040.645s

Functional tests took 3 hours, 37 minutes and 23 seconds.

N1ql tests

2021/12/25 13:16:55 Started n1ql
2021/12/25 13:17:04 Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2021/12/25 13:17:04 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2021/12/25 13:17:04 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 13:17:05 Removing node(s): [] from the cluster
2021/12/25 13:17:10 Rebalance progress: 100
=== RUN   TestRecursiveMutationN1QL
2021/12/25 13:17:15 Waiting for app: TestRecursiveMutationN1QL to get un-deployed
2021/12/25 13:17:15 App: TestRecursiveMutationN1QL got un-deployed
2021/12/25 13:17:15 No eventing-con process running
2021/12/25 13:17:15 Function: TestRecursiveMutationN1QL delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestRecursiveMutationN1QL not found"
}
2021/12/25 13:17:17 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:17:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:17:24 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:17:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:17:29 Deploying app: TestRecursiveMutationN1QL. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:17:29 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Function: TestRecursiveMutationN1QL N1QL DML to source keyspace default:default"
}
--- PASS: TestRecursiveMutationN1QL (18.62s)
=== RUN   TestFlexReset1
2021/12/25 13:17:34 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/25 13:17:34 App: TestFlexReset1 got un-deployed
2021/12/25 13:17:34 No eventing-con process running
2021/12/25 13:17:34 Function: TestFlexReset1 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestFlexReset1 not found"
}
2021/12/25 13:17:35 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:17:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:17:42 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:17:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:17:47 Starting bucket ops to source bucket
2021/12/25 13:17:48 Deploying app: TestFlexReset1. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:17:49 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset1 stored in temp store"
}
2021/12/25 13:17:54 Waiting for app: TestFlexReset1 to get deployed
2021/12/25 13:17:59 Waiting for app: TestFlexReset1 to get deployed
2021/12/25 13:18:04 Waiting for app: TestFlexReset1 to get deployed
2021/12/25 13:18:09 Waiting for app: TestFlexReset1 to get deployed
2021/12/25 13:18:09 App: TestFlexReset1 got deployed
2021/12/25 13:18:14 Waiting for dst bucket item count to get to: 1000 curr count: 500
2021/12/25 13:18:14 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/25 13:18:14 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 13:18:19 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/25 13:18:25 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/25 13:18:30 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/25 13:18:35 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/25 13:18:35 App: TestFlexReset1 got un-deployed
2021/12/25 13:18:35 No eventing-con process running
2021/12/25 13:18:35 Function: TestFlexReset1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset1 deleting in background"
}
2021/12/25 13:18:36 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:18:46 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/25 13:18:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:18:48 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:18:58 Waiting for dst bucket item count to get to: 0 curr count: 729
2021/12/25 13:19:03 Waiting for dst bucket item count to get to: 0 curr count: 229
2021/12/25 13:19:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestFlexReset1 (94.50s)
=== RUN   TestFlexReset2
2021/12/25 13:19:08 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/25 13:19:08 App: TestFlexReset2 got un-deployed
2021/12/25 13:19:08 No eventing-con process running
2021/12/25 13:19:08 Function: TestFlexReset2 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestFlexReset2 not found"
}
2021/12/25 13:19:10 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:19:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:19:17 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:19:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:19:22 Starting bucket ops to source bucket
2021/12/25 13:19:22 Deploying app: TestFlexReset2. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:19:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset2 stored in temp store"
}
2021/12/25 13:19:28 Waiting for app: TestFlexReset2 to get deployed
2021/12/25 13:19:33 Waiting for app: TestFlexReset2 to get deployed
2021/12/25 13:19:38 Waiting for app: TestFlexReset2 to get deployed
2021/12/25 13:19:43 Waiting for app: TestFlexReset2 to get deployed
2021/12/25 13:19:43 App: TestFlexReset2 got deployed
2021/12/25 13:19:48 Waiting for dst bucket item count to get to: 1000 curr count: 727
2021/12/25 13:19:53 Waiting for dst bucket item count to get to: 1000 curr count: 727
2021/12/25 13:19:53 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/25 13:19:53 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 13:19:59 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/25 13:20:04 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/25 13:20:09 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/25 13:20:14 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/25 13:20:14 App: TestFlexReset2 got un-deployed
2021/12/25 13:20:14 No eventing-con process running
2021/12/25 13:20:14 Function: TestFlexReset2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset2 deleting in background"
}
2021/12/25 13:20:16 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:20:26 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/25 13:20:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:20:27 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:20:37 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/25 13:20:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestFlexReset2 (94.21s)
=== RUN   TestN1QLLabelledBreak
2021/12/25 13:20:42 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/25 13:20:42 App: TestN1QLLabelledBreak got un-deployed
2021/12/25 13:20:42 No eventing-con process running
2021/12/25 13:20:42 Function: TestN1QLLabelledBreak delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLLabelledBreak not found"
}
2021/12/25 13:20:44 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:20:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:20:51 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:20:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:20:56 Deploying app: TestN1QLLabelledBreak. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:20:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLLabelledBreak stored in temp store"
}
2021/12/25 13:21:02 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/25 13:21:07 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/25 13:21:12 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/25 13:21:17 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/25 13:21:17 App: TestN1QLLabelledBreak got deployed
2021/12/25 13:21:17 Starting bucket ops to source bucket
2021/12/25 13:21:27 Waiting for dst bucket item count to get to: 10000 curr count: 133
2021/12/25 13:21:32 Waiting for dst bucket item count to get to: 10000 curr count: 133
2021/12/25 13:21:37 Waiting for dst bucket item count to get to: 10000 curr count: 133
2021/12/25 13:21:42 Waiting for dst bucket item count to get to: 10000 curr count: 3230
2021/12/25 13:21:47 Waiting for dst bucket item count to get to: 10000 curr count: 3230
2021/12/25 13:21:52 Waiting for dst bucket item count to get to: 10000 curr count: 7276
2021/12/25 13:21:57 Waiting for dst bucket item count to get to: 10000 curr count: 7276
2021/12/25 13:21:57 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/25 13:21:57 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 13:22:02 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/25 13:22:07 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/25 13:22:12 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/25 13:22:17 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/25 13:22:17 App: TestN1QLLabelledBreak got un-deployed
2021/12/25 13:22:17 No eventing-con process running
2021/12/25 13:22:17 Function: TestN1QLLabelledBreak delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLLabelledBreak deleting in background"
}
2021/12/25 13:22:19 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:22:29 Waiting for dst bucket item count to get to: 0 curr count: 4747
2021/12/25 13:22:34 Waiting for dst bucket item count to get to: 0 curr count: 2247
2021/12/25 13:22:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:22:36 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:22:46 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/25 13:22:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLLabelledBreak (128.25s)
=== RUN   TestN1QLUnlabelledBreak
2021/12/25 13:22:51 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/25 13:22:51 App: TestN1QLUnlabelledBreak got un-deployed
2021/12/25 13:22:51 No eventing-con process running
2021/12/25 13:22:51 Function: TestN1QLUnlabelledBreak delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLUnlabelledBreak not found"
}
2021/12/25 13:22:52 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:22:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:22:59 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:23:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:23:04 Deploying app: TestN1QLUnlabelledBreak. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:23:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLUnlabelledBreak stored in temp store"
}
2021/12/25 13:23:10 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/25 13:23:15 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/25 13:23:20 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/25 13:23:25 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/25 13:23:25 App: TestN1QLUnlabelledBreak got deployed
2021/12/25 13:23:25 Starting bucket ops to source bucket
2021/12/25 13:23:35 Waiting for dst bucket item count to get to: 10000 curr count: 593
2021/12/25 13:23:40 Waiting for dst bucket item count to get to: 10000 curr count: 593
2021/12/25 13:23:45 Waiting for dst bucket item count to get to: 10000 curr count: 593
2021/12/25 13:23:50 Waiting for dst bucket item count to get to: 10000 curr count: 5812
2021/12/25 13:23:55 Waiting for dst bucket item count to get to: 10000 curr count: 5812
2021/12/25 13:23:55 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/25 13:23:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 13:24:00 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/25 13:24:05 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/25 13:24:10 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/25 13:24:15 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/25 13:24:15 App: TestN1QLUnlabelledBreak got un-deployed
2021/12/25 13:24:15 No eventing-con process running
2021/12/25 13:24:15 Function: TestN1QLUnlabelledBreak delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLUnlabelledBreak deleting in background"
}
2021/12/25 13:24:17 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:24:27 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 13:24:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:24:29 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:24:39 Waiting for dst bucket item count to get to: 0 curr count: 9382
2021/12/25 13:24:44 Waiting for dst bucket item count to get to: 0 curr count: 4382
2021/12/25 13:24:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLUnlabelledBreak (118.20s)
=== RUN   TestN1QLThrowStatement
2021/12/25 13:24:49 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/25 13:24:49 App: TestN1QLThrowStatement got un-deployed
2021/12/25 13:24:49 No eventing-con process running
2021/12/25 13:24:49 Function: TestN1QLThrowStatement delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLThrowStatement not found"
}
2021/12/25 13:24:51 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:24:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:24:57 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:25:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:25:02 Deploying app: TestN1QLThrowStatement. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:25:03 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLThrowStatement stored in temp store"
}
2021/12/25 13:25:08 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/25 13:25:13 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/25 13:25:18 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/25 13:25:23 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/25 13:25:23 App: TestN1QLThrowStatement got deployed
2021/12/25 13:25:23 Starting bucket ops to source bucket
2021/12/25 13:25:33 Waiting for dst bucket item count to get to: 10000 curr count: 258
2021/12/25 13:25:38 Waiting for dst bucket item count to get to: 10000 curr count: 258
2021/12/25 13:25:43 Waiting for dst bucket item count to get to: 10000 curr count: 818
2021/12/25 13:25:48 Waiting for dst bucket item count to get to: 10000 curr count: 2737
2021/12/25 13:25:53 Waiting for dst bucket item count to get to: 10000 curr count: 4782
2021/12/25 13:25:58 Waiting for dst bucket item count to get to: 10000 curr count: 6807
2021/12/25 13:26:03 Waiting for dst bucket item count to get to: 10000 curr count: 8796
2021/12/25 13:26:08 Waiting for dst bucket item count to get to: 10000 curr count: 9594
2021/12/25 13:26:08 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/25 13:26:08 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 13:26:13 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/25 13:26:18 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/25 13:26:23 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/25 13:26:28 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/25 13:26:28 App: TestN1QLThrowStatement got un-deployed
2021/12/25 13:26:28 No eventing-con process running
2021/12/25 13:26:28 Function: TestN1QLThrowStatement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLThrowStatement deleting in background"
}
2021/12/25 13:26:30 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:26:40 Waiting for dst bucket item count to get to: 0 curr count: 3660
2021/12/25 13:26:45 Waiting for dst bucket item count to get to: 0 curr count: 3660
2021/12/25 13:26:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:26:47 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:26:57 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/25 13:26:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLThrowStatement (133.24s)
=== RUN   TestN1QLNestedForLoop
2021/12/25 13:27:02 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/25 13:27:02 App: TestN1QLNestedForLoop got un-deployed
2021/12/25 13:27:02 No eventing-con process running
2021/12/25 13:27:02 Function: TestN1QLNestedForLoop delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLNestedForLoop not found"
}
2021/12/25 13:27:04 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:27:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:27:11 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:27:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:27:16 Deploying app: TestN1QLNestedForLoop. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:27:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLNestedForLoop stored in temp store"
}
2021/12/25 13:27:22 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/25 13:27:27 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/25 13:27:32 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/25 13:27:37 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/25 13:27:37 App: TestN1QLNestedForLoop got deployed
2021/12/25 13:27:37 Starting bucket ops to source bucket
2021/12/25 13:27:46 Waiting for dst bucket item count to get to: 5000 curr count: 87
2021/12/25 13:27:51 Waiting for dst bucket item count to get to: 5000 curr count: 87
2021/12/25 13:27:56 Waiting for dst bucket item count to get to: 5000 curr count: 87
2021/12/25 13:28:01 Waiting for dst bucket item count to get to: 5000 curr count: 1988
2021/12/25 13:28:06 Waiting for dst bucket item count to get to: 5000 curr count: 1988
2021/12/25 13:28:11 Waiting for dst bucket item count to get to: 5000 curr count: 4401
2021/12/25 13:28:16 Waiting for dst bucket item count to get to: 5000 curr count: 4401
2021/12/25 13:28:16 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 13:28:16 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 13:28:21 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/25 13:28:27 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/25 13:28:32 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/25 13:28:37 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/25 13:28:37 App: TestN1QLNestedForLoop got un-deployed
2021/12/25 13:28:37 No eventing-con process running
2021/12/25 13:28:37 Function: TestN1QLNestedForLoop delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLNestedForLoop deleting in background"
}
2021/12/25 13:28:38 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:28:48 Waiting for dst bucket item count to get to: 0 curr count: 4228
2021/12/25 13:28:53 Waiting for dst bucket item count to get to: 0 curr count: 1728
2021/12/25 13:28:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:28:55 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:29:05 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 13:29:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLNestedForLoop (128.21s)
=== RUN   TestN1QLAutoClose
2021/12/25 13:29:10 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/25 13:29:10 App: TestN1QLAutoClose got un-deployed
2021/12/25 13:29:10 No eventing-con process running
2021/12/25 13:29:10 Function: TestN1QLAutoClose delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLAutoClose not found"
}
2021/12/25 13:29:12 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:29:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:29:19 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:29:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:29:24 Deploying app: TestN1QLAutoClose. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:29:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAutoClose stored in temp store"
}
2021/12/25 13:29:30 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/25 13:29:35 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/25 13:29:40 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/25 13:29:45 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/25 13:29:45 App: TestN1QLAutoClose got deployed
2021/12/25 13:29:45 Starting bucket ops to source bucket
2021/12/25 13:29:51 Waiting for dst bucket item count to get to: 500 curr count: 0
2021/12/25 13:29:56 Waiting for dst bucket item count to get to: 500 curr count: 2
2021/12/25 13:30:01 Waiting for dst bucket item count to get to: 500 curr count: 6
2021/12/25 13:30:06 Waiting for dst bucket item count to get to: 500 curr count: 28
2021/12/25 13:30:11 Waiting for dst bucket item count to get to: 500 curr count: 28
2021/12/25 13:30:16 Waiting for dst bucket item count to get to: 500 curr count: 49
2021/12/25 13:30:21 Waiting for dst bucket item count to get to: 500 curr count: 49
2021/12/25 13:30:26 Waiting for dst bucket item count to get to: 500 curr count: 71
2021/12/25 13:30:31 Waiting for dst bucket item count to get to: 500 curr count: 71
2021/12/25 13:30:36 Waiting for dst bucket item count to get to: 500 curr count: 93
2021/12/25 13:30:41 Waiting for dst bucket item count to get to: 500 curr count: 93
2021/12/25 13:30:46 Waiting for dst bucket item count to get to: 500 curr count: 115
2021/12/25 13:30:51 Waiting for dst bucket item count to get to: 500 curr count: 115
2021/12/25 13:30:56 Waiting for dst bucket item count to get to: 500 curr count: 115
2021/12/25 13:31:01 Waiting for dst bucket item count to get to: 500 curr count: 135
2021/12/25 13:31:06 Waiting for dst bucket item count to get to: 500 curr count: 135
2021/12/25 13:31:11 Waiting for dst bucket item count to get to: 500 curr count: 158
2021/12/25 13:31:16 Waiting for dst bucket item count to get to: 500 curr count: 158
2021/12/25 13:31:21 Waiting for dst bucket item count to get to: 500 curr count: 179
2021/12/25 13:31:26 Waiting for dst bucket item count to get to: 500 curr count: 179
2021/12/25 13:31:31 Waiting for dst bucket item count to get to: 500 curr count: 202
2021/12/25 13:31:36 Waiting for dst bucket item count to get to: 500 curr count: 202
2021/12/25 13:31:41 Waiting for dst bucket item count to get to: 500 curr count: 224
2021/12/25 13:31:46 Waiting for dst bucket item count to get to: 500 curr count: 224
2021/12/25 13:31:51 Waiting for dst bucket item count to get to: 500 curr count: 243
2021/12/25 13:31:56 Waiting for dst bucket item count to get to: 500 curr count: 243
2021/12/25 13:32:01 Waiting for dst bucket item count to get to: 500 curr count: 264
2021/12/25 13:32:06 Waiting for dst bucket item count to get to: 500 curr count: 264
2021/12/25 13:32:11 Waiting for dst bucket item count to get to: 500 curr count: 283
2021/12/25 13:32:16 Waiting for dst bucket item count to get to: 500 curr count: 283
2021/12/25 13:32:21 Waiting for dst bucket item count to get to: 500 curr count: 305
2021/12/25 13:32:26 Waiting for dst bucket item count to get to: 500 curr count: 317
2021/12/25 13:32:31 Waiting for dst bucket item count to get to: 500 curr count: 326
2021/12/25 13:32:36 Waiting for dst bucket item count to get to: 500 curr count: 337
2021/12/25 13:32:41 Waiting for dst bucket item count to get to: 500 curr count: 346
2021/12/25 13:32:46 Waiting for dst bucket item count to get to: 500 curr count: 358
2021/12/25 13:32:51 Waiting for dst bucket item count to get to: 500 curr count: 367
2021/12/25 13:32:56 Waiting for dst bucket item count to get to: 500 curr count: 376
2021/12/25 13:33:01 Waiting for dst bucket item count to get to: 500 curr count: 388
2021/12/25 13:33:06 Waiting for dst bucket item count to get to: 500 curr count: 400
2021/12/25 13:33:11 Waiting for dst bucket item count to get to: 500 curr count: 409
2021/12/25 13:33:16 Waiting for dst bucket item count to get to: 500 curr count: 421
2021/12/25 13:33:21 Waiting for dst bucket item count to get to: 500 curr count: 430
2021/12/25 13:33:26 Waiting for dst bucket item count to get to: 500 curr count: 442
2021/12/25 13:33:31 Waiting for dst bucket item count to get to: 500 curr count: 452
2021/12/25 13:33:36 Waiting for dst bucket item count to get to: 500 curr count: 463
2021/12/25 13:33:41 Waiting for dst bucket item count to get to: 500 curr count: 475
2021/12/25 13:33:46 Waiting for dst bucket item count to get to: 500 curr count: 485
2021/12/25 13:33:51 Waiting for dst bucket item count to get to: 500 curr count: 495
2021/12/25 13:33:56 Waiting for dst bucket item count to get to: 500 curr count: 499
2021/12/25 13:33:56 src & dst bucket item count matched up. src bucket count: 500 dst bucket count: 500
2021/12/25 13:33:56 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 13:34:01 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/25 13:34:06 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/25 13:34:11 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/25 13:34:16 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/25 13:34:16 App: TestN1QLAutoClose got un-deployed
2021/12/25 13:34:16 No eventing-con process running
2021/12/25 13:34:16 Function: TestN1QLAutoClose delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAutoClose deleting in background"
}
2021/12/25 13:34:18 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:34:28 Waiting for dst bucket item count to get to: 0 curr count: 340
2021/12/25 13:34:33 Waiting for dst bucket item count to get to: 0 curr count: 90
2021/12/25 13:34:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:34:35 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:34:45 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/25 13:34:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLAutoClose (339.61s)
=== RUN   TestN1QLPosParams
2021/12/25 13:34:50 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/25 13:34:50 App: TestN1QLPosParams got un-deployed
2021/12/25 13:34:50 No eventing-con process running
2021/12/25 13:34:50 Function: TestN1QLPosParams delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLPosParams not found"
}
2021/12/25 13:34:52 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:34:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:34:58 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:35:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:35:03 Deploying app: TestN1QLPosParams. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:35:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLPosParams stored in temp store"
}
2021/12/25 13:35:09 Waiting for app: TestN1QLPosParams to get deployed
2021/12/25 13:35:14 Waiting for app: TestN1QLPosParams to get deployed
2021/12/25 13:35:20 Waiting for app: TestN1QLPosParams to get deployed
2021/12/25 13:35:25 Waiting for app: TestN1QLPosParams to get deployed
2021/12/25 13:35:25 App: TestN1QLPosParams got deployed
2021/12/25 13:35:25 Starting bucket ops to source bucket
2021/12/25 13:35:34 Waiting for dst bucket item count to get to: 5000 curr count: 425
2021/12/25 13:35:39 Waiting for dst bucket item count to get to: 5000 curr count: 1220
2021/12/25 13:35:44 Waiting for dst bucket item count to get to: 5000 curr count: 3295
2021/12/25 13:35:44 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 13:35:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 13:35:49 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/25 13:35:54 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/25 13:35:59 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/25 13:36:04 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/25 13:36:05 App: TestN1QLPosParams got un-deployed
2021/12/25 13:36:05 No eventing-con process running
2021/12/25 13:36:05 Function: TestN1QLPosParams delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLPosParams deleting in background"
}
2021/12/25 13:36:06 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:36:16 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 13:36:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:36:18 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:36:28 Waiting for dst bucket item count to get to: 0 curr count: 3548
2021/12/25 13:36:33 Waiting for dst bucket item count to get to: 0 curr count: 1048
2021/12/25 13:36:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLPosParams (108.27s)
=== RUN   TestN1QLExhaustConnPool
2021/12/25 13:36:38 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/25 13:36:38 App: TestN1QLExhaustConnPool got un-deployed
2021/12/25 13:36:38 No eventing-con process running
2021/12/25 13:36:38 Function: TestN1QLExhaustConnPool delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLExhaustConnPool not found"
}
2021/12/25 13:36:40 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:36:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:36:47 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:36:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:36:52 Deploying app: TestN1QLExhaustConnPool. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:36:53 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLExhaustConnPool stored in temp store"
}
2021/12/25 13:36:58 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/25 13:37:03 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/25 13:37:08 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/25 13:37:13 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/25 13:37:13 App: TestN1QLExhaustConnPool got deployed
2021/12/25 13:37:13 Starting bucket ops to source bucket
2021/12/25 13:37:18 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/25 13:37:23 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/25 13:37:23 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/25 13:37:23 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 13:37:28 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/25 13:37:33 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/25 13:37:38 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/25 13:37:43 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/25 13:37:43 App: TestN1QLExhaustConnPool got un-deployed
2021/12/25 13:37:43 No eventing-con process running
2021/12/25 13:37:43 Function: TestN1QLExhaustConnPool delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLExhaustConnPool deleting in background"
}
2021/12/25 13:37:45 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:37:55 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 13:37:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:37:57 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:38:07 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/25 13:38:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLExhaustConnPool (93.81s)
=== RUN   TestN1QLGraceSufficientTimeOut
2021/12/25 13:38:12 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/25 13:38:12 App: TestN1QLGraceSufficientTimeOut got un-deployed
2021/12/25 13:38:12 No eventing-con process running
2021/12/25 13:38:12 Function: TestN1QLGraceSufficientTimeOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLGraceSufficientTimeOut not found"
}
2021/12/25 13:38:14 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:38:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:38:20 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:38:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:38:25 Starting bucket ops to source bucket
2021/12/25 13:38:43 Starting bucket ops to source bucket
2021/12/25 13:39:00 Deploying app: TestN1QLGraceSufficientTimeOut. Item count src bucket: 30000 dst bucket: 9587
2021/12/25 13:39:01 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLGraceSufficientTimeOut stored in temp store"
}
2021/12/25 13:39:06 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/25 13:39:11 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/25 13:39:16 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/25 13:39:21 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/25 13:39:21 App: TestN1QLGraceSufficientTimeOut got deployed
2021/12/25 13:39:21 Starting bucket ops to source bucket
2021/12/25 13:39:26 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/25 13:39:31 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/25 13:39:36 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/25 13:39:41 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/25 13:39:46 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/25 13:39:51 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/25 13:39:56 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/25 13:40:01 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/25 13:40:06 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/25 13:40:11 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/25 13:40:16 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/25 13:40:16 src & dst bucket item count matched up. src bucket count: 30001 dst bucket count: 30001
2021/12/25 13:40:17 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 13:40:22 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/25 13:40:27 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/25 13:40:32 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/25 13:40:37 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/25 13:40:37 App: TestN1QLGraceSufficientTimeOut got un-deployed
2021/12/25 13:40:37 No eventing-con process running
2021/12/25 13:40:37 Function: TestN1QLGraceSufficientTimeOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLGraceSufficientTimeOut deleting in background"
}
2021/12/25 13:40:39 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:40:49 Waiting for dst bucket item count to get to: 0 curr count: 28121
2021/12/25 13:40:54 Waiting for dst bucket item count to get to: 0 curr count: 13121
2021/12/25 13:40:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:40:56 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:41:06 Waiting for dst bucket item count to get to: 0 curr count: 30001
2021/12/25 13:41:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLGraceSufficientTimeOut (178.69s)
=== RUN   TestN1QLQueryConsistency
2021/12/25 13:41:11 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/25 13:41:11 App: n1qlquery_consistency got un-deployed
2021/12/25 13:41:11 No eventing-con process running
2021/12/25 13:41:11 Function: n1qlquery_consistency delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: n1qlquery_consistency not found"
}
2021/12/25 13:41:12 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:41:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:41:19 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:41:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:41:24 Starting bucket ops to source bucket
2021/12/25 13:41:27 Deploying app: n1qlquery_consistency. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:41:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: n1qlquery_consistency stored in temp store"
}
2021/12/25 13:41:33 Waiting for app: n1qlquery_consistency to get deployed
2021/12/25 13:41:38 Waiting for app: n1qlquery_consistency to get deployed
2021/12/25 13:41:43 Waiting for app: n1qlquery_consistency to get deployed
2021/12/25 13:41:48 Waiting for app: n1qlquery_consistency to get deployed
2021/12/25 13:41:48 App: n1qlquery_consistency got deployed
2021/12/25 13:41:53 Waiting for dst bucket item count to get to: 5000 curr count: 4
2021/12/25 13:41:58 Waiting for dst bucket item count to get to: 5000 curr count: 4421
2021/12/25 13:42:03 Waiting for dst bucket item count to get to: 5000 curr count: 4421
2021/12/25 13:42:03 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/25 13:42:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/25 13:42:09 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/25 13:42:14 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/25 13:42:19 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/25 13:42:24 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/25 13:42:24 App: n1qlquery_consistency got un-deployed
2021/12/25 13:42:24 No eventing-con process running
2021/12/25 13:42:24 Function: n1qlquery_consistency delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: n1qlquery_consistency deleting in background"
}
2021/12/25 13:42:26 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:42:36 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/25 13:42:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:42:37 Context: Bucket flush, response code: 200 dump: 
2021/12/25 13:42:47 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/25 13:42:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLQueryConsistency (101.77s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	1548.461s

N1ql tests took 0 hours, 25 minutes and 52 seconds.

Starting server
Starting server: attempt 1

Rebalance tests

2021/12/25 13:44:22 Started rebalance
Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:56758->127.0.0.1:9000: read: connection reset by peer
Quota setup Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:56758->127.0.0.1:9000: read: connection reset by peer
=== RUN   TestDuplicateWithEventingRebIn
2021/12/25 13:44:41 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
running apps fetch error json: cannot unmarshal number into Go value of type string
2021/12/25 13:44:46 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/25 13:44:46 App: TestDuplicateWithEventingRebIn got un-deployed
2021/12/25 13:44:46 No eventing-con process running
2021/12/25 13:44:46 Function: TestDuplicateWithEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingRebIn not found"
}
2021/12/25 13:44:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:44:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 13:44:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:44:54 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:44:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 13:44:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:45:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 13:45:04 Deploying app: TestDuplicateWithEventingRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:45:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebIn stored in temp store"
}
2021/12/25 13:45:10 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/25 13:45:15 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/25 13:45:20 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/25 13:45:26 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/25 13:45:26 App: TestDuplicateWithEventingRebIn got deployed
2021/12/25 13:45:26 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 13:45:26 Starting bucket ops to source bucket
2021/12/25 13:45:40 Removing node(s): [] from the cluster
2021/12/25 13:45:45 Rebalance progress: 0
2021/12/25 13:45:50 Rebalance progress: 0
2021/12/25 13:45:55 Rebalance progress: 25
2021/12/25 13:46:00 Rebalance progress: 25
2021/12/25 13:46:05 Rebalance progress: 25
2021/12/25 13:46:10 Rebalance progress: 25
2021/12/25 13:46:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:46:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:46:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 13:46:15 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/25 13:46:15 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 13:46:15 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 13:46:20 Rebalance progress: 25
2021/12/25 13:46:25 Rebalance progress: 25
2021/12/25 13:46:30 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:46:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:46:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 13:46:30 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/25 13:46:30 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 13:46:30 Waiting for src bucket item count to get to: 200000 curr count: 85813
2021/12/25 13:46:35 Waiting for src bucket item count to get to: 200000 curr count: 102751
2021/12/25 13:46:40 Waiting for src bucket item count to get to: 200000 curr count: 102751
2021/12/25 13:46:45 Waiting for src bucket item count to get to: 200000 curr count: 119720
2021/12/25 13:46:50 Waiting for src bucket item count to get to: 200000 curr count: 119720
2021/12/25 13:46:55 Waiting for src bucket item count to get to: 200000 curr count: 136637
2021/12/25 13:47:00 Waiting for src bucket item count to get to: 200000 curr count: 136637
2021/12/25 13:47:05 Waiting for src bucket item count to get to: 200000 curr count: 153288
2021/12/25 13:47:10 Waiting for src bucket item count to get to: 200000 curr count: 153288
2021/12/25 13:47:15 Waiting for src bucket item count to get to: 200000 curr count: 169764
2021/12/25 13:47:20 Waiting for src bucket item count to get to: 200000 curr count: 169764
2021/12/25 13:47:25 Waiting for src bucket item count to get to: 200000 curr count: 186501
2021/12/25 13:47:30 Waiting for src bucket item count to get to: 200000 curr count: 186501
2021/12/25 13:47:40 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/25 13:47:45 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/25 13:47:50 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/25 13:47:55 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/25 13:48:00 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/25 13:48:05 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/25 13:48:10 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/25 13:48:15 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/25 13:48:20 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/25 13:48:25 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/25 13:48:25 Post SET ops. Expected item count: 200000 got 200001
2021/12/25 13:48:30 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/25 13:48:35 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/25 13:48:40 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/25 13:48:45 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/25 13:48:45 App: TestDuplicateWithEventingRebIn got un-deployed
2021/12/25 13:48:45 No eventing-con process running
2021/12/25 13:48:45 Function: TestDuplicateWithEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebIn deleting in background"
}
2021/12/25 13:48:47 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:48:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 13:48:57 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/25 13:48:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:48:59 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:49:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 13:49:09 Waiting for dst bucket item count to get to: 0 curr count: 200001
2021/12/25 13:49:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingRebIn (277.64s)
=== RUN   TestDuplicateWithEventingRebOut
2021/12/25 13:49:14 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 13:49:14 Removing node(s): [] from the cluster
2021/12/25 13:49:19 Rebalance progress: 100
2021/12/25 13:49:24 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/25 13:49:24 App: TestDuplicateWithEventingRebOut got un-deployed
2021/12/25 13:49:24 No eventing-con process running
2021/12/25 13:49:24 Function: TestDuplicateWithEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingRebOut not found"
}
2021/12/25 13:49:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:49:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 13:49:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:49:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:49:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 13:49:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:49:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 13:49:42 Deploying app: TestDuplicateWithEventingRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:49:43 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebOut stored in temp store"
}
2021/12/25 13:49:48 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/25 13:49:53 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/25 13:49:58 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/25 13:50:03 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/25 13:50:03 App: TestDuplicateWithEventingRebOut got deployed
2021/12/25 13:50:03 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 13:50:03 Starting bucket ops to source bucket
2021/12/25 13:50:09 Rebalance progress: 25
2021/12/25 13:50:14 Rebalance progress: 25
2021/12/25 13:50:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:50:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:50:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 13:50:19 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/25 13:50:19 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 13:50:19 Waiting for src bucket item count to get to: 200000 curr count: 9375
2021/12/25 13:50:24 Waiting for src bucket item count to get to: 200000 curr count: 26305
2021/12/25 13:50:29 Waiting for src bucket item count to get to: 200000 curr count: 26305
2021/12/25 13:50:34 Waiting for src bucket item count to get to: 200000 curr count: 43151
2021/12/25 13:50:39 Waiting for src bucket item count to get to: 200000 curr count: 43151
2021/12/25 13:50:44 Waiting for src bucket item count to get to: 200000 curr count: 60011
2021/12/25 13:50:49 Waiting for src bucket item count to get to: 200000 curr count: 60011
2021/12/25 13:50:54 Waiting for src bucket item count to get to: 200000 curr count: 60011
2021/12/25 13:50:59 Waiting for src bucket item count to get to: 200000 curr count: 76655
2021/12/25 13:51:04 Waiting for src bucket item count to get to: 200000 curr count: 76655
2021/12/25 13:51:09 Waiting for src bucket item count to get to: 200000 curr count: 93157
2021/12/25 13:51:14 Waiting for src bucket item count to get to: 200000 curr count: 93157
2021/12/25 13:51:19 Waiting for src bucket item count to get to: 200000 curr count: 109857
2021/12/25 13:51:24 Waiting for src bucket item count to get to: 200000 curr count: 109857
2021/12/25 13:51:29 Waiting for src bucket item count to get to: 200000 curr count: 126765
2021/12/25 13:51:34 Waiting for src bucket item count to get to: 200000 curr count: 126765
2021/12/25 13:51:39 Waiting for src bucket item count to get to: 200000 curr count: 143852
2021/12/25 13:51:44 Waiting for src bucket item count to get to: 200000 curr count: 143852
2021/12/25 13:51:49 Waiting for src bucket item count to get to: 200000 curr count: 160673
2021/12/25 13:51:54 Waiting for src bucket item count to get to: 200000 curr count: 160673
2021/12/25 13:51:59 Waiting for src bucket item count to get to: 200000 curr count: 177288
2021/12/25 13:52:04 Waiting for src bucket item count to get to: 200000 curr count: 193597
2021/12/25 13:52:09 Waiting for src bucket item count to get to: 200000 curr count: 193597
2021/12/25 13:52:14 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/25 13:52:14 Post SET ops. Expected item count: 200000 got 200000
2021/12/25 13:52:19 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/25 13:52:24 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/25 13:52:29 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/25 13:52:34 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/25 13:52:34 App: TestDuplicateWithEventingRebOut got un-deployed
2021/12/25 13:52:34 No eventing-con process running
2021/12/25 13:52:34 Function: TestDuplicateWithEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebOut deleting in background"
}
2021/12/25 13:52:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:52:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 13:52:46 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/25 13:52:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:52:47 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:52:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 13:52:57 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/25 13:52:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingRebOut (228.66s)
=== RUN   TestDuplicateWithEventingSwapReb
2021/12/25 13:53:07 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/25 13:53:07 App: TestDuplicateWithEventingSwapReb got un-deployed
2021/12/25 13:53:07 No eventing-con process running
2021/12/25 13:53:07 Function: TestDuplicateWithEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingSwapReb not found"
}
2021/12/25 13:53:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:53:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 13:53:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:53:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:53:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 13:53:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:53:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 13:53:26 Deploying app: TestDuplicateWithEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:53:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingSwapReb stored in temp store"
}
2021/12/25 13:53:32 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/25 13:53:37 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/25 13:53:42 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/25 13:53:47 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/25 13:53:47 App: TestDuplicateWithEventingSwapReb got deployed
2021/12/25 13:53:47 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 13:53:47 Starting bucket ops to source bucket
2021/12/25 13:53:47 Removing node(s): [] from the cluster
2021/12/25 13:53:52 Rebalance progress: 25
2021/12/25 13:53:57 Rebalance progress: 25
2021/12/25 13:54:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:54:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:54:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 13:54:03 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/25 13:54:03 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 13:54:03 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 13:54:10 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 13:54:15 Rebalance progress: 16.66666666666667
2021/12/25 13:54:20 Rebalance progress: 16.66666666666667
2021/12/25 13:54:25 Rebalance progress: 16.66666666666667
2021/12/25 13:54:30 Rebalance progress: 42.16417910447761
2021/12/25 13:54:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:54:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:54:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 13:54:35 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 13:54:35 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 13:54:40 Rebalance progress: 16.66666666666667
2021/12/25 13:54:45 Rebalance progress: 16.66666666666667
2021/12/25 13:54:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:54:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:54:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 13:54:50 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 13:54:50 Waiting for src bucket item count to get to: 200000 curr count: 79809
2021/12/25 13:54:55 Waiting for src bucket item count to get to: 200000 curr count: 95844
2021/12/25 13:55:00 Waiting for src bucket item count to get to: 200000 curr count: 95844
2021/12/25 13:55:05 Waiting for src bucket item count to get to: 200000 curr count: 112085
2021/12/25 13:55:10 Waiting for src bucket item count to get to: 200000 curr count: 112085
2021/12/25 13:55:15 Waiting for src bucket item count to get to: 200000 curr count: 128593
2021/12/25 13:55:20 Waiting for src bucket item count to get to: 200000 curr count: 128593
2021/12/25 13:55:25 Waiting for src bucket item count to get to: 200000 curr count: 145224
2021/12/25 13:55:30 Waiting for src bucket item count to get to: 200000 curr count: 145224
2021/12/25 13:55:35 Waiting for src bucket item count to get to: 200000 curr count: 161922
2021/12/25 13:55:40 Waiting for src bucket item count to get to: 200000 curr count: 161922
2021/12/25 13:55:45 Waiting for src bucket item count to get to: 200000 curr count: 177945
2021/12/25 13:55:50 Waiting for src bucket item count to get to: 200000 curr count: 177945
2021/12/25 13:55:55 Waiting for src bucket item count to get to: 200000 curr count: 194318
2021/12/25 13:56:00 Waiting for src bucket item count to get to: 200000 curr count: 194318
2021/12/25 13:56:05 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/25 13:56:05 Post SET ops. Expected item count: 200000 got 200000
2021/12/25 13:56:10 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/25 13:56:15 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/25 13:56:20 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/25 13:56:25 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/25 13:56:25 App: TestDuplicateWithEventingSwapReb got un-deployed
2021/12/25 13:56:25 No eventing-con process running
2021/12/25 13:56:25 Function: TestDuplicateWithEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingSwapReb deleting in background"
}
2021/12/25 13:56:27 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:56:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 13:56:37 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/25 13:56:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:56:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:56:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 13:56:49 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/25 13:56:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingSwapReb (231.23s)
=== RUN   TestDuplicateWithKVRebIn
2021/12/25 13:56:59 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/25 13:56:59 App: TestDuplicateWithKVRebIn got un-deployed
2021/12/25 13:56:59 No eventing-con process running
2021/12/25 13:56:59 Function: TestDuplicateWithKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVRebIn not found"
}
2021/12/25 13:57:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:57:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 13:57:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 13:57:07 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:57:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 13:57:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:57:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 13:57:17 Deploying app: TestDuplicateWithKVRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/25 13:57:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebIn stored in temp store"
}
2021/12/25 13:57:23 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/25 13:57:28 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/25 13:57:33 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/25 13:57:38 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/25 13:57:38 App: TestDuplicateWithKVRebIn got deployed
2021/12/25 13:57:38 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 13:57:38 Starting bucket ops to source bucket
2021/12/25 13:57:38 Removing node(s): [] from the cluster
2021/12/25 13:57:44 Rebalance progress: 16.66666666666667
2021/12/25 13:57:49 Rebalance progress: 16.66666666666667
2021/12/25 13:57:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:57:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:57:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 13:57:54 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 13:57:54 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 13:57:59 Rebalance progress: 16.66666666666667
2021/12/25 13:58:04 Rebalance progress: 16.66666666666667
2021/12/25 13:58:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:58:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 13:58:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 13:58:09 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 13:58:09 Waiting for src bucket item count to get to: 200000 curr count: 33355
2021/12/25 13:58:14 Waiting for src bucket item count to get to: 200000 curr count: 49731
2021/12/25 13:58:19 Waiting for src bucket item count to get to: 200000 curr count: 49731
2021/12/25 13:58:24 Waiting for src bucket item count to get to: 200000 curr count: 66092
2021/12/25 13:58:29 Waiting for src bucket item count to get to: 200000 curr count: 66092
2021/12/25 13:58:34 Waiting for src bucket item count to get to: 200000 curr count: 81810
2021/12/25 13:58:39 Waiting for src bucket item count to get to: 200000 curr count: 81810
2021/12/25 13:58:44 Waiting for src bucket item count to get to: 200000 curr count: 98281
2021/12/25 13:58:49 Waiting for src bucket item count to get to: 200000 curr count: 98281
2021/12/25 13:58:54 Waiting for src bucket item count to get to: 200000 curr count: 114523
2021/12/25 13:58:59 Waiting for src bucket item count to get to: 200000 curr count: 114523
2021/12/25 13:59:04 Waiting for src bucket item count to get to: 200000 curr count: 114523
2021/12/25 13:59:09 Waiting for src bucket item count to get to: 200000 curr count: 131063
2021/12/25 13:59:14 Waiting for src bucket item count to get to: 200000 curr count: 131063
2021/12/25 13:59:19 Waiting for src bucket item count to get to: 200000 curr count: 147725
2021/12/25 13:59:24 Waiting for src bucket item count to get to: 200000 curr count: 147725
2021/12/25 13:59:29 Waiting for src bucket item count to get to: 200000 curr count: 164392
2021/12/25 13:59:34 Waiting for src bucket item count to get to: 200000 curr count: 164392
2021/12/25 13:59:39 Waiting for src bucket item count to get to: 200000 curr count: 180419
2021/12/25 13:59:44 Waiting for src bucket item count to get to: 200000 curr count: 180419
2021/12/25 13:59:49 Waiting for src bucket item count to get to: 200000 curr count: 196869
2021/12/25 13:59:54 Waiting for src bucket item count to get to: 200000 curr count: 196869
2021/12/25 13:59:59 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/25 13:59:59 Post SET ops. Expected item count: 200000 got 200000
2021/12/25 14:00:04 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/25 14:00:09 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/25 14:00:14 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/25 14:00:19 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/25 14:00:19 App: TestDuplicateWithKVRebIn got un-deployed
2021/12/25 14:00:19 No eventing-con process running
2021/12/25 14:00:19 Function: TestDuplicateWithKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebIn deleting in background"
}
2021/12/25 14:00:21 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:00:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:00:31 Waiting for dst bucket item count to get to: 0 curr count: 157772
2021/12/25 14:00:36 Waiting for dst bucket item count to get to: 0 curr count: 157772
2021/12/25 14:00:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:00:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:00:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:00:48 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/25 14:00:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVRebIn (239.05s)
=== RUN   TestDuplicateWithKVRebOut
2021/12/25 14:00:53 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 14:00:53 Removing node(s): [] from the cluster
2021/12/25 14:00:58 Rebalance progress: 100
2021/12/25 14:01:03 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/25 14:01:03 App: TestDuplicateWithKVRebOut got un-deployed
2021/12/25 14:01:03 No eventing-con process running
2021/12/25 14:01:03 Function: TestDuplicateWithKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVRebOut not found"
}
2021/12/25 14:01:05 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:01:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:01:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:01:11 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:01:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:01:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:01:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:01:21 Deploying app: TestDuplicateWithKVRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:01:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebOut stored in temp store"
}
2021/12/25 14:01:28 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/25 14:01:33 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/25 14:01:38 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/25 14:01:43 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/25 14:01:43 App: TestDuplicateWithKVRebOut got deployed
2021/12/25 14:01:43 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 14:01:43 Starting bucket ops to source bucket
2021/12/25 14:01:48 Rebalance progress: 16.66666666666667
2021/12/25 14:01:53 Rebalance progress: 16.66666666666667
2021/12/25 14:01:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:01:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:01:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:01:58 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 14:01:58 Waiting for src bucket item count to get to: 200000 curr count: 10385
2021/12/25 14:02:03 Waiting for src bucket item count to get to: 200000 curr count: 26537
2021/12/25 14:02:08 Waiting for src bucket item count to get to: 200000 curr count: 26537
2021/12/25 14:02:13 Waiting for src bucket item count to get to: 200000 curr count: 42578
2021/12/25 14:02:18 Waiting for src bucket item count to get to: 200000 curr count: 42578
2021/12/25 14:02:23 Waiting for src bucket item count to get to: 200000 curr count: 59344
2021/12/25 14:02:28 Waiting for src bucket item count to get to: 200000 curr count: 59344
2021/12/25 14:02:33 Waiting for src bucket item count to get to: 200000 curr count: 59344
2021/12/25 14:02:38 Waiting for src bucket item count to get to: 200000 curr count: 75176
2021/12/25 14:02:43 Waiting for src bucket item count to get to: 200000 curr count: 75176
2021/12/25 14:02:48 Waiting for src bucket item count to get to: 200000 curr count: 91105
2021/12/25 14:02:53 Waiting for src bucket item count to get to: 200000 curr count: 91105
2021/12/25 14:02:58 Waiting for src bucket item count to get to: 200000 curr count: 107273
2021/12/25 14:03:03 Waiting for src bucket item count to get to: 200000 curr count: 107273
2021/12/25 14:03:08 Waiting for src bucket item count to get to: 200000 curr count: 123754
2021/12/25 14:03:13 Waiting for src bucket item count to get to: 200000 curr count: 123754
2021/12/25 14:03:18 Waiting for src bucket item count to get to: 200000 curr count: 140077
2021/12/25 14:03:23 Waiting for src bucket item count to get to: 200000 curr count: 140077
2021/12/25 14:03:28 Waiting for src bucket item count to get to: 200000 curr count: 156511
2021/12/25 14:03:33 Waiting for src bucket item count to get to: 200000 curr count: 156511
2021/12/25 14:03:38 Waiting for src bucket item count to get to: 200000 curr count: 172147
2021/12/25 14:03:43 Waiting for src bucket item count to get to: 200000 curr count: 172147
2021/12/25 14:03:48 Waiting for src bucket item count to get to: 200000 curr count: 187945
2021/12/25 14:03:53 Waiting for src bucket item count to get to: 200000 curr count: 187945
2021/12/25 14:03:58 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/25 14:03:58 Post SET ops. Expected item count: 200000 got 200000
2021/12/25 14:04:03 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/25 14:04:08 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/25 14:04:13 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/25 14:04:18 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/25 14:04:18 App: TestDuplicateWithKVRebOut got un-deployed
2021/12/25 14:04:18 No eventing-con process running
2021/12/25 14:04:18 Function: TestDuplicateWithKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebOut deleting in background"
}
2021/12/25 14:04:20 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:04:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:04:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:04:27 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:04:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:04:37 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/25 14:04:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVRebOut (229.06s)
=== RUN   TestDuplicateWithKVSwapReb
2021/12/25 14:04:47 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/25 14:04:47 App: TestDuplicateWithKVSwapReb got un-deployed
2021/12/25 14:04:47 No eventing-con process running
2021/12/25 14:04:47 Function: TestDuplicateWithKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVSwapReb not found"
}
2021/12/25 14:04:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:04:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:04:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:04:55 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:05:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:05:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:05:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:05:05 Deploying app: TestDuplicateWithKVSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:05:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVSwapReb stored in temp store"
}
2021/12/25 14:05:11 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/25 14:05:16 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/25 14:05:21 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/25 14:05:26 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/25 14:05:26 App: TestDuplicateWithKVSwapReb got deployed
2021/12/25 14:05:26 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 14:05:26 Starting bucket ops to source bucket
2021/12/25 14:05:27 Removing node(s): [] from the cluster
2021/12/25 14:05:32 Rebalance progress: 16.66666666666667
2021/12/25 14:05:37 Rebalance progress: 16.66666666666667
2021/12/25 14:05:42 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:05:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:05:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:05:42 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 14:05:42 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 14:05:42 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 14:05:47 Rebalance progress: 16.66666666666667
2021/12/25 14:05:52 Rebalance progress: 16.66666666666667
2021/12/25 14:05:57 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:05:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:05:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:05:57 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 14:05:57 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 14:06:02 Rebalance progress: 16.66666666666667
2021/12/25 14:06:07 Rebalance progress: 16.66666666666667
2021/12/25 14:06:12 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:06:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:06:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:06:12 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 14:06:12 Waiting for src bucket item count to get to: 200000 curr count: 68851
2021/12/25 14:06:17 Waiting for src bucket item count to get to: 200000 curr count: 68851
2021/12/25 14:06:22 Waiting for src bucket item count to get to: 200000 curr count: 84305
2021/12/25 14:06:27 Waiting for src bucket item count to get to: 200000 curr count: 84305
2021/12/25 14:06:32 Waiting for src bucket item count to get to: 200000 curr count: 100645
2021/12/25 14:06:37 Waiting for src bucket item count to get to: 200000 curr count: 100645
2021/12/25 14:06:42 Waiting for src bucket item count to get to: 200000 curr count: 117343
2021/12/25 14:06:47 Waiting for src bucket item count to get to: 200000 curr count: 117343
2021/12/25 14:06:52 Waiting for src bucket item count to get to: 200000 curr count: 133905
2021/12/25 14:06:57 Waiting for src bucket item count to get to: 200000 curr count: 133905
2021/12/25 14:07:02 Waiting for src bucket item count to get to: 200000 curr count: 150358
2021/12/25 14:07:07 Waiting for src bucket item count to get to: 200000 curr count: 150358
2021/12/25 14:07:12 Waiting for src bucket item count to get to: 200000 curr count: 150358
2021/12/25 14:07:17 Waiting for src bucket item count to get to: 200000 curr count: 167060
2021/12/25 14:07:22 Waiting for src bucket item count to get to: 200000 curr count: 167060
2021/12/25 14:07:27 Waiting for src bucket item count to get to: 200000 curr count: 182831
2021/12/25 14:07:32 Waiting for src bucket item count to get to: 200000 curr count: 182831
2021/12/25 14:07:37 Waiting for src bucket item count to get to: 200000 curr count: 199091
2021/12/25 14:07:42 Waiting for src bucket item count to get to: 200000 curr count: 199091
2021/12/25 14:07:47 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/25 14:07:47 Post SET ops. Expected item count: 200000 got 200000
2021/12/25 14:07:52 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/25 14:07:58 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/25 14:08:03 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/25 14:08:08 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/25 14:08:08 App: TestDuplicateWithKVSwapReb got un-deployed
2021/12/25 14:08:08 No eventing-con process running
2021/12/25 14:08:08 Function: TestDuplicateWithKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVSwapReb deleting in background"
}
2021/12/25 14:08:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:08:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:08:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:08:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:08:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:08:26 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/25 14:08:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVSwapReb (229.49s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpOneByOne
2021/12/25 14:08:36 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/25 14:08:36 App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/25 14:08:36 No eventing-con process running
2021/12/25 14:08:36 Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne not found"
}
2021/12/25 14:08:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:08:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:08:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:08:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:08:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:08:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:08:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:08:55 Deploying app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:08:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2021/12/25 14:09:01 Starting bucket ops to source bucket
2021/12/25 14:09:06 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/25 14:09:11 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/25 14:09:16 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/25 14:09:16 App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:09:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:09:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:09:16 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 14:09:16 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 14:09:16 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:09:21 Rebalance progress: 16.66666666666667
2021/12/25 14:09:26 Rebalance progress: 16.66666666666667
2021/12/25 14:09:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:09:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:09:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:09:31 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 14:09:31 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 14:09:31 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:09:37 Rebalance progress: 16.66666666666667
2021/12/25 14:09:42 Rebalance progress: 16.66666666666667
2021/12/25 14:09:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:09:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:09:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:09:47 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/25 14:09:47 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/25 14:09:52 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:09:57 Rebalance progress: 12.5
2021/12/25 14:10:02 Rebalance progress: 12.5
2021/12/25 14:10:07 Rebalance progress: 12.5
2021/12/25 14:10:12 Rebalance progress: 97.89999999999999
2021/12/25 14:10:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:10:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:10:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:10:17 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 14:10:22 Rebalance progress: 12.5
2021/12/25 14:10:27 Rebalance progress: 12.5
2021/12/25 14:10:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:10:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:10:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:10:32 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 14:10:37 Rebalance progress: 12.5
2021/12/25 14:10:42 Rebalance progress: 12.5
2021/12/25 14:10:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:10:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:10:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:10:47 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/25 14:10:52 Rebalance progress: 12.5
2021/12/25 14:10:57 Rebalance progress: 12.5
2021/12/25 14:11:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:11:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:11:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:11:07 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/25 14:11:12 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/25 14:11:17 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/25 14:11:22 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/25 14:11:22 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/25 14:11:22 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:11:22 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2021/12/25 14:11:24 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:11:29 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:11:34 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12136
2021/12/25 14:11:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12136
2021/12/25 14:11:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:11:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:11:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:11:51 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11423
2021/12/25 14:11:56 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11423
2021/12/25 14:11:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpOneByOne (209.82s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce
2021/12/25 14:12:06 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/25 14:12:06 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got un-deployed
2021/12/25 14:12:06 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:12:06 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce not found"
}
2021/12/25 14:12:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:12:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:12:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:12:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:12:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:12:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:12:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:12:24 eventingSetup.go:125: Deploying app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:12:26 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce stored in temp store"
}
2021/12/25 14:12:31 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 14:12:36 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2021/12/25 14:12:41 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2021/12/25 14:12:46 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2021/12/25 14:12:46 clusterSetup.go:354: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:12:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:12:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:12:46 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 14:12:46 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 14:12:46 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/25 14:12:46 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:12:52 Rebalance progress: 12.5
2021/12/25 14:12:57 Rebalance progress: 12.5
2021/12/25 14:13:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:13:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:13:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:13:02 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/25 14:13:07 Rebalance progress: 12.5
2021/12/25 14:13:12 Rebalance progress: 12.5
2021/12/25 14:13:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:13:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:13:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:13:22 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/25 14:13:27 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/25 14:13:32 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/25 14:13:37 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/25 14:13:37 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got un-deployed
2021/12/25 14:13:37 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:13:37 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce deleting in background"
}
2021/12/25 14:13:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:13:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:13:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4587
2021/12/25 14:13:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:13:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:13:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:14:00 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2240
2021/12/25 14:14:05 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2240
2021/12/25 14:14:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce (129.50s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings
2021/12/25 14:14:15 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/25 14:14:15 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/25 14:14:15 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:14:15 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings not found"
}
2021/12/25 14:14:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:14:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:14:22 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:14:24 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:14:29 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:14:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:14:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:14:34 eventingSetup.go:125: Deploying app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:14:35 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings stored in temp store"
}
2021/12/25 14:14:40 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 14:14:45 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2021/12/25 14:14:50 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2021/12/25 14:14:55 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2021/12/25 14:14:55 clusterSetup.go:354: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:14:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:14:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:14:55 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 14:14:56 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:15:01 Rebalance progress: 12.5
2021/12/25 14:15:06 Rebalance progress: 12.5
2021/12/25 14:15:11 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:15:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:15:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:15:11 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 14:15:11 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:15:16 Rebalance progress: 12.5
2021/12/25 14:15:21 Rebalance progress: 12.5
2021/12/25 14:15:26 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:15:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:15:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:15:26 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/25 14:15:26 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:15:31 Rebalance progress: 12.5
2021/12/25 14:15:36 Rebalance progress: 12.5
2021/12/25 14:15:41 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:15:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:15:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:15:42 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 14:15:47 Rebalance progress: 12.5
2021/12/25 14:15:52 Rebalance progress: 12.5
2021/12/25 14:15:57 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:15:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:15:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:15:57 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 14:16:02 Rebalance progress: 12.5
2021/12/25 14:16:07 Rebalance progress: 12.5
2021/12/25 14:16:12 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:16:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:16:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:16:12 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/25 14:16:17 Rebalance progress: 12.5
2021/12/25 14:16:22 Rebalance progress: 12.5
2021/12/25 14:16:27 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:16:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:16:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:16:32 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/25 14:16:37 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/25 14:16:42 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/25 14:16:47 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/25 14:16:47 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/25 14:16:47 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:16:47 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings deleting in background"
}
2021/12/25 14:16:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:16:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:16:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10670
2021/12/25 14:16:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:17:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:17:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:17:11 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7570
2021/12/25 14:17:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7570
2021/12/25 14:17:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings (190.24s)
=== RUN   TestEventingSwapRebOnUpdateBucketOp
2021/12/25 14:17:26 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/25 14:17:26 clusterSetup.go:405: App: TestEventingSwapRebOnUpdateBucketOp got un-deployed
2021/12/25 14:17:26 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:17:26 eventingSetup.go:418: Function: TestEventingSwapRebOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebOnUpdateBucketOp not found"
}
2021/12/25 14:17:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:17:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:17:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:17:34 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:17:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:17:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:17:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:17:39 eventingSetup.go:125: Deploying app: TestEventingSwapRebOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:17:40 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebOnUpdateBucketOp stored in temp store"
}
2021/12/25 14:17:45 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 14:17:50 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2021/12/25 14:17:55 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2021/12/25 14:18:00 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2021/12/25 14:18:00 clusterSetup.go:354: App: TestEventingSwapRebOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:18:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:18:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:18:00 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 14:18:01 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:18:06 Rebalance progress: 12.5
2021/12/25 14:18:11 Rebalance progress: 12.5
2021/12/25 14:18:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:18:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:18:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:18:16 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 14:18:16 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 14:18:21 Rebalance progress: 12.5
2021/12/25 14:18:26 Rebalance progress: 12.5
2021/12/25 14:18:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:18:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:18:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:18:31 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 14:18:36 Rebalance progress: 12.5
2021/12/25 14:18:41 Rebalance progress: 12.5
2021/12/25 14:18:46 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:18:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:18:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:18:51 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/25 14:18:56 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/25 14:19:02 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/25 14:19:07 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/25 14:19:07 clusterSetup.go:405: App: TestEventingSwapRebOnUpdateBucketOp got un-deployed
2021/12/25 14:19:07 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:19:07 eventingSetup.go:418: Function: TestEventingSwapRebOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebOnUpdateBucketOp deleting in background"
}
2021/12/25 14:19:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:19:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:19:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6087
2021/12/25 14:19:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:19:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:19:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:19:30 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 924
2021/12/25 14:19:35 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 924
2021/12/25 14:19:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebOnUpdateBucketOp (139.39s)
=== RUN   TestMetaRollbackWithEventingReb
2021/12/25 14:19:40 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 14:19:41 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:19:46 Rebalance progress: 100
2021/12/25 14:19:51 Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/25 14:19:51 App: TestMetaRollbackWithEventingReb got un-deployed
2021/12/25 14:19:51 No eventing-con process running
2021/12/25 14:19:51 Function: TestMetaRollbackWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaRollbackWithEventingReb not found"
}
2021/12/25 14:19:52 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:19:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:19:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:19:59 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:20:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:20:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:20:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:20:04 Deploying app: TestMetaRollbackWithEventingReb. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:20:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaRollbackWithEventingReb stored in temp store"
}
2021/12/25 14:20:10 Starting bucket ops to source bucket
2021/12/25 14:20:15 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2021/12/25 14:20:20 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2021/12/25 14:20:25 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2021/12/25 14:20:25 App: TestMetaRollbackWithEventingReb got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:20:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:20:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:20:25 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 14:20:26 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:20:31 Rebalance progress: 12.5
2021/12/25 14:20:36 Rebalance progress: 12.5
2021/12/25 14:20:41 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:20:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:20:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:20:41 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2021/12/25 14:20:41 bucketOps.go:134: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2021/12/25 14:20:46 Rebalance progress: 12.5
2021/12/25 14:20:51 Rebalance progress: 12.5
2021/12/25 14:20:56 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:20:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:20:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:21:01 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/25 14:21:06 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/25 14:21:11 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/25 14:21:16 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/25 14:21:16 clusterSetup.go:405: App: TestMetaRollbackWithEventingReb got un-deployed
2021/12/25 14:21:16 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:21:16 eventingSetup.go:418: Function: TestMetaRollbackWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaRollbackWithEventingReb deleting in background"
}
2021/12/25 14:21:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:21:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:21:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4569
2021/12/25 14:21:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:21:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:21:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:21:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaRollbackWithEventingReb (119.62s)
=== RUN   TestMetaPartialRollbackWithEventingReb
2021/12/25 14:21:40 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 14:21:40 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:21:45 Rebalance progress: 100
2021/12/25 14:21:50 Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/25 14:21:50 App: TestMetaPartialRollbackWithEventingReb got un-deployed
2021/12/25 14:21:50 No eventing-con process running
2021/12/25 14:21:50 Function: TestMetaPartialRollbackWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaPartialRollbackWithEventingReb not found"
}
2021/12/25 14:21:52 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:21:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:21:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:21:58 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:22:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:22:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:22:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:22:03 Deploying app: TestMetaPartialRollbackWithEventingReb. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:22:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaPartialRollbackWithEventingReb stored in temp store"
}
2021/12/25 14:22:10 Starting bucket ops to source bucket
2021/12/25 14:22:15 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2021/12/25 14:22:20 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2021/12/25 14:22:25 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2021/12/25 14:22:25 App: TestMetaPartialRollbackWithEventingReb got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:22:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:22:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:22:25 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 14:22:25 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:22:30 Rebalance progress: 12.5
2021/12/25 14:22:35 Rebalance progress: 12.5
2021/12/25 14:22:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:22:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:22:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:22:40 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2021/12/25 14:22:40 bucketOps.go:65: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaPartialRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2021/12/25 14:22:45 Rebalance progress: 12.5
2021/12/25 14:22:50 Rebalance progress: 12.5
2021/12/25 14:22:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:22:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:22:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:22:55 bucketOps.go:65: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaPartialRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2021/12/25 14:23:01 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/25 14:23:06 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/25 14:23:11 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/25 14:23:16 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/25 14:23:16 clusterSetup.go:405: App: TestMetaPartialRollbackWithEventingReb got un-deployed
2021/12/25 14:23:16 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:23:16 eventingSetup.go:418: Function: TestMetaPartialRollbackWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaPartialRollbackWithEventingReb deleting in background"
}
2021/12/25 14:23:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:23:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:23:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 37770
2021/12/25 14:23:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:23:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:23:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:23:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 37770
2021/12/25 14:23:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaPartialRollbackWithEventingReb (124.53s)
=== RUN   TestEventingRebMultipleHandlersOneByOne
2021/12/25 14:23:49 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/25 14:23:49 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got un-deployed
2021/12/25 14:23:49 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:23:49 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op not found"
}
2021/12/25 14:23:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:23:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:23:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:23:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:24:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:24:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:24:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:24:08 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:24:09 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:24:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:24:09 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:24:10 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update stored in temp store"
}
2021/12/25 14:24:15 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 14:24:20 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2021/12/25 14:24:25 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2021/12/25 14:24:30 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2021/12/25 14:24:30 clusterSetup.go:354: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got deployed
2021/12/25 14:24:35 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2021/12/25 14:24:40 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2021/12/25 14:24:45 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2021/12/25 14:24:45 clusterSetup.go:354: App: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:24:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:24:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:24:45 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 14:24:46 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:24:51 Rebalance progress: 12.5
2021/12/25 14:24:56 Rebalance progress: 12.5
2021/12/25 14:25:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:25:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:25:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:25:01 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 14:25:01 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:25:06 Rebalance progress: 12.5
2021/12/25 14:25:11 Rebalance progress: 12.5
2021/12/25 14:25:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:25:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:25:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:25:16 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/25 14:25:17 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:25:22 Rebalance progress: 12.5
2021/12/25 14:25:27 Rebalance progress: 12.5
2021/12/25 14:25:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:25:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:25:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:25:32 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 14:25:37 Rebalance progress: 12.5
2021/12/25 14:25:42 Rebalance progress: 12.5
2021/12/25 14:25:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:25:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:25:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:25:47 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 14:25:52 Rebalance progress: 12.5
2021/12/25 14:25:57 Rebalance progress: 12.5
2021/12/25 14:26:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:26:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:26:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:26:02 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/25 14:26:07 Rebalance progress: 12.5
2021/12/25 14:26:12 Rebalance progress: 12.5
2021/12/25 14:26:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:26:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:26:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:26:22 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/25 14:26:28 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/25 14:26:33 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/25 14:26:38 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/25 14:26:38 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got un-deployed
2021/12/25 14:26:38 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:26:38 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op deleting in background"
}
2021/12/25 14:26:42 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:26:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:26:52 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2640
2021/12/25 14:26:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2640
2021/12/25 14:26:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:26:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:27:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:27:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12224
2021/12/25 14:27:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:27:13 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/25 14:27:18 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/25 14:27:23 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/25 14:27:28 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/25 14:27:28 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update got un-deployed
2021/12/25 14:27:29 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:27:29 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update deleting in background"
}
2021/12/25 14:27:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:27:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:27:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:27:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:27:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:27:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultipleHandlersOneByOne (242.83s)
=== RUN   TestEventingRebMultipleHandlersAllAtOnce
2021/12/25 14:27:52 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/25 14:27:52 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got un-deployed
2021/12/25 14:27:52 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:27:52 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op not found"
}
2021/12/25 14:27:54 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:27:59 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:27:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:28:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:28:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:28:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:28:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:28:11 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:28:12 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:28:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:28:12 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:28:13 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update stored in temp store"
}
2021/12/25 14:28:18 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 14:28:23 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2021/12/25 14:28:28 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2021/12/25 14:28:33 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2021/12/25 14:28:33 clusterSetup.go:354: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got deployed
2021/12/25 14:28:38 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2021/12/25 14:28:43 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2021/12/25 14:28:48 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2021/12/25 14:28:48 clusterSetup.go:354: App: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:28:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:28:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:28:48 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 14:28:48 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 14:28:49 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/25 14:28:49 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:28:55 Rebalance progress: 12.5
2021/12/25 14:29:00 Rebalance progress: 12.5
2021/12/25 14:29:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:29:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:29:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:29:05 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/25 14:29:10 Rebalance progress: 12.5
2021/12/25 14:29:15 Rebalance progress: 12.5
2021/12/25 14:29:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:29:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:29:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:29:25 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/25 14:29:30 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/25 14:29:35 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/25 14:29:40 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/25 14:29:40 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got un-deployed
2021/12/25 14:29:40 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:29:40 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op deleting in background"
}
2021/12/25 14:29:43 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:29:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:29:53 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6162
2021/12/25 14:29:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6162
2021/12/25 14:29:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:30:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:30:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:30:10 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2048
2021/12/25 14:30:15 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2048
2021/12/25 14:30:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:30:20 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2021/12/25 14:30:25 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2021/12/25 14:30:30 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2021/12/25 14:30:35 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2021/12/25 14:30:35 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update got un-deployed
2021/12/25 14:30:35 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:30:36 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update deleting in background"
}
2021/12/25 14:30:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:30:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:30:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:30:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:30:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:30:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultipleHandlersAllAtOnce (187.01s)
=== RUN   TestEventingSwapRebMultipleHandlers
2021/12/25 14:30:59 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/25 14:30:59 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got un-deployed
2021/12/25 14:30:59 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:30:59 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update not found"
}
2021/12/25 14:31:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:31:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:31:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:31:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:31:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:31:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:31:18 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/25 14:31:18 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got un-deployed
2021/12/25 14:31:18 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:31:18 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op not found"
}
2021/12/25 14:31:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:31:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:31:24 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:31:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:31:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:31:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:31:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:31:31 eventingSetup.go:125: Deploying app: TestEventingSwapRebMultipleHandlersbucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:31:32 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:31:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:31:32 eventingSetup.go:125: Deploying app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:31:33 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op stored in temp store"
}
2021/12/25 14:31:38 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 14:31:43 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2021/12/25 14:31:48 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2021/12/25 14:31:53 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2021/12/25 14:31:53 clusterSetup.go:354: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got deployed
2021/12/25 14:31:58 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2021/12/25 14:32:03 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2021/12/25 14:32:08 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2021/12/25 14:32:08 clusterSetup.go:354: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:32:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:32:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:32:09 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 14:32:09 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:32:14 Rebalance progress: 12.5
2021/12/25 14:32:19 Rebalance progress: 12.5
2021/12/25 14:32:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:32:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:32:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:32:24 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 14:32:25 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 14:32:30 Rebalance progress: 12.5
2021/12/25 14:32:35 Rebalance progress: 12.5
2021/12/25 14:32:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:32:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:32:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:32:40 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 14:32:45 Rebalance progress: 12.5
2021/12/25 14:32:50 Rebalance progress: 12.5
2021/12/25 14:32:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:32:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:32:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:33:00 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/25 14:33:05 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/25 14:33:10 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/25 14:33:15 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/25 14:33:15 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got un-deployed
2021/12/25 14:33:15 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:33:15 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update deleting in background"
}
2021/12/25 14:33:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:33:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:33:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7654
2021/12/25 14:33:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:33:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:33:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:33:40 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 517
2021/12/25 14:33:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 517
2021/12/25 14:33:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:33:50 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/25 14:33:55 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/25 14:34:00 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/25 14:34:05 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/25 14:34:05 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got un-deployed
2021/12/25 14:34:05 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:34:05 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op deleting in background"
}
2021/12/25 14:34:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:34:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:34:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:34:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:34:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:34:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebMultipleHandlers (209.73s)
=== RUN   TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne
2021/12/25 14:34:29 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/25 14:34:29 clusterSetup.go:405: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/25 14:34:29 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:34:29 eventingSetup.go:418: Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne not found"
}
2021/12/25 14:34:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:34:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:34:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:34:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:34:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:34:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:34:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:34:47 eventingSetup.go:125: Deploying app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:34:48 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2021/12/25 14:34:53 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 14:34:58 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/25 14:35:03 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/25 14:35:08 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/25 14:35:08 clusterSetup.go:354: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:35:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:35:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:35:09 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 14:35:09 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:35:29 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:35:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:35:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:36:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:36:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:36:00 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:36:05 Rebalance progress: 12.5
2021/12/25 14:36:10 Rebalance progress: 12.5
2021/12/25 14:36:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:36:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:36:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:36:15 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 14:36:16 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 14:36:21 Rebalance progress: 12.5
2021/12/25 14:36:26 Rebalance progress: 12.5
2021/12/25 14:36:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:36:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:36:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:36:31 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 14:36:36 Rebalance progress: 12.5
2021/12/25 14:36:41 Rebalance progress: 12.5
2021/12/25 14:36:46 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:36:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:36:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:36:51 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/25 14:36:56 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/25 14:37:01 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/25 14:37:06 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/25 14:37:06 clusterSetup.go:405: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/25 14:37:06 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:37:06 eventingSetup.go:418: Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2021/12/25 14:37:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:37:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:37:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11232
2021/12/25 14:37:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:37:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:37:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:37:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne (185.88s)
=== RUN   TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne
2021/12/25 14:37:35 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/25 14:37:35 clusterSetup.go:405: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/25 14:37:35 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:37:35 eventingSetup.go:418: Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne not found"
}
2021/12/25 14:37:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:37:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:37:41 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:37:43 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:37:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:37:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:37:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:37:53 eventingSetup.go:125: Deploying app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:37:54 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2021/12/25 14:37:59 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 14:38:04 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/25 14:38:09 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/25 14:38:14 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/25 14:38:14 clusterSetup.go:354: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:38:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:38:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:38:14 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 14:38:15 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:38:35 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:38:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:38:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:38:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:38:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:38:45 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 14:38:46 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:39:06 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:39:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:39:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:39:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:39:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:39:16 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 14:39:17 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:39:37 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:39:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:39:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:39:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:39:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:39:47 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 14:39:48 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:40:08 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:40:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:40:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:40:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:40:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:40:18 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 14:40:18 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:40:38 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:40:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:40:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:40:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:40:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:40:49 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:40:54 Rebalance progress: 12.5
2021/12/25 14:40:59 Rebalance progress: 12.5
2021/12/25 14:41:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:41:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:41:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:41:04 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 14:41:04 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 14:41:09 Rebalance progress: 12.5
2021/12/25 14:41:14 Rebalance progress: 12.5
2021/12/25 14:41:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:41:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:41:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:41:20 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 14:41:25 Rebalance progress: 12.5
2021/12/25 14:41:30 Rebalance progress: 12.5
2021/12/25 14:41:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:41:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:41:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:41:40 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/25 14:41:45 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/25 14:41:50 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/25 14:41:55 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/25 14:41:55 clusterSetup.go:405: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/25 14:41:55 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:41:55 eventingSetup.go:418: Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2021/12/25 14:41:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:42:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:42:07 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 21520
2021/12/25 14:42:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:42:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:42:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:42:19 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 21520
2021/12/25 14:42:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne (293.89s)
=== RUN   TestEventingFailoverOnUpdateBucketOp
2021/12/25 14:42:29 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/25 14:42:29 clusterSetup.go:405: App: TestEventingFailoverOnUpdateBucketOp got un-deployed
2021/12/25 14:42:29 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:42:29 eventingSetup.go:418: Function: TestEventingFailoverOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingFailoverOnUpdateBucketOp not found"
}
2021/12/25 14:42:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:42:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:42:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:42:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:42:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:42:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:42:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:42:47 eventingSetup.go:125: Deploying app: TestEventingFailoverOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:42:48 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingFailoverOnUpdateBucketOp stored in temp store"
}
2021/12/25 14:42:53 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 14:42:58 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2021/12/25 14:43:03 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2021/12/25 14:43:08 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2021/12/25 14:43:08 clusterSetup.go:354: App: TestEventingFailoverOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:43:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:43:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:43:08 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 14:43:09 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:43:14 Rebalance progress: 12.5
2021/12/25 14:43:19 Rebalance progress: 12.5
2021/12/25 14:43:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:43:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:43:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:43:24 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:43:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:43:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:43:34 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:43:39 Rebalance progress: 12.5
2021/12/25 14:43:44 Rebalance progress: 12.5
2021/12/25 14:43:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:43:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:43:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:43:49 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 14:43:49 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 14:43:55 Rebalance progress: 12.5
2021/12/25 14:44:00 Rebalance progress: 12.5
2021/12/25 14:44:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:44:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:44:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:44:05 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 14:44:10 Rebalance progress: 12.5
2021/12/25 14:44:15 Rebalance progress: 12.5
2021/12/25 14:44:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:44:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:44:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:44:25 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/25 14:44:30 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/25 14:44:35 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/25 14:44:35 clusterSetup.go:405: App: TestEventingFailoverOnUpdateBucketOp got un-deployed
2021/12/25 14:44:35 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:44:35 eventingSetup.go:418: Function: TestEventingFailoverOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingFailoverOnUpdateBucketOp deleting in background"
}
2021/12/25 14:44:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:44:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:44:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8635
2021/12/25 14:44:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:44:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:44:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:44:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8635
2021/12/25 14:44:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingFailoverOnUpdateBucketOp (160.09s)
=== RUN   TestEventingKVRebalanceOnUpdateBucketOp
2021/12/25 14:45:09 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/25 14:45:09 clusterSetup.go:405: App: TestEventingKVRebalanceOnUpdateBucketOp got un-deployed
2021/12/25 14:45:09 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:45:09 eventingSetup.go:418: Function: TestEventingKVRebalanceOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingKVRebalanceOnUpdateBucketOp not found"
}
2021/12/25 14:45:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:45:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:45:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:45:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:45:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:45:22 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:45:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:45:27 eventingSetup.go:125: Deploying app: TestEventingKVRebalanceOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:45:28 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingKVRebalanceOnUpdateBucketOp stored in temp store"
}
2021/12/25 14:45:33 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 14:45:38 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2021/12/25 14:45:43 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2021/12/25 14:45:48 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2021/12/25 14:45:48 clusterSetup.go:354: App: TestEventingKVRebalanceOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:45:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:45:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:45:48 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing,kv to the cluster
2021/12/25 14:45:49 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:45:54 Rebalance progress: 12.5
2021/12/25 14:45:59 Rebalance progress: 12.5
2021/12/25 14:46:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:46:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:46:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:46:04 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing,kv to the cluster
2021/12/25 14:46:04 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 14:46:09 Rebalance progress: 12.5
2021/12/25 14:46:14 Rebalance progress: 12.5
2021/12/25 14:46:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:46:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:46:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:46:19 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 14:46:24 Rebalance progress: 12.5
2021/12/25 14:46:29 Rebalance progress: 12.5
2021/12/25 14:46:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:46:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:46:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:46:40 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/25 14:46:45 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/25 14:46:50 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/25 14:46:55 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/25 14:46:55 clusterSetup.go:405: App: TestEventingKVRebalanceOnUpdateBucketOp got un-deployed
2021/12/25 14:46:55 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:46:55 eventingSetup.go:418: Function: TestEventingKVRebalanceOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingKVRebalanceOnUpdateBucketOp deleting in background"
}
2021/12/25 14:46:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:47:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:47:06 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6101
2021/12/25 14:47:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:47:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:47:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:47:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6101
2021/12/25 14:47:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingKVRebalanceOnUpdateBucketOp (139.52s)
=== RUN   TestEventingRebInWithOps
2021/12/25 14:47:28 clusterSetup.go:397: Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/25 14:47:28 clusterSetup.go:405: App: TestEventingRebInWithOps got un-deployed
2021/12/25 14:47:28 eventingSetup.go:46: No eventing-con process running
2021/12/25 14:47:28 eventingSetup.go:418: Function: TestEventingRebInWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebInWithOps not found"
}
2021/12/25 14:47:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:47:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:47:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:47:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:47:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:47:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:47:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:47:47 eventingSetup.go:125: Deploying app: TestEventingRebInWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:47:48 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithOps stored in temp store"
}
2021/12/25 14:47:53 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/25 14:47:58 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/25 14:48:03 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/25 14:48:08 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/25 14:48:08 clusterSetup.go:354: App: TestEventingRebInWithOps got deployed
2021/12/25 14:48:08 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 14:48:08 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 14:48:08 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 14:48:13 Rebalance progress: 12.5
2021/12/25 14:48:18 Rebalance progress: 12.5
2021/12/25 14:48:23 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:48:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:48:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:48:23 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 14:48:28 Rebalance progress: 12.5
2021/12/25 14:48:33 Rebalance progress: 12.5
2021/12/25 14:48:38 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:48:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:48:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:48:38 Waiting for src bucket item count to get to: 200000 curr count: 32688
2021/12/25 14:48:43 Waiting for src bucket item count to get to: 200000 curr count: 48495
2021/12/25 14:48:48 Waiting for src bucket item count to get to: 200000 curr count: 48495
2021/12/25 14:48:53 Waiting for src bucket item count to get to: 200000 curr count: 64552
2021/12/25 14:48:58 Waiting for src bucket item count to get to: 200000 curr count: 64552
2021/12/25 14:49:03 Waiting for src bucket item count to get to: 200000 curr count: 80038
2021/12/25 14:49:08 Waiting for src bucket item count to get to: 200000 curr count: 80038
2021/12/25 14:49:13 Waiting for src bucket item count to get to: 200000 curr count: 96305
2021/12/25 14:49:18 Waiting for src bucket item count to get to: 200000 curr count: 96305
2021/12/25 14:49:23 Waiting for src bucket item count to get to: 200000 curr count: 96305
2021/12/25 14:49:28 Waiting for src bucket item count to get to: 200000 curr count: 112387
2021/12/25 14:49:33 Waiting for src bucket item count to get to: 200000 curr count: 112387
2021/12/25 14:49:38 Waiting for src bucket item count to get to: 200000 curr count: 128891
2021/12/25 14:49:43 Waiting for src bucket item count to get to: 200000 curr count: 128891
2021/12/25 14:49:48 Waiting for src bucket item count to get to: 200000 curr count: 145299
2021/12/25 14:49:54 Waiting for src bucket item count to get to: 200000 curr count: 145299
2021/12/25 14:49:59 Waiting for src bucket item count to get to: 200000 curr count: 161682
2021/12/25 14:50:04 Waiting for src bucket item count to get to: 200000 curr count: 161682
2021/12/25 14:50:09 Waiting for src bucket item count to get to: 200000 curr count: 177097
2021/12/25 14:50:14 Waiting for src bucket item count to get to: 200000 curr count: 177097
2021/12/25 14:50:19 Waiting for src bucket item count to get to: 200000 curr count: 193285
2021/12/25 14:50:24 Waiting for src bucket item count to get to: 200000 curr count: 193285
2021/12/25 14:50:29 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/25 14:50:29 Post SET ops. Expected item count: 200000 got 200000
2021/12/25 14:50:29 Starting bucket ops to source bucket
2021/12/25 14:54:15 Waiting for dst bucket item count to get to: 0 curr count: 19344
2021/12/25 14:54:20 Waiting for dst bucket item count to get to: 0 curr count: 895
2021/12/25 14:54:25 Waiting for dst bucket item count to get to: 0 curr count: 895
2021/12/25 14:54:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:54:25 Post DELETE ops. Expected item count: 0 got 0
2021/12/25 14:54:30 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/25 14:54:35 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/25 14:54:40 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/25 14:54:45 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/25 14:54:45 App: TestEventingRebInWithOps got un-deployed
2021/12/25 14:54:45 No eventing-con process running
2021/12/25 14:54:45 Function: TestEventingRebInWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithOps deleting in background"
}
2021/12/25 14:54:47 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:54:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:54:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:54:54 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:54:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:54:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebInWithOps (460.48s)
=== RUN   TestEventingRebOutWithOps
2021/12/25 14:55:04 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 14:55:04 Removing node(s): [] from the cluster
2021/12/25 14:55:09 Rebalance progress: 100
2021/12/25 14:55:14 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/25 14:55:14 App: TestEventingRebOutWithOps got un-deployed
2021/12/25 14:55:14 No eventing-con process running
2021/12/25 14:55:14 Function: TestEventingRebOutWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebOutWithOps not found"
}
2021/12/25 14:55:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:55:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:55:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 14:55:23 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:55:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:55:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:55:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 14:55:33 Deploying app: TestEventingRebOutWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/25 14:55:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithOps stored in temp store"
}
2021/12/25 14:55:39 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/25 14:55:44 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/25 14:55:49 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/25 14:55:54 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/25 14:55:54 App: TestEventingRebOutWithOps got deployed
2021/12/25 14:55:54 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 14:55:54 Starting bucket ops to source bucket
2021/12/25 14:55:59 Rebalance progress: 12.5
2021/12/25 14:56:04 Rebalance progress: 12.5
2021/12/25 14:56:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:56:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 14:56:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 14:56:09 Waiting for src bucket item count to get to: 200000 curr count: 8179
2021/12/25 14:56:14 Waiting for src bucket item count to get to: 200000 curr count: 24451
2021/12/25 14:56:19 Waiting for src bucket item count to get to: 200000 curr count: 24451
2021/12/25 14:56:24 Waiting for src bucket item count to get to: 200000 curr count: 40833
2021/12/25 14:56:29 Waiting for src bucket item count to get to: 200000 curr count: 40833
2021/12/25 14:56:34 Waiting for src bucket item count to get to: 200000 curr count: 57161
2021/12/25 14:56:39 Waiting for src bucket item count to get to: 200000 curr count: 57161
2021/12/25 14:56:44 Waiting for src bucket item count to get to: 200000 curr count: 57161
2021/12/25 14:56:49 Waiting for src bucket item count to get to: 200000 curr count: 73418
2021/12/25 14:56:54 Waiting for src bucket item count to get to: 200000 curr count: 73418
2021/12/25 14:56:59 Waiting for src bucket item count to get to: 200000 curr count: 88753
2021/12/25 14:57:04 Waiting for src bucket item count to get to: 200000 curr count: 88753
2021/12/25 14:57:09 Waiting for src bucket item count to get to: 200000 curr count: 105176
2021/12/25 14:57:14 Waiting for src bucket item count to get to: 200000 curr count: 105176
2021/12/25 14:57:19 Waiting for src bucket item count to get to: 200000 curr count: 121697
2021/12/25 14:57:24 Waiting for src bucket item count to get to: 200000 curr count: 121697
2021/12/25 14:57:29 Waiting for src bucket item count to get to: 200000 curr count: 138145
2021/12/25 14:57:34 Waiting for src bucket item count to get to: 200000 curr count: 154634
2021/12/25 14:57:39 Waiting for src bucket item count to get to: 200000 curr count: 154634
2021/12/25 14:57:44 Waiting for src bucket item count to get to: 200000 curr count: 171154
2021/12/25 14:57:49 Waiting for src bucket item count to get to: 200000 curr count: 171154
2021/12/25 14:57:54 Waiting for src bucket item count to get to: 200000 curr count: 186251
2021/12/25 14:57:59 Waiting for src bucket item count to get to: 200000 curr count: 186251
2021/12/25 14:58:04 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/25 14:58:04 Post SET ops. Expected item count: 200000 got 200000
2021/12/25 14:58:04 Starting bucket ops to source bucket
2021/12/25 15:01:50 Waiting for dst bucket item count to get to: 0 curr count: 9573
2021/12/25 15:01:55 Waiting for dst bucket item count to get to: 0 curr count: 9573
2021/12/25 15:01:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:01:55 Post DELETE ops. Expected item count: 0 got 0
2021/12/25 15:02:00 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/25 15:02:05 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/25 15:02:10 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/25 15:02:15 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/25 15:02:15 App: TestEventingRebOutWithOps got un-deployed
2021/12/25 15:02:15 No eventing-con process running
2021/12/25 15:02:15 Function: TestEventingRebOutWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithOps deleting in background"
}
2021/12/25 15:02:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:02:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:02:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:02:24 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:02:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:02:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebOutWithOps (449.97s)
=== RUN   TestEventingSwapRebWithOps
2021/12/25 15:02:39 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/25 15:02:39 App: TestEventingSwapRebWithOps got un-deployed
2021/12/25 15:02:39 No eventing-con process running
2021/12/25 15:02:39 Function: TestEventingSwapRebWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebWithOps not found"
}
2021/12/25 15:02:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:02:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:02:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:02:47 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:02:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:02:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:02:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:02:57 Deploying app: TestEventingSwapRebWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/25 15:02:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithOps stored in temp store"
}
2021/12/25 15:03:03 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/25 15:03:08 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/25 15:03:13 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/25 15:03:18 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/25 15:03:18 App: TestEventingSwapRebWithOps got deployed
2021/12/25 15:03:18 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 15:03:18 Starting bucket ops to source bucket
2021/12/25 15:03:19 Removing node(s): [] from the cluster
2021/12/25 15:03:24 Rebalance progress: 12.5
2021/12/25 15:03:29 Rebalance progress: 12.5
2021/12/25 15:03:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:03:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:03:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:03:34 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 15:03:35 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 15:03:40 Rebalance progress: 12.5
2021/12/25 15:03:45 Rebalance progress: 12.5
2021/12/25 15:03:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:03:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:03:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:03:50 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 15:03:55 Rebalance progress: 12.5
2021/12/25 15:04:00 Rebalance progress: 12.5
2021/12/25 15:04:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:04:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:04:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:04:05 Waiting for src bucket item count to get to: 200000 curr count: 63635
2021/12/25 15:04:10 Waiting for src bucket item count to get to: 200000 curr count: 63635
2021/12/25 15:04:15 Waiting for src bucket item count to get to: 200000 curr count: 78859
2021/12/25 15:04:20 Waiting for src bucket item count to get to: 200000 curr count: 78859
2021/12/25 15:04:25 Waiting for src bucket item count to get to: 200000 curr count: 94475
2021/12/25 15:04:30 Waiting for src bucket item count to get to: 200000 curr count: 94475
2021/12/25 15:04:35 Waiting for src bucket item count to get to: 200000 curr count: 110673
2021/12/25 15:04:40 Waiting for src bucket item count to get to: 200000 curr count: 110673
2021/12/25 15:04:45 Waiting for src bucket item count to get to: 200000 curr count: 126945
2021/12/25 15:04:50 Waiting for src bucket item count to get to: 200000 curr count: 126945
2021/12/25 15:04:55 Waiting for src bucket item count to get to: 200000 curr count: 143228
2021/12/25 15:05:00 Waiting for src bucket item count to get to: 200000 curr count: 143228
2021/12/25 15:05:05 Waiting for src bucket item count to get to: 200000 curr count: 159857
2021/12/25 15:05:10 Waiting for src bucket item count to get to: 200000 curr count: 159857
2021/12/25 15:05:15 Waiting for src bucket item count to get to: 200000 curr count: 175211
2021/12/25 15:05:20 Waiting for src bucket item count to get to: 200000 curr count: 191291
2021/12/25 15:05:25 Waiting for src bucket item count to get to: 200000 curr count: 191291
2021/12/25 15:05:31 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/25 15:05:31 Post SET ops. Expected item count: 200000 got 200000
2021/12/25 15:05:31 Starting bucket ops to source bucket
2021/12/25 15:09:17 Waiting for dst bucket item count to get to: 0 curr count: 21981
2021/12/25 15:09:22 Waiting for dst bucket item count to get to: 0 curr count: 3962
2021/12/25 15:09:27 Waiting for dst bucket item count to get to: 0 curr count: 3962
2021/12/25 15:09:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:09:27 Post DELETE ops. Expected item count: 0 got 0
2021/12/25 15:09:32 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/25 15:09:37 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/25 15:09:42 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/25 15:09:47 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/25 15:09:47 App: TestEventingSwapRebWithOps got un-deployed
2021/12/25 15:09:47 No eventing-con process running
2021/12/25 15:09:47 Function: TestEventingSwapRebWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithOps deleting in background"
}
2021/12/25 15:09:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:09:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:09:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:09:55 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:10:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:10:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebWithOps (451.80s)
=== RUN   TestKVRebInWithOps
2021/12/25 15:10:10 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/25 15:10:10 App: TestKVRebInWithOps got un-deployed
2021/12/25 15:10:10 No eventing-con process running
2021/12/25 15:10:10 Function: TestKVRebInWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebInWithOps not found"
}
2021/12/25 15:10:12 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:10:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:10:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:10:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:10:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:10:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:10:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:10:29 Deploying app: TestKVRebInWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/25 15:10:30 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithOps stored in temp store"
}
2021/12/25 15:10:35 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/25 15:10:40 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/25 15:10:45 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/25 15:10:50 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/25 15:10:50 App: TestKVRebInWithOps got deployed
2021/12/25 15:10:50 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 15:10:50 Starting bucket ops to source bucket
2021/12/25 15:10:50 Removing node(s): [] from the cluster
2021/12/25 15:10:55 Rebalance progress: 12.5
2021/12/25 15:11:00 Rebalance progress: 12.5
2021/12/25 15:11:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:11:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:11:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:11:06 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 15:11:11 Rebalance progress: 12.5
2021/12/25 15:11:16 Rebalance progress: 12.5
2021/12/25 15:11:21 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:11:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:11:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:11:21 Waiting for src bucket item count to get to: 200000 curr count: 45412
2021/12/25 15:11:26 Waiting for src bucket item count to get to: 200000 curr count: 45412
2021/12/25 15:11:31 Waiting for src bucket item count to get to: 200000 curr count: 61535
2021/12/25 15:11:36 Waiting for src bucket item count to get to: 200000 curr count: 61535
2021/12/25 15:11:41 Waiting for src bucket item count to get to: 200000 curr count: 76965
2021/12/25 15:11:46 Waiting for src bucket item count to get to: 200000 curr count: 76965
2021/12/25 15:11:51 Waiting for src bucket item count to get to: 200000 curr count: 93011
2021/12/25 15:11:56 Waiting for src bucket item count to get to: 200000 curr count: 93011
2021/12/25 15:12:01 Waiting for src bucket item count to get to: 200000 curr count: 109166
2021/12/25 15:12:06 Waiting for src bucket item count to get to: 200000 curr count: 109166
2021/12/25 15:12:11 Waiting for src bucket item count to get to: 200000 curr count: 109166
2021/12/25 15:12:16 Waiting for src bucket item count to get to: 200000 curr count: 125545
2021/12/25 15:12:21 Waiting for src bucket item count to get to: 200000 curr count: 125545
2021/12/25 15:12:26 Waiting for src bucket item count to get to: 200000 curr count: 142037
2021/12/25 15:12:31 Waiting for src bucket item count to get to: 200000 curr count: 142037
2021/12/25 15:12:36 Waiting for src bucket item count to get to: 200000 curr count: 158265
2021/12/25 15:12:41 Waiting for src bucket item count to get to: 200000 curr count: 158265
2021/12/25 15:12:46 Waiting for src bucket item count to get to: 200000 curr count: 173923
2021/12/25 15:12:51 Waiting for src bucket item count to get to: 200000 curr count: 173923
2021/12/25 15:12:56 Waiting for src bucket item count to get to: 200000 curr count: 190207
2021/12/25 15:13:01 Waiting for src bucket item count to get to: 200000 curr count: 190207
2021/12/25 15:13:06 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/25 15:13:06 Post SET ops. Expected item count: 200000 got 200000
2021/12/25 15:13:06 Starting bucket ops to source bucket
2021/12/25 15:16:52 Waiting for dst bucket item count to get to: 0 curr count: 13181
2021/12/25 15:16:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:16:52 Post DELETE ops. Expected item count: 0 got 0
2021/12/25 15:16:57 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/25 15:17:02 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/25 15:17:07 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/25 15:17:12 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/25 15:17:12 App: TestKVRebInWithOps got un-deployed
2021/12/25 15:17:12 No eventing-con process running
2021/12/25 15:17:12 Function: TestKVRebInWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithOps deleting in background"
}
2021/12/25 15:17:14 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:17:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:17:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:17:20 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:17:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:17:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebInWithOps (444.93s)
=== RUN   TestKVRebOutWithOps
2021/12/25 15:17:30 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 15:17:31 Removing node(s): [] from the cluster
2021/12/25 15:17:36 Rebalance progress: 100
2021/12/25 15:17:41 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/25 15:17:41 App: TestKVRebOutWithOps got un-deployed
2021/12/25 15:17:41 No eventing-con process running
2021/12/25 15:17:41 Function: TestKVRebOutWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebOutWithOps not found"
}
2021/12/25 15:17:43 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:17:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:17:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:17:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:17:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:17:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:17:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:17:59 Deploying app: TestKVRebOutWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/25 15:18:01 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithOps stored in temp store"
}
2021/12/25 15:18:06 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/25 15:18:11 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/25 15:18:16 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/25 15:18:21 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/25 15:18:21 App: TestKVRebOutWithOps got deployed
2021/12/25 15:18:21 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 15:18:21 Starting bucket ops to source bucket
2021/12/25 15:18:26 Rebalance progress: 12.5
2021/12/25 15:18:31 Rebalance progress: 12.5
2021/12/25 15:18:36 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:18:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:18:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:18:36 Waiting for src bucket item count to get to: 200000 curr count: 13200
2021/12/25 15:18:41 Waiting for src bucket item count to get to: 200000 curr count: 29519
2021/12/25 15:18:46 Waiting for src bucket item count to get to: 200000 curr count: 29519
2021/12/25 15:18:51 Waiting for src bucket item count to get to: 200000 curr count: 45825
2021/12/25 15:18:56 Waiting for src bucket item count to get to: 200000 curr count: 45825
2021/12/25 15:19:01 Waiting for src bucket item count to get to: 200000 curr count: 62051
2021/12/25 15:19:06 Waiting for src bucket item count to get to: 200000 curr count: 62051
2021/12/25 15:19:11 Waiting for src bucket item count to get to: 200000 curr count: 62051
2021/12/25 15:19:16 Waiting for src bucket item count to get to: 200000 curr count: 77373
2021/12/25 15:19:21 Waiting for src bucket item count to get to: 200000 curr count: 77373
2021/12/25 15:19:26 Waiting for src bucket item count to get to: 200000 curr count: 93415
2021/12/25 15:19:31 Waiting for src bucket item count to get to: 200000 curr count: 93415
2021/12/25 15:19:36 Waiting for src bucket item count to get to: 200000 curr count: 109705
2021/12/25 15:19:41 Waiting for src bucket item count to get to: 200000 curr count: 109705
2021/12/25 15:19:46 Waiting for src bucket item count to get to: 200000 curr count: 126050
2021/12/25 15:19:51 Waiting for src bucket item count to get to: 200000 curr count: 126050
2021/12/25 15:19:56 Waiting for src bucket item count to get to: 200000 curr count: 142750
2021/12/25 15:20:01 Waiting for src bucket item count to get to: 200000 curr count: 142750
2021/12/25 15:20:06 Waiting for src bucket item count to get to: 200000 curr count: 159159
2021/12/25 15:20:11 Waiting for src bucket item count to get to: 200000 curr count: 159159
2021/12/25 15:20:16 Waiting for src bucket item count to get to: 200000 curr count: 174494
2021/12/25 15:20:21 Waiting for src bucket item count to get to: 200000 curr count: 174494
2021/12/25 15:20:26 Waiting for src bucket item count to get to: 200000 curr count: 190713
2021/12/25 15:20:31 Waiting for src bucket item count to get to: 200000 curr count: 190713
2021/12/25 15:20:36 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/25 15:20:36 Post SET ops. Expected item count: 200000 got 200000
2021/12/25 15:20:36 Starting bucket ops to source bucket
2021/12/25 15:24:22 Waiting for dst bucket item count to get to: 0 curr count: 14153
2021/12/25 15:24:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:24:22 Post DELETE ops. Expected item count: 0 got 0
2021/12/25 15:24:27 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/25 15:24:32 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/25 15:24:37 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/25 15:24:42 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/25 15:24:42 App: TestKVRebOutWithOps got un-deployed
2021/12/25 15:24:42 No eventing-con process running
2021/12/25 15:24:42 Function: TestKVRebOutWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithOps deleting in background"
}
2021/12/25 15:24:44 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:24:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:24:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:24:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:24:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:24:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOutWithOps (450.55s)
=== RUN   TestKVSwapRebWithOps
2021/12/25 15:25:06 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/25 15:25:06 App: TestKVSwapRebWithOps got un-deployed
2021/12/25 15:25:06 No eventing-con process running
2021/12/25 15:25:06 Function: TestKVSwapRebWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVSwapRebWithOps not found"
}
2021/12/25 15:25:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:25:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:25:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:25:14 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:25:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:25:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:25:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:25:24 Deploying app: TestKVSwapRebWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/25 15:25:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithOps stored in temp store"
}
2021/12/25 15:25:31 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/25 15:25:36 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/25 15:25:41 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/25 15:25:46 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/25 15:25:46 App: TestKVSwapRebWithOps got deployed
2021/12/25 15:25:46 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 15:25:46 Starting bucket ops to source bucket
2021/12/25 15:25:46 Removing node(s): [] from the cluster
2021/12/25 15:25:51 Rebalance progress: 12.5
2021/12/25 15:25:56 Rebalance progress: 12.5
2021/12/25 15:26:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:26:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:26:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:26:01 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 15:26:02 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 15:26:07 Rebalance progress: 12.5
2021/12/25 15:26:12 Rebalance progress: 12.5
2021/12/25 15:26:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:26:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:26:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:26:17 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 15:26:22 Rebalance progress: 12.5
2021/12/25 15:26:27 Rebalance progress: 12.5
2021/12/25 15:26:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:26:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:26:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:26:32 Waiting for src bucket item count to get to: 200000 curr count: 67899
2021/12/25 15:26:37 Waiting for src bucket item count to get to: 200000 curr count: 67899
2021/12/25 15:26:42 Waiting for src bucket item count to get to: 200000 curr count: 82665
2021/12/25 15:26:47 Waiting for src bucket item count to get to: 200000 curr count: 82665
2021/12/25 15:26:52 Waiting for src bucket item count to get to: 200000 curr count: 99008
2021/12/25 15:26:57 Waiting for src bucket item count to get to: 200000 curr count: 99008
2021/12/25 15:27:02 Waiting for src bucket item count to get to: 200000 curr count: 115344
2021/12/25 15:27:07 Waiting for src bucket item count to get to: 200000 curr count: 115344
2021/12/25 15:27:12 Waiting for src bucket item count to get to: 200000 curr count: 131530
2021/12/25 15:27:17 Waiting for src bucket item count to get to: 200000 curr count: 131530
2021/12/25 15:27:22 Waiting for src bucket item count to get to: 200000 curr count: 148139
2021/12/25 15:27:27 Waiting for src bucket item count to get to: 200000 curr count: 148139
2021/12/25 15:27:32 Waiting for src bucket item count to get to: 200000 curr count: 164457
2021/12/25 15:27:37 Waiting for src bucket item count to get to: 200000 curr count: 164457
2021/12/25 15:27:42 Waiting for src bucket item count to get to: 200000 curr count: 179145
2021/12/25 15:27:47 Waiting for src bucket item count to get to: 200000 curr count: 179145
2021/12/25 15:27:52 Waiting for src bucket item count to get to: 200000 curr count: 179145
2021/12/25 15:27:57 Waiting for src bucket item count to get to: 200000 curr count: 195163
2021/12/25 15:28:02 Waiting for src bucket item count to get to: 200000 curr count: 195163
2021/12/25 15:28:07 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/25 15:28:07 Post SET ops. Expected item count: 200000 got 200000
2021/12/25 15:28:07 Starting bucket ops to source bucket
2021/12/25 15:31:53 Waiting for dst bucket item count to get to: 0 curr count: 15663
2021/12/25 15:31:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:31:53 Post DELETE ops. Expected item count: 0 got 0
2021/12/25 15:31:58 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/25 15:32:03 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/25 15:32:08 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/25 15:32:13 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/25 15:32:13 App: TestKVSwapRebWithOps got un-deployed
2021/12/25 15:32:13 No eventing-con process running
2021/12/25 15:32:13 Function: TestKVSwapRebWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithOps deleting in background"
}
2021/12/25 15:32:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:32:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:32:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:32:21 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:32:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:32:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebWithOps (450.61s)
=== RUN   TestEventingRebInWithTimers
2021/12/25 15:32:36 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/25 15:32:37 App: TestEventingRebInWithTimers got un-deployed
2021/12/25 15:32:37 No eventing-con process running
2021/12/25 15:32:37 Function: TestEventingRebInWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebInWithTimers not found"
}
2021/12/25 15:32:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:32:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:32:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:32:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:32:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:32:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:32:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:32:55 Deploying app: TestEventingRebInWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/25 15:32:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithTimers stored in temp store"
}
2021/12/25 15:33:01 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/25 15:33:06 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/25 15:33:11 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/25 15:33:16 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/25 15:33:16 App: TestEventingRebInWithTimers got deployed
2021/12/25 15:33:16 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 15:33:16 Starting bucket ops to source bucket
2021/12/25 15:33:17 Removing node(s): [] from the cluster
2021/12/25 15:33:22 Rebalance progress: 12.5
2021/12/25 15:33:27 Rebalance progress: 12.5
2021/12/25 15:33:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:33:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:33:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:33:32 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 15:33:37 Rebalance progress: 12.5
2021/12/25 15:33:42 Rebalance progress: 12.5
2021/12/25 15:33:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:33:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:33:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:33:47 Waiting for src bucket item count to get to: 50000 curr count: 28899
2021/12/25 15:33:52 Waiting for src bucket item count to get to: 50000 curr count: 40147
2021/12/25 15:33:57 Waiting for src bucket item count to get to: 50000 curr count: 40147
2021/12/25 15:34:07 Waiting for dst bucket item count to get to: 50000 curr count: 36913
2021/12/25 15:34:12 Waiting for dst bucket item count to get to: 50000 curr count: 36913
2021/12/25 15:34:17 Waiting for dst bucket item count to get to: 50000 curr count: 45555
2021/12/25 15:34:22 Waiting for dst bucket item count to get to: 50000 curr count: 45555
2021/12/25 15:34:22 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 15:34:22 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 15:34:22 Starting bucket ops to source bucket
2021/12/25 15:35:32 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 15:35:37 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 15:35:42 Waiting for dst bucket item count to get to: 0 curr count: 49994
2021/12/25 15:35:47 Waiting for dst bucket item count to get to: 0 curr count: 49994
2021/12/25 15:35:52 Waiting for dst bucket item count to get to: 0 curr count: 40579
2021/12/25 15:35:57 Waiting for dst bucket item count to get to: 0 curr count: 40579
2021/12/25 15:36:02 Waiting for dst bucket item count to get to: 0 curr count: 30982
2021/12/25 15:36:07 Waiting for dst bucket item count to get to: 0 curr count: 30982
2021/12/25 15:36:12 Waiting for dst bucket item count to get to: 0 curr count: 6169
2021/12/25 15:36:17 Waiting for dst bucket item count to get to: 0 curr count: 6169
2021/12/25 15:36:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:36:17 Post DELETE ops. Expected item count: 0 got 0
2021/12/25 15:36:22 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/25 15:36:27 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/25 15:36:32 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/25 15:36:37 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/25 15:36:37 App: TestEventingRebInWithTimers got un-deployed
2021/12/25 15:36:37 No eventing-con process running
2021/12/25 15:36:37 Function: TestEventingRebInWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithTimers deleting in background"
}
2021/12/25 15:36:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:36:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:36:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:36:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:36:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:36:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebInWithTimers (264.03s)
=== RUN   TestEventingRebOutWithTimers
2021/12/25 15:36:56 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 15:36:56 Removing node(s): [] from the cluster
2021/12/25 15:37:01 Rebalance progress: 100
2021/12/25 15:37:06 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/25 15:37:06 App: TestEventingRebOutWithTimers got un-deployed
2021/12/25 15:37:06 No eventing-con process running
2021/12/25 15:37:06 Function: TestEventingRebOutWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebOutWithTimers not found"
}
2021/12/25 15:37:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:37:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:37:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:37:14 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:37:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:37:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:37:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:37:24 Deploying app: TestEventingRebOutWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/25 15:37:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithTimers stored in temp store"
}
2021/12/25 15:37:30 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/25 15:37:35 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/25 15:37:40 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/25 15:37:46 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/25 15:37:46 App: TestEventingRebOutWithTimers got deployed
2021/12/25 15:37:46 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 15:37:46 Starting bucket ops to source bucket
2021/12/25 15:37:51 Rebalance progress: 12.5
2021/12/25 15:37:56 Rebalance progress: 12.5
2021/12/25 15:38:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:38:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:38:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:38:01 Waiting for src bucket item count to get to: 50000 curr count: 19137
2021/12/25 15:38:06 Waiting for src bucket item count to get to: 50000 curr count: 19137
2021/12/25 15:38:11 Waiting for src bucket item count to get to: 50000 curr count: 28505
2021/12/25 15:38:16 Waiting for src bucket item count to get to: 50000 curr count: 28505
2021/12/25 15:38:21 Waiting for src bucket item count to get to: 50000 curr count: 40903
2021/12/25 15:38:26 Waiting for src bucket item count to get to: 50000 curr count: 40903
2021/12/25 15:38:36 Waiting for dst bucket item count to get to: 50000 curr count: 41567
2021/12/25 15:38:41 Waiting for dst bucket item count to get to: 50000 curr count: 41567
2021/12/25 15:38:46 Waiting for dst bucket item count to get to: 50000 curr count: 41567
2021/12/25 15:38:51 Waiting for dst bucket item count to get to: 50000 curr count: 49615
2021/12/25 15:38:56 Waiting for dst bucket item count to get to: 50000 curr count: 49615
2021/12/25 15:38:56 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 15:38:56 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 15:38:56 Starting bucket ops to source bucket
2021/12/25 15:40:05 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 15:40:10 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 15:40:15 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 15:40:20 Waiting for dst bucket item count to get to: 0 curr count: 41594
2021/12/25 15:40:25 Waiting for dst bucket item count to get to: 0 curr count: 41594
2021/12/25 15:40:30 Waiting for dst bucket item count to get to: 0 curr count: 28694
2021/12/25 15:40:35 Waiting for dst bucket item count to get to: 0 curr count: 28694
2021/12/25 15:40:40 Waiting for dst bucket item count to get to: 0 curr count: 6458
2021/12/25 15:40:45 Waiting for dst bucket item count to get to: 0 curr count: 6458
2021/12/25 15:40:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:40:45 Post DELETE ops. Expected item count: 0 got 0
2021/12/25 15:40:50 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/25 15:40:55 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/25 15:41:00 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/25 15:41:05 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/25 15:41:06 App: TestEventingRebOutWithTimers got un-deployed
2021/12/25 15:41:06 No eventing-con process running
2021/12/25 15:41:06 Function: TestEventingRebOutWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithTimers deleting in background"
}
2021/12/25 15:41:07 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:41:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:41:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:41:14 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:41:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:41:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebOutWithTimers (268.58s)
=== RUN   TestEventingSwapRebWithTimers
2021/12/25 15:41:29 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/25 15:41:29 App: TestEventingSwapRebWithTimers got un-deployed
2021/12/25 15:41:29 No eventing-con process running
2021/12/25 15:41:29 Function: TestEventingSwapRebWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebWithTimers not found"
}
2021/12/25 15:41:31 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:41:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:41:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:41:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:41:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:41:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:41:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:41:48 Deploying app: TestEventingSwapRebWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/25 15:41:49 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithTimers stored in temp store"
}
2021/12/25 15:41:54 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/25 15:41:59 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/25 15:42:04 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/25 15:42:09 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/25 15:42:09 App: TestEventingSwapRebWithTimers got deployed
2021/12/25 15:42:09 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 15:42:09 Starting bucket ops to source bucket
2021/12/25 15:42:10 Removing node(s): [] from the cluster
2021/12/25 15:42:15 Rebalance progress: 12.5
2021/12/25 15:42:20 Rebalance progress: 12.5
2021/12/25 15:42:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:42:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:42:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:42:25 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 15:42:25 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 15:42:30 Rebalance progress: 12.5
2021/12/25 15:42:35 Rebalance progress: 12.5
2021/12/25 15:42:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:42:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:42:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:42:40 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 15:42:45 Rebalance progress: 12.5
2021/12/25 15:42:50 Rebalance progress: 12.5
2021/12/25 15:42:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:42:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:42:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:42:55 Waiting for src bucket item count to get to: 50000 curr count: 47745
2021/12/25 15:43:00 Waiting for src bucket item count to get to: 50000 curr count: 47745
2021/12/25 15:43:10 Waiting for dst bucket item count to get to: 50000 curr count: 43562
2021/12/25 15:43:15 Waiting for dst bucket item count to get to: 50000 curr count: 43562
2021/12/25 15:43:15 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 15:43:15 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 15:43:15 Starting bucket ops to source bucket
2021/12/25 15:44:24 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 15:44:29 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 15:44:34 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 15:44:39 Waiting for dst bucket item count to get to: 0 curr count: 45219
2021/12/25 15:44:44 Waiting for dst bucket item count to get to: 0 curr count: 45219
2021/12/25 15:44:49 Waiting for dst bucket item count to get to: 0 curr count: 31041
2021/12/25 15:44:54 Waiting for dst bucket item count to get to: 0 curr count: 31041
2021/12/25 15:44:59 Waiting for dst bucket item count to get to: 0 curr count: 17752
2021/12/25 15:45:04 Waiting for dst bucket item count to get to: 0 curr count: 17752
2021/12/25 15:45:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:45:04 Post DELETE ops. Expected item count: 0 got 0
2021/12/25 15:45:10 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/25 15:45:15 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/25 15:45:20 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/25 15:45:25 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/25 15:45:25 App: TestEventingSwapRebWithTimers got un-deployed
2021/12/25 15:45:25 No eventing-con process running
2021/12/25 15:45:25 Function: TestEventingSwapRebWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithTimers deleting in background"
}
2021/12/25 15:45:27 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:45:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:45:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:45:33 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:45:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:45:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebWithTimers (259.22s)
=== RUN   TestKVRebInWithTimers
2021/12/25 15:45:48 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/25 15:45:48 App: TestKVRebInWithTimers got un-deployed
2021/12/25 15:45:48 No eventing-con process running
2021/12/25 15:45:48 Function: TestKVRebInWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebInWithTimers not found"
}
2021/12/25 15:45:50 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:45:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:45:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:45:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:46:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:46:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:46:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:46:07 Deploying app: TestKVRebInWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/25 15:46:08 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithTimers stored in temp store"
}
2021/12/25 15:46:13 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/25 15:46:18 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/25 15:46:23 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/25 15:46:28 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/25 15:46:28 App: TestKVRebInWithTimers got deployed
2021/12/25 15:46:28 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 15:46:28 Starting bucket ops to source bucket
2021/12/25 15:46:28 Removing node(s): [] from the cluster
2021/12/25 15:46:33 Rebalance progress: 12.5
2021/12/25 15:46:38 Rebalance progress: 12.5
2021/12/25 15:46:43 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:46:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:46:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:46:43 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 15:46:48 Rebalance progress: 12.5
2021/12/25 15:46:53 Rebalance progress: 12.5
2021/12/25 15:46:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:46:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:46:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:46:59 Waiting for src bucket item count to get to: 50000 curr count: 28038
2021/12/25 15:47:04 Waiting for src bucket item count to get to: 50000 curr count: 37633
2021/12/25 15:47:09 Waiting for src bucket item count to get to: 50000 curr count: 37633
2021/12/25 15:47:19 Waiting for dst bucket item count to get to: 50000 curr count: 27671
2021/12/25 15:47:24 Waiting for dst bucket item count to get to: 50000 curr count: 27671
2021/12/25 15:47:29 Waiting for dst bucket item count to get to: 50000 curr count: 45393
2021/12/25 15:47:34 Waiting for dst bucket item count to get to: 50000 curr count: 45393
2021/12/25 15:47:34 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 15:47:34 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 15:47:34 Starting bucket ops to source bucket
2021/12/25 15:48:43 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 15:48:48 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 15:48:53 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 15:48:58 Waiting for dst bucket item count to get to: 0 curr count: 41487
2021/12/25 15:49:03 Waiting for dst bucket item count to get to: 0 curr count: 41487
2021/12/25 15:49:08 Waiting for dst bucket item count to get to: 0 curr count: 30409
2021/12/25 15:49:13 Waiting for dst bucket item count to get to: 0 curr count: 30409
2021/12/25 15:49:18 Waiting for dst bucket item count to get to: 0 curr count: 13847
2021/12/25 15:49:23 Waiting for dst bucket item count to get to: 0 curr count: 13847
2021/12/25 15:49:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:49:23 Post DELETE ops. Expected item count: 0 got 0
2021/12/25 15:49:28 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/25 15:49:33 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/25 15:49:38 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/25 15:49:43 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/25 15:49:43 App: TestKVRebInWithTimers got un-deployed
2021/12/25 15:49:43 No eventing-con process running
2021/12/25 15:49:43 Function: TestKVRebInWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithTimers deleting in background"
}
2021/12/25 15:49:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:49:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:49:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:49:52 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:49:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:49:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebInWithTimers (258.68s)
=== RUN   TestKVRebOutWithTimers
2021/12/25 15:50:02 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 15:50:02 Removing node(s): [] from the cluster
2021/12/25 15:50:07 Rebalance progress: 100
2021/12/25 15:50:12 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/25 15:50:12 App: TestKVRebOutWithTimers got un-deployed
2021/12/25 15:50:13 No eventing-con process running
2021/12/25 15:50:13 Function: TestKVRebOutWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebOutWithTimers not found"
}
2021/12/25 15:50:14 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:50:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:50:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:50:21 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:50:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:50:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:50:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:50:31 Deploying app: TestKVRebOutWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/25 15:50:32 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithTimers stored in temp store"
}
2021/12/25 15:50:37 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/25 15:50:42 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/25 15:50:47 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/25 15:50:52 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/25 15:50:52 App: TestKVRebOutWithTimers got deployed
2021/12/25 15:50:52 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 15:50:52 Starting bucket ops to source bucket
2021/12/25 15:50:57 Rebalance progress: 12.5
2021/12/25 15:51:02 Rebalance progress: 12.5
2021/12/25 15:51:07 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:51:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:51:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:51:07 Waiting for src bucket item count to get to: 50000 curr count: 9587
2021/12/25 15:51:12 Waiting for src bucket item count to get to: 50000 curr count: 22166
2021/12/25 15:51:17 Waiting for src bucket item count to get to: 50000 curr count: 22166
2021/12/25 15:51:22 Waiting for src bucket item count to get to: 50000 curr count: 33467
2021/12/25 15:51:27 Waiting for src bucket item count to get to: 50000 curr count: 33467
2021/12/25 15:51:32 Waiting for src bucket item count to get to: 50000 curr count: 43557
2021/12/25 15:51:37 Waiting for src bucket item count to get to: 50000 curr count: 43557
2021/12/25 15:51:42 Waiting for src bucket item count to get to: 50000 curr count: 43557
2021/12/25 15:51:52 Waiting for dst bucket item count to get to: 50000 curr count: 38619
2021/12/25 15:51:57 Waiting for dst bucket item count to get to: 50000 curr count: 38619
2021/12/25 15:51:57 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 15:51:57 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 15:51:57 Starting bucket ops to source bucket
2021/12/25 15:53:07 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 15:53:12 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 15:53:17 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 15:53:22 Waiting for dst bucket item count to get to: 0 curr count: 47442
2021/12/25 15:53:27 Waiting for dst bucket item count to get to: 0 curr count: 47442
2021/12/25 15:53:32 Waiting for dst bucket item count to get to: 0 curr count: 36294
2021/12/25 15:53:37 Waiting for dst bucket item count to get to: 0 curr count: 36294
2021/12/25 15:53:42 Waiting for dst bucket item count to get to: 0 curr count: 14972
2021/12/25 15:53:47 Waiting for dst bucket item count to get to: 0 curr count: 14972
2021/12/25 15:53:52 Waiting for dst bucket item count to get to: 0 curr count: 3011
2021/12/25 15:53:57 Waiting for dst bucket item count to get to: 0 curr count: 3011
2021/12/25 15:53:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:53:57 Post DELETE ops. Expected item count: 0 got 0
2021/12/25 15:54:02 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/25 15:54:08 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/25 15:54:13 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/25 15:54:18 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/25 15:54:18 App: TestKVRebOutWithTimers got un-deployed
2021/12/25 15:54:18 No eventing-con process running
2021/12/25 15:54:18 Function: TestKVRebOutWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithTimers deleting in background"
}
2021/12/25 15:54:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:54:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:54:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:54:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:54:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:54:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOutWithTimers (274.30s)
=== RUN   TestKVSwapRebWithTimers
2021/12/25 15:54:41 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/25 15:54:41 App: TestKVSwapRebWithTimers got un-deployed
2021/12/25 15:54:41 No eventing-con process running
2021/12/25 15:54:41 Function: TestKVSwapRebWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVSwapRebWithTimers not found"
}
2021/12/25 15:54:43 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:54:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:54:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:54:50 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:54:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:54:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:55:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:55:00 Deploying app: TestKVSwapRebWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/25 15:55:01 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithTimers stored in temp store"
}
2021/12/25 15:55:06 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/25 15:55:11 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/25 15:55:16 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/25 15:55:21 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/25 15:55:21 App: TestKVSwapRebWithTimers got deployed
2021/12/25 15:55:21 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 15:55:21 Starting bucket ops to source bucket
2021/12/25 15:55:21 Removing node(s): [] from the cluster
2021/12/25 15:55:26 Rebalance progress: 12.5
2021/12/25 15:55:31 Rebalance progress: 12.5
2021/12/25 15:55:36 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:55:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:55:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:55:36 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 15:55:37 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 15:55:42 Rebalance progress: 12.5
2021/12/25 15:55:47 Rebalance progress: 12.5
2021/12/25 15:55:52 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:55:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:55:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:55:52 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 15:55:57 Rebalance progress: 12.5
2021/12/25 15:56:02 Rebalance progress: 12.5
2021/12/25 15:56:07 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:56:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:56:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 15:56:07 Waiting for src bucket item count to get to: 50000 curr count: 44785
2021/12/25 15:56:17 Waiting for dst bucket item count to get to: 50000 curr count: 34794
2021/12/25 15:56:22 Waiting for dst bucket item count to get to: 50000 curr count: 34794
2021/12/25 15:56:22 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 15:56:22 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 15:56:22 Starting bucket ops to source bucket
2021/12/25 15:57:32 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 15:57:37 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 15:57:42 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 15:57:47 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 15:57:52 Waiting for dst bucket item count to get to: 0 curr count: 43800
2021/12/25 15:57:57 Waiting for dst bucket item count to get to: 0 curr count: 43800
2021/12/25 15:58:02 Waiting for dst bucket item count to get to: 0 curr count: 25268
2021/12/25 15:58:07 Waiting for dst bucket item count to get to: 0 curr count: 25268
2021/12/25 15:58:12 Waiting for dst bucket item count to get to: 0 curr count: 12574
2021/12/25 15:58:17 Waiting for dst bucket item count to get to: 0 curr count: 12574
2021/12/25 15:58:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:58:17 Post DELETE ops. Expected item count: 0 got 0
2021/12/25 15:58:22 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/25 15:58:27 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/25 15:58:32 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/25 15:58:37 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/25 15:58:42 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/25 15:58:42 App: TestKVSwapRebWithTimers got un-deployed
2021/12/25 15:58:42 No eventing-con process running
2021/12/25 15:58:42 Function: TestKVSwapRebWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithTimers deleting in background"
}
2021/12/25 15:58:44 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:58:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:58:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:58:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:58:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:58:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebWithTimers (264.44s)
=== RUN   TestDuplicateTimerCreationEventingRebIn
2021/12/25 15:59:06 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/25 15:59:06 App: TestDuplicateTimerCreationEventingRebIn got un-deployed
2021/12/25 15:59:06 No eventing-con process running
2021/12/25 15:59:06 Function: TestDuplicateTimerCreationEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingRebIn not found"
}
2021/12/25 15:59:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:59:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:59:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 15:59:14 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:59:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:59:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 15:59:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 15:59:24 Deploying app: TestDuplicateTimerCreationEventingRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/25 15:59:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebIn stored in temp store"
}
2021/12/25 15:59:30 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/25 15:59:35 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/25 15:59:40 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/25 15:59:46 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/25 15:59:46 App: TestDuplicateTimerCreationEventingRebIn got deployed
2021/12/25 15:59:46 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 15:59:46 Starting bucket ops to source bucket
2021/12/25 15:59:46 Removing node(s): [] from the cluster
2021/12/25 15:59:51 Rebalance progress: 12.5
2021/12/25 15:59:56 Rebalance progress: 12.5
2021/12/25 16:00:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:00:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:00:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:00:01 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 16:00:06 Rebalance progress: 12.5
2021/12/25 16:00:11 Rebalance progress: 12.5
2021/12/25 16:00:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:00:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:00:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:00:16 Waiting for src bucket item count to get to: 50000 curr count: 31353
2021/12/25 16:00:21 Waiting for src bucket item count to get to: 50000 curr count: 42589
2021/12/25 16:00:26 Waiting for src bucket item count to get to: 50000 curr count: 42589
2021/12/25 16:00:36 Waiting for dst bucket item count to get to: 50000 curr count: 30184
2021/12/25 16:00:41 Waiting for dst bucket item count to get to: 50000 curr count: 30184
2021/12/25 16:00:46 Waiting for dst bucket item count to get to: 50000 curr count: 36298
2021/12/25 16:00:51 Waiting for dst bucket item count to get to: 50000 curr count: 36298
2021/12/25 16:00:56 Waiting for dst bucket item count to get to: 50000 curr count: 49440
2021/12/25 16:01:01 Waiting for dst bucket item count to get to: 50000 curr count: 49440
2021/12/25 16:01:01 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 16:01:01 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 16:01:06 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/25 16:01:11 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/25 16:01:16 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/25 16:01:21 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/25 16:01:26 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/25 16:01:27 App: TestDuplicateTimerCreationEventingRebIn got un-deployed
2021/12/25 16:01:27 No eventing-con process running
2021/12/25 16:01:27 Function: TestDuplicateTimerCreationEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebIn deleting in background"
}
2021/12/25 16:01:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:01:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:01:38 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:01:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:01:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:01:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:01:50 Waiting for dst bucket item count to get to: 0 curr count: 10450
2021/12/25 16:01:55 Waiting for dst bucket item count to get to: 0 curr count: 10450
2021/12/25 16:01:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingRebIn (179.39s)
=== RUN   TestDuplicateTimerCreationEventingRebOut
2021/12/25 16:02:00 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 16:02:01 Removing node(s): [] from the cluster
2021/12/25 16:02:06 Rebalance progress: 100
2021/12/25 16:02:11 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/25 16:02:11 App: TestDuplicateTimerCreationEventingRebOut got un-deployed
2021/12/25 16:02:11 No eventing-con process running
2021/12/25 16:02:11 Function: TestDuplicateTimerCreationEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingRebOut not found"
}
2021/12/25 16:02:12 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:02:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:02:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:02:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:02:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:02:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:02:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:02:29 Deploying app: TestDuplicateTimerCreationEventingRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:02:30 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebOut stored in temp store"
}
2021/12/25 16:02:35 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2021/12/25 16:02:40 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2021/12/25 16:02:45 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2021/12/25 16:02:50 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2021/12/25 16:02:50 App: TestDuplicateTimerCreationEventingRebOut got deployed
2021/12/25 16:02:50 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 16:02:50 Starting bucket ops to source bucket
2021/12/25 16:02:55 Rebalance progress: 12.5
2021/12/25 16:03:00 Rebalance progress: 12.5
2021/12/25 16:03:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:03:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:03:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:03:05 Waiting for src bucket item count to get to: 50000 curr count: 12112
2021/12/25 16:03:10 Waiting for src bucket item count to get to: 50000 curr count: 26294
2021/12/25 16:03:15 Waiting for src bucket item count to get to: 50000 curr count: 26294
2021/12/25 16:03:20 Waiting for src bucket item count to get to: 50000 curr count: 37619
2021/12/25 16:03:25 Waiting for src bucket item count to get to: 50000 curr count: 37619
2021/12/25 16:03:30 Waiting for src bucket item count to get to: 50000 curr count: 47580
2021/12/25 16:03:35 Waiting for src bucket item count to get to: 50000 curr count: 47580
2021/12/25 16:03:40 Waiting for src bucket item count to get to: 50000 curr count: 47580
2021/12/25 16:03:50 Waiting for dst bucket item count to get to: 50000 curr count: 36360
2021/12/25 16:03:55 Waiting for dst bucket item count to get to: 50000 curr count: 36360
2021/12/25 16:04:00 Waiting for dst bucket item count to get to: 50000 curr count: 47790
2021/12/25 16:04:05 Waiting for dst bucket item count to get to: 50000 curr count: 47790
2021/12/25 16:04:05 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 16:04:05 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 16:04:11 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/25 16:04:16 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/25 16:04:21 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/25 16:04:26 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/25 16:04:31 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/25 16:04:31 App: TestDuplicateTimerCreationEventingRebOut got un-deployed
2021/12/25 16:04:31 No eventing-con process running
2021/12/25 16:04:31 Function: TestDuplicateTimerCreationEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebOut deleting in background"
}
2021/12/25 16:04:33 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:04:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:04:43 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:04:48 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:04:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:04:50 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:04:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:04:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingRebOut (179.50s)
=== RUN   TestDuplicateTimerCreationEventingSwapReb
2021/12/25 16:05:05 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/25 16:05:05 App: TestDuplicateTimerCreationEventingSwapReb got un-deployed
2021/12/25 16:05:05 No eventing-con process running
2021/12/25 16:05:05 Function: TestDuplicateTimerCreationEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingSwapReb not found"
}
2021/12/25 16:05:06 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:05:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:05:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:05:13 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:05:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:05:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:05:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:05:23 Deploying app: TestDuplicateTimerCreationEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:05:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingSwapReb stored in temp store"
}
2021/12/25 16:05:29 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/25 16:05:34 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/25 16:05:39 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/25 16:05:44 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/25 16:05:44 App: TestDuplicateTimerCreationEventingSwapReb got deployed
2021/12/25 16:05:44 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 16:05:44 Starting bucket ops to source bucket
2021/12/25 16:05:45 Removing node(s): [] from the cluster
2021/12/25 16:05:50 Rebalance progress: 12.5
2021/12/25 16:05:55 Rebalance progress: 12.5
2021/12/25 16:06:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:06:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:06:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:06:00 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 16:06:00 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 16:06:05 Rebalance progress: 12.5
2021/12/25 16:06:10 Rebalance progress: 12.5
2021/12/25 16:06:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:06:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:06:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:06:16 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 16:06:21 Rebalance progress: 12.5
2021/12/25 16:06:26 Rebalance progress: 12.5
2021/12/25 16:06:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:06:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:06:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:06:31 Waiting for src bucket item count to get to: 50000 curr count: 43164
2021/12/25 16:06:41 Waiting for dst bucket item count to get to: 50000 curr count: 27869
2021/12/25 16:06:46 Waiting for dst bucket item count to get to: 50000 curr count: 36411
2021/12/25 16:06:51 Waiting for dst bucket item count to get to: 50000 curr count: 36411
2021/12/25 16:06:56 Waiting for dst bucket item count to get to: 50000 curr count: 49657
2021/12/25 16:07:01 Waiting for dst bucket item count to get to: 50000 curr count: 49657
2021/12/25 16:07:01 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 16:07:01 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 16:07:06 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/25 16:07:11 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/25 16:07:16 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/25 16:07:21 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/25 16:07:26 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/25 16:07:26 App: TestDuplicateTimerCreationEventingSwapReb got un-deployed
2021/12/25 16:07:26 No eventing-con process running
2021/12/25 16:07:26 Function: TestDuplicateTimerCreationEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingSwapReb deleting in background"
}
2021/12/25 16:07:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:07:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:07:38 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:07:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:07:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:07:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:07:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingSwapReb (170.08s)
=== RUN   TestDuplicateTimerCreationKVRebIn
2021/12/25 16:07:55 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/25 16:07:55 App: TestDuplicateTimerCreationKVRebIn got un-deployed
2021/12/25 16:07:55 No eventing-con process running
2021/12/25 16:07:55 Function: TestDuplicateTimerCreationKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVRebIn not found"
}
2021/12/25 16:07:56 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:08:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:08:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:08:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:08:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:08:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:08:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:08:13 Deploying app: TestDuplicateTimerCreationKVRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:08:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebIn stored in temp store"
}
2021/12/25 16:08:19 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/25 16:08:24 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/25 16:08:29 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/25 16:08:34 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/25 16:08:34 App: TestDuplicateTimerCreationKVRebIn got deployed
2021/12/25 16:08:34 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 16:08:34 Starting bucket ops to source bucket
2021/12/25 16:08:35 Removing node(s): [] from the cluster
2021/12/25 16:08:40 Rebalance progress: 12.5
2021/12/25 16:08:45 Rebalance progress: 12.5
2021/12/25 16:08:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:08:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:08:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:08:50 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 16:08:55 Rebalance progress: 12.5
2021/12/25 16:09:00 Rebalance progress: 12.5
2021/12/25 16:09:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:09:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:09:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:09:06 Waiting for src bucket item count to get to: 50000 curr count: 31231
2021/12/25 16:09:11 Waiting for src bucket item count to get to: 50000 curr count: 31231
2021/12/25 16:09:16 Waiting for src bucket item count to get to: 50000 curr count: 41895
2021/12/25 16:09:21 Waiting for src bucket item count to get to: 50000 curr count: 41895
2021/12/25 16:09:31 Waiting for dst bucket item count to get to: 50000 curr count: 32964
2021/12/25 16:09:36 Waiting for dst bucket item count to get to: 50000 curr count: 39764
2021/12/25 16:09:41 Waiting for dst bucket item count to get to: 50000 curr count: 39764
2021/12/25 16:09:41 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 16:09:41 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 16:09:46 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/25 16:09:51 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/25 16:09:56 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/25 16:10:01 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/25 16:10:06 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/25 16:10:06 App: TestDuplicateTimerCreationKVRebIn got un-deployed
2021/12/25 16:10:06 No eventing-con process running
2021/12/25 16:10:06 Function: TestDuplicateTimerCreationKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebIn deleting in background"
}
2021/12/25 16:10:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:10:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:10:18 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:10:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:10:20 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:10:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:10:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVRebIn (160.02s)
=== RUN   TestDuplicateTimerCreationKVRebOut
2021/12/25 16:10:30 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 16:10:30 Removing node(s): [] from the cluster
2021/12/25 16:10:35 Rebalance progress: 100
2021/12/25 16:10:40 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/25 16:10:40 App: TestDuplicateTimerCreationKVRebOut got un-deployed
2021/12/25 16:10:40 No eventing-con process running
2021/12/25 16:10:40 Function: TestDuplicateTimerCreationKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVRebOut not found"
}
2021/12/25 16:10:42 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:10:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:10:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:10:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:10:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:10:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:10:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:10:58 Deploying app: TestDuplicateTimerCreationKVRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:11:00 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebOut stored in temp store"
}
2021/12/25 16:11:05 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/25 16:11:10 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/25 16:11:15 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/25 16:11:20 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/25 16:11:20 App: TestDuplicateTimerCreationKVRebOut got deployed
2021/12/25 16:11:20 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 16:11:20 Starting bucket ops to source bucket
2021/12/25 16:11:25 Rebalance progress: 12.5
2021/12/25 16:11:30 Rebalance progress: 12.5
2021/12/25 16:11:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:11:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:11:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:11:35 Waiting for src bucket item count to get to: 50000 curr count: 12533
2021/12/25 16:11:40 Waiting for src bucket item count to get to: 50000 curr count: 12533
2021/12/25 16:11:45 Waiting for src bucket item count to get to: 50000 curr count: 26318
2021/12/25 16:11:50 Waiting for src bucket item count to get to: 50000 curr count: 38866
2021/12/25 16:11:55 Waiting for src bucket item count to get to: 50000 curr count: 38866
2021/12/25 16:12:00 Waiting for src bucket item count to get to: 50000 curr count: 49095
2021/12/25 16:12:05 Waiting for src bucket item count to get to: 50000 curr count: 49095
2021/12/25 16:12:10 Waiting for src bucket item count to get to: 50000 curr count: 49095
2021/12/25 16:12:20 Waiting for dst bucket item count to get to: 50000 curr count: 34799
2021/12/25 16:12:25 Waiting for dst bucket item count to get to: 50000 curr count: 34799
2021/12/25 16:12:30 Waiting for dst bucket item count to get to: 50000 curr count: 44305
2021/12/25 16:12:35 Waiting for dst bucket item count to get to: 50000 curr count: 44305
2021/12/25 16:12:35 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 16:12:35 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 16:12:40 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/25 16:12:45 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/25 16:12:50 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/25 16:12:55 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/25 16:13:00 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/25 16:13:00 App: TestDuplicateTimerCreationKVRebOut got un-deployed
2021/12/25 16:13:00 No eventing-con process running
2021/12/25 16:13:00 Function: TestDuplicateTimerCreationKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebOut deleting in background"
}
2021/12/25 16:13:02 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:13:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:13:12 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:13:17 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:13:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:13:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:13:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:13:29 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:13:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVRebOut (184.30s)
=== RUN   TestDuplicateTimerCreationKVSwapReb
2021/12/25 16:13:39 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/25 16:13:39 App: TestDuplicateTimerCreationKVSwapReb got un-deployed
2021/12/25 16:13:39 No eventing-con process running
2021/12/25 16:13:39 Function: TestDuplicateTimerCreationKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVSwapReb not found"
}
2021/12/25 16:13:41 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:13:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:13:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:13:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:13:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:13:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:13:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:13:58 Deploying app: TestDuplicateTimerCreationKVSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:13:59 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVSwapReb stored in temp store"
}
2021/12/25 16:14:04 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/25 16:14:09 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/25 16:14:14 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/25 16:14:19 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/25 16:14:19 App: TestDuplicateTimerCreationKVSwapReb got deployed
2021/12/25 16:14:19 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 16:14:19 Starting bucket ops to source bucket
2021/12/25 16:14:19 Removing node(s): [] from the cluster
2021/12/25 16:14:24 Rebalance progress: 12.5
2021/12/25 16:14:29 Rebalance progress: 12.5
2021/12/25 16:14:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:14:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:14:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:14:34 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 16:14:35 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 16:14:40 Rebalance progress: 12.5
2021/12/25 16:14:45 Rebalance progress: 12.5
2021/12/25 16:14:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:14:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:14:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:14:50 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 16:14:55 Rebalance progress: 12.5
2021/12/25 16:15:00 Rebalance progress: 12.5
2021/12/25 16:15:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:15:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:15:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:15:05 Waiting for src bucket item count to get to: 50000 curr count: 47028
2021/12/25 16:15:10 Waiting for src bucket item count to get to: 50000 curr count: 47028
2021/12/25 16:15:20 Waiting for dst bucket item count to get to: 50000 curr count: 37372
2021/12/25 16:15:25 Waiting for dst bucket item count to get to: 50000 curr count: 37372
2021/12/25 16:15:30 Waiting for dst bucket item count to get to: 50000 curr count: 44306
2021/12/25 16:15:35 Waiting for dst bucket item count to get to: 50000 curr count: 44306
2021/12/25 16:15:35 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 16:15:35 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 16:15:40 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/25 16:15:45 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/25 16:15:51 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/25 16:15:56 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/25 16:16:01 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/25 16:16:01 App: TestDuplicateTimerCreationKVSwapReb got un-deployed
2021/12/25 16:16:01 No eventing-con process running
2021/12/25 16:16:01 Function: TestDuplicateTimerCreationKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVSwapReb deleting in background"
}
2021/12/25 16:16:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:16:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:16:13 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:16:18 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:16:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:16:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:16:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:16:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVSwapReb (175.33s)
=== RUN   TestDuplicateTimerFiringEventingRebIn
2021/12/25 16:16:34 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/25 16:16:34 App: TestDuplicateTimerFiringEventingRebIn got un-deployed
2021/12/25 16:16:34 No eventing-con process running
2021/12/25 16:16:34 Function: TestDuplicateTimerFiringEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingRebIn not found"
}
2021/12/25 16:16:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:16:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:16:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:16:43 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:16:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:16:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:16:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:16:53 Deploying app: TestDuplicateTimerFiringEventingRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:16:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebIn stored in temp store"
}
2021/12/25 16:16:59 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/25 16:17:04 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/25 16:17:09 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/25 16:17:14 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/25 16:17:14 App: TestDuplicateTimerFiringEventingRebIn got deployed
2021/12/25 16:17:14 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 16:17:14 Starting bucket ops to source bucket
2021/12/25 16:17:14 Removing node(s): [] from the cluster
2021/12/25 16:17:19 Rebalance progress: 12.5
2021/12/25 16:17:24 Rebalance progress: 12.5
2021/12/25 16:17:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:17:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:17:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:17:30 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 16:17:35 Rebalance progress: 12.5
2021/12/25 16:17:40 Rebalance progress: 12.5
2021/12/25 16:17:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:17:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:17:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:17:45 Waiting for src bucket item count to get to: 50000 curr count: 29651
2021/12/25 16:17:50 Waiting for src bucket item count to get to: 50000 curr count: 29651
2021/12/25 16:17:55 Waiting for src bucket item count to get to: 50000 curr count: 41005
2021/12/25 16:18:00 Waiting for src bucket item count to get to: 50000 curr count: 41005
2021/12/25 16:18:10 Waiting for dst bucket item count to get to: 50000 curr count: 37663
2021/12/25 16:18:15 Waiting for dst bucket item count to get to: 50000 curr count: 37663
2021/12/25 16:18:20 Waiting for dst bucket item count to get to: 50000 curr count: 45760
2021/12/25 16:18:25 Waiting for dst bucket item count to get to: 50000 curr count: 45760
2021/12/25 16:18:25 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 16:18:25 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 16:18:30 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/25 16:18:35 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/25 16:18:40 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/25 16:18:45 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/25 16:18:50 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/25 16:18:50 App: TestDuplicateTimerFiringEventingRebIn got un-deployed
2021/12/25 16:18:50 No eventing-con process running
2021/12/25 16:18:50 Function: TestDuplicateTimerFiringEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebIn deleting in background"
}
2021/12/25 16:18:52 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:18:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:19:02 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:19:07 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:19:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:19:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:19:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:19:19 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:19:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingRebIn (174.40s)
=== RUN   TestDuplicateTimerFiringEventingRebOut
2021/12/25 16:19:24 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 16:19:24 Removing node(s): [] from the cluster
2021/12/25 16:19:29 Rebalance progress: 100
2021/12/25 16:19:34 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/25 16:19:34 App: TestDuplicateTimerFiringEventingRebOut got un-deployed
2021/12/25 16:19:34 No eventing-con process running
2021/12/25 16:19:34 Function: TestDuplicateTimerFiringEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingRebOut not found"
}
2021/12/25 16:19:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:19:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:19:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:19:43 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:19:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:19:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:19:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:19:53 Deploying app: TestDuplicateTimerFiringEventingRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:19:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebOut stored in temp store"
}
2021/12/25 16:19:59 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/25 16:20:04 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/25 16:20:09 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/25 16:20:14 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/25 16:20:14 App: TestDuplicateTimerFiringEventingRebOut got deployed
2021/12/25 16:20:14 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 16:20:14 Starting bucket ops to source bucket
2021/12/25 16:20:19 Rebalance progress: 12.5
2021/12/25 16:20:24 Rebalance progress: 12.5
2021/12/25 16:20:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:20:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:20:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:20:29 Waiting for src bucket item count to get to: 50000 curr count: 6788
2021/12/25 16:20:34 Waiting for src bucket item count to get to: 50000 curr count: 19920
2021/12/25 16:20:39 Waiting for src bucket item count to get to: 50000 curr count: 19920
2021/12/25 16:20:44 Waiting for src bucket item count to get to: 50000 curr count: 30638
2021/12/25 16:20:49 Waiting for src bucket item count to get to: 50000 curr count: 30638
2021/12/25 16:20:54 Waiting for src bucket item count to get to: 50000 curr count: 42069
2021/12/25 16:20:59 Waiting for src bucket item count to get to: 50000 curr count: 42069
2021/12/25 16:21:04 Waiting for src bucket item count to get to: 50000 curr count: 42069
2021/12/25 16:21:14 Waiting for dst bucket item count to get to: 50000 curr count: 41231
2021/12/25 16:21:19 Waiting for dst bucket item count to get to: 50000 curr count: 41231
2021/12/25 16:21:24 Waiting for dst bucket item count to get to: 50000 curr count: 49826
2021/12/25 16:21:29 Waiting for dst bucket item count to get to: 50000 curr count: 49826
2021/12/25 16:21:29 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 16:21:29 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 16:21:34 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/25 16:21:39 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/25 16:21:44 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/25 16:21:50 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/25 16:21:55 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/25 16:21:55 App: TestDuplicateTimerFiringEventingRebOut got un-deployed
2021/12/25 16:21:55 No eventing-con process running
2021/12/25 16:21:55 Function: TestDuplicateTimerFiringEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebOut deleting in background"
}
2021/12/25 16:21:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:22:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:22:07 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:22:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:22:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:22:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:22:18 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:22:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingRebOut (179.52s)
=== RUN   TestDuplicateTimerFiringEventingSwapReb
2021/12/25 16:22:28 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/25 16:22:28 App: TestDuplicateTimerFiringEventingSwapReb got un-deployed
2021/12/25 16:22:28 No eventing-con process running
2021/12/25 16:22:28 Function: TestDuplicateTimerFiringEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingSwapReb not found"
}
2021/12/25 16:22:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:22:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:22:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:22:37 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:22:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:22:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:22:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:22:47 Deploying app: TestDuplicateTimerFiringEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:22:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingSwapReb stored in temp store"
}
2021/12/25 16:22:53 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/25 16:22:58 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/25 16:23:03 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/25 16:23:08 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/25 16:23:08 App: TestDuplicateTimerFiringEventingSwapReb got deployed
2021/12/25 16:23:08 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 16:23:08 Starting bucket ops to source bucket
2021/12/25 16:23:09 Removing node(s): [] from the cluster
2021/12/25 16:23:14 Rebalance progress: 12.5
2021/12/25 16:23:19 Rebalance progress: 12.5
2021/12/25 16:23:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:23:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:23:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:23:24 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 16:23:24 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 16:23:29 Rebalance progress: 12.5
2021/12/25 16:23:34 Rebalance progress: 12.5
2021/12/25 16:23:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:23:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:23:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:23:39 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 16:23:45 Rebalance progress: 12.5
2021/12/25 16:23:50 Rebalance progress: 12.5
2021/12/25 16:23:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:23:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:23:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:23:55 Waiting for src bucket item count to get to: 50000 curr count: 48753
2021/12/25 16:24:00 Waiting for src bucket item count to get to: 50000 curr count: 48753
2021/12/25 16:24:10 Waiting for dst bucket item count to get to: 50000 curr count: 41385
2021/12/25 16:24:15 Waiting for dst bucket item count to get to: 50000 curr count: 41385
2021/12/25 16:24:20 Waiting for dst bucket item count to get to: 50000 curr count: 48836
2021/12/25 16:24:25 Waiting for dst bucket item count to get to: 50000 curr count: 48836
2021/12/25 16:24:25 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 16:24:25 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 16:24:30 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/25 16:24:35 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/25 16:24:40 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/25 16:24:45 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/25 16:24:50 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/25 16:24:50 App: TestDuplicateTimerFiringEventingSwapReb got un-deployed
2021/12/25 16:24:50 No eventing-con process running
2021/12/25 16:24:50 Function: TestDuplicateTimerFiringEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingSwapReb deleting in background"
}
2021/12/25 16:24:52 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:24:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:25:02 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:25:07 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:25:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:25:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:25:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:25:19 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:25:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingSwapReb (180.71s)
=== RUN   TestDuplicateTimerFiringKVRebIn
2021/12/25 16:25:29 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/25 16:25:29 App: TestDuplicateTimerFiringKVRebIn got un-deployed
2021/12/25 16:25:29 No eventing-con process running
2021/12/25 16:25:29 Function: TestDuplicateTimerFiringKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVRebIn not found"
}
2021/12/25 16:25:31 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:25:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:25:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:25:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:25:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:25:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:25:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:25:48 Deploying app: TestDuplicateTimerFiringKVRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:25:49 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebIn stored in temp store"
}
2021/12/25 16:25:54 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/25 16:25:59 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/25 16:26:04 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/25 16:26:09 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/25 16:26:09 App: TestDuplicateTimerFiringKVRebIn got deployed
2021/12/25 16:26:09 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 16:26:09 Starting bucket ops to source bucket
2021/12/25 16:26:09 Removing node(s): [] from the cluster
2021/12/25 16:26:14 Rebalance progress: 12.5
2021/12/25 16:26:19 Rebalance progress: 12.5
2021/12/25 16:26:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:26:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:26:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:26:24 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 16:26:30 Rebalance progress: 12.5
2021/12/25 16:26:35 Rebalance progress: 12.5
2021/12/25 16:26:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:26:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:26:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:26:40 Waiting for src bucket item count to get to: 50000 curr count: 27159
2021/12/25 16:26:45 Waiting for src bucket item count to get to: 50000 curr count: 36713
2021/12/25 16:26:50 Waiting for src bucket item count to get to: 50000 curr count: 36713
2021/12/25 16:26:55 Waiting for src bucket item count to get to: 50000 curr count: 49119
2021/12/25 16:27:00 Waiting for src bucket item count to get to: 50000 curr count: 49119
2021/12/25 16:27:10 Waiting for dst bucket item count to get to: 50000 curr count: 43005
2021/12/25 16:27:15 Waiting for dst bucket item count to get to: 50000 curr count: 43005
2021/12/25 16:27:15 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 16:27:15 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 16:27:20 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/25 16:27:25 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/25 16:27:30 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/25 16:27:35 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/25 16:27:40 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/25 16:27:40 App: TestDuplicateTimerFiringKVRebIn got un-deployed
2021/12/25 16:27:40 No eventing-con process running
2021/12/25 16:27:40 Function: TestDuplicateTimerFiringKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebIn deleting in background"
}
2021/12/25 16:27:42 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:27:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:27:52 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:27:57 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:27:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:27:59 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:28:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:28:09 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:28:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVRebIn (169.87s)
=== RUN   TestDuplicateTimerFiringKVRebOut
2021/12/25 16:28:14 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 16:28:14 Removing node(s): [] from the cluster
2021/12/25 16:28:19 Rebalance progress: 100
2021/12/25 16:28:24 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/25 16:28:24 App: TestDuplicateTimerFiringKVRebOut got un-deployed
2021/12/25 16:28:24 No eventing-con process running
2021/12/25 16:28:24 Function: TestDuplicateTimerFiringKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVRebOut not found"
}
2021/12/25 16:28:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:28:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:28:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:28:33 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:28:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:28:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:28:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:28:43 Deploying app: TestDuplicateTimerFiringKVRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:28:44 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebOut stored in temp store"
}
2021/12/25 16:28:49 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/25 16:28:54 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/25 16:28:59 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/25 16:29:04 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/25 16:29:04 App: TestDuplicateTimerFiringKVRebOut got deployed
2021/12/25 16:29:04 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 16:29:04 Starting bucket ops to source bucket
2021/12/25 16:29:09 Rebalance progress: 12.5
2021/12/25 16:29:14 Rebalance progress: 12.5
2021/12/25 16:29:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:29:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:29:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:29:19 Waiting for src bucket item count to get to: 50000 curr count: 6969
2021/12/25 16:29:24 Waiting for src bucket item count to get to: 50000 curr count: 20652
2021/12/25 16:29:29 Waiting for src bucket item count to get to: 50000 curr count: 20652
2021/12/25 16:29:34 Waiting for src bucket item count to get to: 50000 curr count: 31813
2021/12/25 16:29:39 Waiting for src bucket item count to get to: 50000 curr count: 31813
2021/12/25 16:29:44 Waiting for src bucket item count to get to: 50000 curr count: 42504
2021/12/25 16:29:49 Waiting for src bucket item count to get to: 50000 curr count: 42504
2021/12/25 16:29:54 Waiting for src bucket item count to get to: 50000 curr count: 42504
2021/12/25 16:30:04 Waiting for dst bucket item count to get to: 50000 curr count: 34449
2021/12/25 16:30:09 Waiting for dst bucket item count to get to: 50000 curr count: 34449
2021/12/25 16:30:14 Waiting for dst bucket item count to get to: 50000 curr count: 43591
2021/12/25 16:30:19 Waiting for dst bucket item count to get to: 50000 curr count: 43591
2021/12/25 16:30:19 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 16:30:19 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 16:30:24 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/25 16:30:29 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/25 16:30:34 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/25 16:30:40 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/25 16:30:45 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/25 16:30:45 App: TestDuplicateTimerFiringKVRebOut got un-deployed
2021/12/25 16:30:45 No eventing-con process running
2021/12/25 16:30:45 Function: TestDuplicateTimerFiringKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebOut deleting in background"
}
2021/12/25 16:30:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:30:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:30:56 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:30:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:30:58 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:31:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:31:08 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:31:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVRebOut (179.42s)
=== RUN   TestDuplicateTimerFiringKVSwapReb
2021/12/25 16:31:18 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/25 16:31:18 App: TestDuplicateTimerFiringKVSwapReb got un-deployed
2021/12/25 16:31:18 No eventing-con process running
2021/12/25 16:31:18 Function: TestDuplicateTimerFiringKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVSwapReb not found"
}
2021/12/25 16:31:20 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:31:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:31:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:31:27 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:31:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:31:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:31:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:31:37 Deploying app: TestDuplicateTimerFiringKVSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:31:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVSwapReb stored in temp store"
}
2021/12/25 16:31:43 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/25 16:31:48 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/25 16:31:53 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/25 16:31:58 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/25 16:31:58 App: TestDuplicateTimerFiringKVSwapReb got deployed
2021/12/25 16:31:58 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 16:31:58 Starting bucket ops to source bucket
2021/12/25 16:31:58 Removing node(s): [] from the cluster
2021/12/25 16:32:03 Rebalance progress: 12.5
2021/12/25 16:32:08 Rebalance progress: 12.5
2021/12/25 16:32:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:32:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:32:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:32:13 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 16:32:14 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 16:32:19 Rebalance progress: 12.5
2021/12/25 16:32:24 Rebalance progress: 12.5
2021/12/25 16:32:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:32:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:32:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:32:29 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 16:32:34 Rebalance progress: 12.5
2021/12/25 16:32:39 Rebalance progress: 12.5
2021/12/25 16:32:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:32:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:32:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:32:44 Waiting for src bucket item count to get to: 50000 curr count: 48764
2021/12/25 16:32:49 Waiting for src bucket item count to get to: 50000 curr count: 48764
2021/12/25 16:32:59 Waiting for dst bucket item count to get to: 50000 curr count: 43141
2021/12/25 16:33:04 Waiting for dst bucket item count to get to: 50000 curr count: 43141
2021/12/25 16:33:04 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 16:33:04 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 16:33:09 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/25 16:33:14 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/25 16:33:19 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/25 16:33:24 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/25 16:33:30 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/25 16:33:30 App: TestDuplicateTimerFiringKVSwapReb got un-deployed
2021/12/25 16:33:30 No eventing-con process running
2021/12/25 16:33:30 Function: TestDuplicateTimerFiringKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVSwapReb deleting in background"
}
2021/12/25 16:33:31 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:33:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:33:41 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:33:46 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:33:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:33:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:33:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:33:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 16:33:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVSwapReb (169.90s)
=== RUN   TestKVRebOnUpdateBucketOpOneByOne
2021/12/25 16:34:08 Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:34:08 App: bucket_op_on_update got un-deployed
2021/12/25 16:34:08 No eventing-con process running
2021/12/25 16:34:08 Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 16:34:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:34:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:34:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:34:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:34:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:34:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:34:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:34:27 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:34:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/25 16:34:33 Starting bucket ops to source bucket
2021/12/25 16:34:38 Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:34:43 Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:34:48 Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:34:48 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:34:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:34:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:34:48 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 16:34:48 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 16:34:53 Rebalance progress: 12.5
2021/12/25 16:34:58 Rebalance progress: 12.5
2021/12/25 16:35:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:35:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:35:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:35:03 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 16:35:04 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 16:35:09 Rebalance progress: 12.5
2021/12/25 16:35:14 Rebalance progress: 12.5
2021/12/25 16:35:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:35:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:35:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:35:19 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/25 16:35:19 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 16:35:24 Rebalance progress: 12.5
2021/12/25 16:35:29 Rebalance progress: 12.5
2021/12/25 16:35:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:35:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:35:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:35:34 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 16:35:39 Rebalance progress: 12.5
2021/12/25 16:35:44 Rebalance progress: 12.5
2021/12/25 16:35:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:35:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:35:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:35:49 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 16:35:54 Rebalance progress: 12.5
2021/12/25 16:35:59 Rebalance progress: 12.5
2021/12/25 16:36:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:36:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:36:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:36:04 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/25 16:36:09 Rebalance progress: 12.5
2021/12/25 16:36:14 Rebalance progress: 12.5
2021/12/25 16:36:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:36:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:36:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:36:24 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:36:29 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:36:35 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:36:40 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:36:45 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:36:45 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 16:36:45 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:36:45 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 16:36:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:36:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:36:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10632
2021/12/25 16:36:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:36:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:37:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:37:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10632
2021/12/25 16:37:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOnUpdateBucketOpOneByOne (190.31s)
=== RUN   TestKVForceFailover
2021/12/25 16:37:23 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:37:24 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 16:37:24 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:37:24 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 16:37:25 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:37:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:37:30 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:37:32 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:37:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:37:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:37:37 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 16:37:37 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 16:37:42 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:37:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:37:42 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:37:44 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/25 16:37:44 Starting bucket ops to source bucket
2021/12/25 16:37:49 Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:37:54 Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:37:59 Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:38:04 Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:38:04 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:38:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:38:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:38:04 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
2021/12/25 16:38:24 clusterSetup.go:237: Kicking off failover recovery, type: full
2021/12/25 16:38:24 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 16:38:29 Rebalance progress: 12.5
2021/12/25 16:38:34 Rebalance progress: 12.5
2021/12/25 16:38:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:38:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:38:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:38:39 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2021/12/25 16:38:44 Rebalance progress: 12.5
2021/12/25 16:38:49 Rebalance progress: 12.5
2021/12/25 16:38:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:38:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:38:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:39:00 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:39:05 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:39:10 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:39:15 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:39:20 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:39:20 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 16:39:20 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:39:20 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 16:39:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:39:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:39:32 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7075
2021/12/25 16:39:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7075
2021/12/25 16:39:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:39:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:39:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:39:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7075
2021/12/25 16:39:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVForceFailover (160.25s)
=== RUN   TestKVHardFailoverRecovery
2021/12/25 16:39:59 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:39:59 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 16:39:59 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:39:59 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 16:40:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:40:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:40:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:40:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:40:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:40:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:40:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:40:17 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:40:18 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/25 16:40:23 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 16:40:28 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:40:33 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:40:38 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:40:38 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:40:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:40:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:40:38 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 16:40:39 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 16:40:44 Rebalance progress: 12.5
2021/12/25 16:40:49 Rebalance progress: 12.5
2021/12/25 16:40:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:40:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:40:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:40:54 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
2021/12/25 16:41:54 clusterSetup.go:237: Kicking off failover recovery, type: full
2021/12/25 16:41:59 Rebalance progress: 12.5
2021/12/25 16:42:04 Rebalance progress: 12.5
2021/12/25 16:42:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:42:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:42:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:42:09 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 16:42:14 Rebalance progress: 12.5
2021/12/25 16:42:19 Rebalance progress: 12.5
2021/12/25 16:42:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:42:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:42:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:42:29 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:42:34 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:42:39 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:42:45 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:42:50 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:42:50 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 16:42:50 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:42:50 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 16:42:52 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:42:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:43:02 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12062
2021/12/25 16:43:07 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12062
2021/12/25 16:43:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:43:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:43:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:43:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12062
2021/12/25 16:43:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVHardFailoverRecovery (209.63s)
=== RUN   TestKVRebOnUpdateBucketOpAllAtOnce
2021/12/25 16:43:28 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:43:28 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 16:43:28 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:43:28 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 16:43:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:43:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:43:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:43:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:43:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:43:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:43:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:43:47 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:43:48 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/25 16:43:53 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 16:43:58 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:44:03 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:44:08 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:44:08 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:44:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:44:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:44:08 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 16:44:08 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 16:44:09 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/25 16:44:09 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 16:44:14 Rebalance progress: 12.5
2021/12/25 16:44:19 Rebalance progress: 12.5
2021/12/25 16:44:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:44:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:44:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:44:24 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/25 16:44:29 Rebalance progress: 12.5
2021/12/25 16:44:34 Rebalance progress: 12.5
2021/12/25 16:44:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:44:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:44:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:44:44 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:44:49 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:44:55 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:45:00 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:45:05 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:45:05 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 16:45:05 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:45:05 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 16:45:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:45:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:45:17 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4619
2021/12/25 16:45:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:45:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:45:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:45:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4619
2021/12/25 16:45:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOnUpdateBucketOpAllAtOnce (130.03s)
=== RUN   TestKVSwapRebOnUpdateBucketOp
2021/12/25 16:45:38 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:45:38 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 16:45:38 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:45:38 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 16:45:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:45:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:45:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:45:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:45:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:45:52 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:45:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:45:52 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:45:53 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/25 16:45:58 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 16:46:03 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:46:08 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:46:13 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:46:13 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:46:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:46:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:46:13 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 16:46:14 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 16:46:19 Rebalance progress: 12.5
2021/12/25 16:46:24 Rebalance progress: 12.5
2021/12/25 16:46:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:46:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:46:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:46:29 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 16:46:29 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 16:46:34 Rebalance progress: 12.5
2021/12/25 16:46:39 Rebalance progress: 12.5
2021/12/25 16:46:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:46:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:46:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:46:44 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 16:46:50 Rebalance progress: 12.5
2021/12/25 16:46:55 Rebalance progress: 12.5
2021/12/25 16:47:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:47:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:47:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:47:05 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:47:10 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:47:15 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:47:20 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:47:25 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:47:25 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 16:47:25 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:47:25 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 16:47:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:47:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:47:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6132
2021/12/25 16:47:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:47:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:47:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:47:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6132
2021/12/25 16:47:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:47:54 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:47:54 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 16:47:54 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:47:54 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 16:47:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:48:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:48:01 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:48:02 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:48:07 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:48:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebOnUpdateBucketOp (158.89s)
=== RUN   TestKVRebalanceWithMultipleHandlers
2021/12/25 16:48:17 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:48:17 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 16:48:17 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:48:17 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 16:48:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:48:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:48:24 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:48:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:48:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:48:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:48:36 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 16:48:36 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/25 16:48:36 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:48:36 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: sys_test_bucket_op not found"
}
2021/12/25 16:48:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:48:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:48:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:48:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:48:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:48:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:48:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:48:49 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:48:50 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:48:50 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:48:50 eventingSetup.go:125: Deploying app: sys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:48:52 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op stored in temp store"
}
2021/12/25 16:48:57 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 16:49:02 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:49:07 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:49:12 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:49:12 clusterSetup.go:354: App: bucket_op_on_update got deployed
2021/12/25 16:49:17 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/25 16:49:22 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/25 16:49:27 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/25 16:49:27 clusterSetup.go:354: App: sys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:49:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:49:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:49:27 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 16:49:27 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 16:49:32 Rebalance progress: 12.5
2021/12/25 16:49:37 Rebalance progress: 12.5
2021/12/25 16:49:42 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:49:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:49:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:49:42 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 16:49:43 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 16:49:48 Rebalance progress: 12.5
2021/12/25 16:49:53 Rebalance progress: 12.5
2021/12/25 16:49:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:49:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:49:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:49:58 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/25 16:49:59 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 16:50:04 Rebalance progress: 12.5
2021/12/25 16:50:09 Rebalance progress: 12.5
2021/12/25 16:50:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:50:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:50:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:50:14 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 16:50:19 Rebalance progress: 12.5
2021/12/25 16:50:24 Rebalance progress: 12.5
2021/12/25 16:50:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:50:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:50:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:50:29 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 16:50:34 Rebalance progress: 12.5
2021/12/25 16:50:39 Rebalance progress: 12.5
2021/12/25 16:50:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:50:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:50:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:50:44 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/25 16:50:49 Rebalance progress: 12.5
2021/12/25 16:50:54 Rebalance progress: 12.5
2021/12/25 16:50:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:50:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:50:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:51:04 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:51:09 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:51:15 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:51:20 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:51:25 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:51:25 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 16:51:25 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:51:25 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 16:51:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:51:33 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:51:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12234
2021/12/25 16:51:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:51:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:51:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:51:50 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2348
2021/12/25 16:51:55 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2348
2021/12/25 16:51:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:52:00 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 16:52:05 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 16:52:11 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 16:52:16 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 16:52:21 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 16:52:21 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/25 16:52:21 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:52:21 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op deleting in background"
}
2021/12/25 16:52:23 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:52:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:52:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:52:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:52:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:52:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebalanceWithMultipleHandlers (267.04s)
=== RUN   TestKVSwapRebalanceWithMultipleHandlers
2021/12/25 16:52:44 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:52:44 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 16:52:44 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:52:44 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 16:52:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:52:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:52:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:52:53 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:52:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:52:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:53:03 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 16:53:03 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/25 16:53:03 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:53:03 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: sys_test_bucket_op not found"
}
2021/12/25 16:53:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:53:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:53:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:53:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:53:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:53:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:53:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:53:16 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:53:18 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:53:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:53:18 eventingSetup.go:125: Deploying app: sys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:53:19 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op stored in temp store"
}
2021/12/25 16:53:24 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 16:53:29 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:53:34 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:53:39 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:53:39 clusterSetup.go:354: App: bucket_op_on_update got deployed
2021/12/25 16:53:44 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/25 16:53:49 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/25 16:53:54 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/25 16:53:54 clusterSetup.go:354: App: sys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:53:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:53:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:53:54 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 16:53:54 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 16:54:00 Rebalance progress: 12.5
2021/12/25 16:54:05 Rebalance progress: 12.5
2021/12/25 16:54:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:54:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:54:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:54:10 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 16:54:10 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 16:54:15 Rebalance progress: 12.5
2021/12/25 16:54:20 Rebalance progress: 12.5
2021/12/25 16:54:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:54:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:54:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:54:25 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 16:54:30 Rebalance progress: 12.5
2021/12/25 16:54:35 Rebalance progress: 12.5
2021/12/25 16:54:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:54:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:54:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:54:45 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:54:51 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:54:56 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:55:01 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:55:06 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:55:06 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 16:55:06 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:55:06 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 16:55:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:55:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:55:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:55:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:55:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:55:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7657
2021/12/25 16:55:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:55:32 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 16:55:37 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 16:55:43 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 16:55:48 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 16:55:53 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 16:55:53 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/25 16:55:53 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:55:53 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op deleting in background"
}
2021/12/25 16:55:55 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:56:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:56:00 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:56:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:56:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:56:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebalanceWithMultipleHandlers (212.05s)
=== RUN   TestKVRebStopStartKVOpsOnUpdateBucketOpOneByOne
2021/12/25 16:56:16 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:56:16 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 16:56:16 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:56:16 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 16:56:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:56:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:56:23 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:56:25 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:56:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:56:30 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:56:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:56:35 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:56:36 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/25 16:56:41 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 16:56:46 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:56:51 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:56:56 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:56:56 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:56:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:56:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:56:56 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 16:56:56 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 16:57:16 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:57:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:57:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:57:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:57:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:57:27 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 16:57:32 Rebalance progress: 12.5
2021/12/25 16:57:37 Rebalance progress: 12.5
2021/12/25 16:57:42 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:57:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:57:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:57:42 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 16:57:43 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 16:57:48 Rebalance progress: 12.5
2021/12/25 16:57:53 Rebalance progress: 12.5
2021/12/25 16:57:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:57:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:57:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:57:58 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 16:58:03 Rebalance progress: 12.5
2021/12/25 16:58:08 Rebalance progress: 12.5
2021/12/25 16:58:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:58:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:58:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:58:18 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:58:23 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:58:28 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:58:33 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:58:38 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:58:38 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 16:58:38 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:58:38 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 16:58:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:58:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:58:50 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2299
2021/12/25 16:58:55 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2299
2021/12/25 16:58:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:58:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:59:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:59:07 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9155
2021/12/25 16:59:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebStopStartKVOpsOnUpdateBucketOpOneByOne (180.57s)
=== RUN   TestKVFailoverOnUpdateBucketOp
2021/12/25 16:59:17 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 16:59:17 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 16:59:17 eventingSetup.go:46: No eventing-con process running
2021/12/25 16:59:17 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 16:59:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:59:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:59:24 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 16:59:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:59:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:59:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:59:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 16:59:36 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 16:59:37 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/25 16:59:42 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 16:59:47 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:59:52 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:59:57 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 16:59:57 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:59:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 16:59:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 16:59:57 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 16:59:57 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 17:00:02 Rebalance progress: 12.5
2021/12/25 17:00:07 Rebalance progress: 12.5
2021/12/25 17:00:12 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 17:00:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 17:00:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 17:00:12 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 17:00:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 17:00:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 17:00:22 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 17:00:27 Rebalance progress: 12.5
2021/12/25 17:00:32 Rebalance progress: 12.5
2021/12/25 17:00:37 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 17:00:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 17:00:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 17:00:37 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 17:00:37 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 17:00:43 Rebalance progress: 12.5
2021/12/25 17:00:48 Rebalance progress: 12.5
2021/12/25 17:00:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 17:00:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 17:00:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 17:00:53 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 17:00:58 Rebalance progress: 12.5
2021/12/25 17:01:03 Rebalance progress: 12.5
2021/12/25 17:01:08 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 17:01:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 17:01:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 17:01:13 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 17:01:18 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 17:01:23 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 17:01:28 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 17:01:33 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 17:01:33 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 17:01:33 eventingSetup.go:46: No eventing-con process running
2021/12/25 17:01:33 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 17:01:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 17:01:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 17:01:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8589
2021/12/25 17:01:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 17:01:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 17:01:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 17:01:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8589
2021/12/25 17:01:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVFailoverOnUpdateBucketOp (169.72s)
=== RUN   TestBootstrapAfterKVHardFailover
2021/12/25 17:02:02 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 17:02:02 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 17:02:07 Rebalance progress: 100
2021/12/25 17:02:07 Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 17:02:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 17:02:37 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 17:02:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/25 17:02:43 Removing node(s): [] from the cluster
2021/12/25 17:02:43 Starting bucket ops to source bucket
2021/12/25 17:02:48 Rebalance failed. See logs for detailed reason. You can try again.
2021/12/25 17:02:53 Waiting for app: bucket_op_on_update to get deployed
2021/12/25 17:02:58 Waiting for app: bucket_op_on_update to get deployed
2021/12/25 17:02:58 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 17:02:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 17:02:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 17:03:03 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 17:03:09 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 17:03:14 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 17:03:19 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 17:03:24 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 17:03:24 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 17:03:24 eventingSetup.go:46: No eventing-con process running
2021/12/25 17:03:24 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 17:03:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 17:03:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 17:03:36 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1506
2021/12/25 17:03:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 17:03:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 17:03:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 17:03:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1506
2021/12/25 17:03:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBootstrapAfterKVHardFailover (110.73s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	11963.076s

Rebalance tests took 3 hours, 19 minutes and 26 seconds.

Testing Succeeded


Version: versions-25.12.2021-09.22.cfg
Build Log: make-25.12.2021-09.22.log
Server Log: logs-25.12.2021-09.22.tar.gz

Finished