Building

Started building at 2021/12/24 17:35:26
Calculating base
Updating mirror
Basing run on 7.1.0-1980 4ea6ff3a6
Updating tree for run 24.12.2021-17.35
gocb is at 635fa6c, changes since last good build: none
libcouchbase is at f6822fc, changes since last good build: none
indexing is at 8d3522b, changes since last good build: none
kv_engine is at cda4d73, changes since last good build: none
ns_server is at fadbef1, changes since last good build: none
couchstore is at 0bf3a4b, changes since last good build: none
couchdb is at fca2e6b, changes since last good build: none
testrunner is at a23e488, changes since last good build: none
Switching eventing to unstable
eventing is at ee5930d, changes since last good build: none
Switching eventing-ee to unstable
eventing-ee is at 80089ff, changes since last good build: 
 80089ff Revert "MB-50023 : getLibraries endpoint should determine libraries list from"
Pulling in uncommitted change 160397 at refs/changes/97/160397/3
Total 23 (delta 15), reused 17 (delta 15)
[unstable 6591ec34] MB-100 : Do not fail n1ql timeout test if we are catching timeout exceptions successfully
 Author: abhijpes 
 Date: Mon Aug 30 08:24:38 2021 +0530
 1 file changed, 2 insertions(+), 2 deletions(-)
Pulling in uncommitted change 163449 at refs/changes/49/163449/1
Total 48 (delta 27), reused 39 (delta 27)
[unstable aeef52e7] MB-100: collect data when test fails
 Author: AnkitPrabhu 
 Date: Tue Oct 12 14:02:31 2021 +0530
 1 file changed, 2 insertions(+)
Pulling in uncommitted change 166698 at refs/changes/98/166698/3
Total 4 (delta 3), reused 4 (delta 3)
[unstable cd78011c] MB-48334 : Fail rebalance unless all functions deployed on current encryption level
 Author: abhijpes 
 Date: Wed Dec 1 14:51:29 2021 +0530
 1 file changed, 9 insertions(+)
Building cmakefiles and deps
Building main product

Testing

Started testing at 2021/12/24 17:51:36
Testing mode: rebalance,n1ql,functional
Starting server
Starting server: attempt 1

Functional tests

2021/12/24 17:53:04 Started functional
2021/12/24 17:53:12 Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2021/12/24 17:53:18 Error in adding nodes : , response: {"otpNode":"n_1@127.0.0.1"}
2021/12/24 17:53:18 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 17:53:30 Removing node(s): [] from the cluster
2021/12/24 17:53:35 Rebalance progress: 2.983940972222222
2021/12/24 17:53:40 Rebalance progress: 7.685908564814814
2021/12/24 17:53:45 Rebalance progress: 11.10387731481481
2021/12/24 17:53:50 Rebalance progress: 15.78776041666667
2021/12/24 17:53:55 Rebalance progress: 19.15147569444445
2021/12/24 17:54:00 Rebalance progress: 23.83535879629629
2021/12/24 17:54:05 Rebalance progress: 88.88888888888887
2021/12/24 17:54:10 Rebalance progress: 100
2021/12/24 17:54:13 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 17:54:28 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 17:54:43 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 17:54:58 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 17:55:13 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 17:55:28 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 17:55:43 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 17:55:58 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 17:56:13 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 17:56:28 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 17:56:43 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 17:56:58 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 17:57:13 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 17:57:28 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 17:57:43 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/24 17:57:58 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
=== RUN   TestAdvancedGetOps
2021/12/24 17:58:16 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/24 17:58:31 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/24 17:58:46 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/24 17:59:01 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/24 17:59:16 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/24 17:59:31 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/24 17:59:46 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/24 18:00:01 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/24 18:00:16 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/24 18:00:31 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/24 18:00:46 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/24 18:01:01 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/24 18:01:16 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/24 18:01:31 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/24 18:01:46 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:hello-world Completion:0}]
2021/12/24 18:02:01 Deploying app: TestAdvancedGetOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:02:02 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedGetOps stored in temp store"
}
2021/12/24 18:02:07 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/24 18:02:12 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/24 18:02:17 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/24 18:02:22 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/24 18:02:22 App: TestAdvancedGetOps got deployed
2021/12/24 18:02:22 Starting bucket ops to source bucket
2021/12/24 18:02:27 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 18:02:32 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 18:02:32 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 18:02:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:02:32 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:02:37 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/24 18:02:42 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/24 18:02:47 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/24 18:02:52 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/24 18:02:52 App: TestAdvancedGetOps got un-deployed
2021/12/24 18:02:52 No eventing-con process running
2021/12/24 18:02:52 Function: TestAdvancedGetOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedGetOps deleting in background"
}
2021/12/24 18:02:54 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:03:04 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:03:09 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:03:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:03:11 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:03:21 Waiting for dst bucket item count to get to: 0 curr count: 92
2021/12/24 18:03:26 Waiting for dst bucket item count to get to: 0 curr count: 92
2021/12/24 18:03:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedGetOps (310.11s)
=== RUN   TestAdvancedInsertOps
2021/12/24 18:03:26 Deploying app: TestAdvancedInsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:03:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps stored in temp store"
}
2021/12/24 18:03:32 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/24 18:03:37 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/24 18:03:42 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/24 18:03:47 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/24 18:03:47 App: TestAdvancedInsertOps got deployed
2021/12/24 18:03:47 Starting bucket ops to source bucket
2021/12/24 18:03:53 Waiting for dst bucket item count to get to: 1024 curr count: 0
2021/12/24 18:03:58 Waiting for dst bucket item count to get to: 1024 curr count: 595
2021/12/24 18:04:03 Waiting for dst bucket item count to get to: 1024 curr count: 595
2021/12/24 18:04:03 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2021/12/24 18:04:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:04:03 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:04:08 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/24 18:04:13 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/24 18:04:18 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/24 18:04:23 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/24 18:04:23 App: TestAdvancedInsertOps got un-deployed
2021/12/24 18:04:23 No eventing-con process running
2021/12/24 18:04:23 Function: TestAdvancedInsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps deleting in background"
}
2021/12/24 18:04:25 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:04:35 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/24 18:04:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:04:37 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:04:47 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/24 18:04:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:04:47 Testing insert operation on source bucket
2021/12/24 18:04:47 Deploying app: TestAdvancedInsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:04:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps stored in temp store"
}
2021/12/24 18:04:53 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/24 18:04:58 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/24 18:05:03 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/24 18:05:08 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/24 18:05:08 App: TestAdvancedInsertOps got deployed
2021/12/24 18:05:08 Starting bucket ops to source bucket
2021/12/24 18:05:14 Waiting for dst bucket item count to get to: 2048 curr count: 0
2021/12/24 18:05:19 Waiting for dst bucket item count to get to: 2048 curr count: 1024
2021/12/24 18:05:24 Waiting for dst bucket item count to get to: 2048 curr count: 1024
2021/12/24 18:05:24 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2021/12/24 18:05:24 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:05:24 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:05:29 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/24 18:05:34 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/24 18:05:39 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/24 18:05:44 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/24 18:05:44 App: TestAdvancedInsertOps got un-deployed
2021/12/24 18:05:44 No eventing-con process running
2021/12/24 18:05:44 Function: TestAdvancedInsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps deleting in background"
}
2021/12/24 18:05:46 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:05:56 Waiting for dst bucket item count to get to: 0 curr count: 2048
2021/12/24 18:05:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:05:57 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:06:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedInsertOps (156.52s)
=== RUN   TestAdvancedUpsertOps
2021/12/24 18:06:02 Starting bucket ops to source bucket
2021/12/24 18:06:03 Deploying app: TestAdvancedUpsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:06:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps stored in temp store"
}
2021/12/24 18:06:09 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/24 18:06:14 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/24 18:06:19 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/24 18:06:24 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/24 18:06:24 App: TestAdvancedUpsertOps got deployed
2021/12/24 18:06:24 Starting bucket ops to source bucket
2021/12/24 18:06:30 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/24 18:06:35 Waiting for dst bucket item count to get to: 0 curr count: 512
2021/12/24 18:06:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:06:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:06:35 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:06:40 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/24 18:06:45 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/24 18:06:50 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/24 18:06:55 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/24 18:06:55 App: TestAdvancedUpsertOps got un-deployed
2021/12/24 18:06:55 No eventing-con process running
2021/12/24 18:06:55 Function: TestAdvancedUpsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps deleting in background"
}
2021/12/24 18:06:57 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:07:07 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/24 18:07:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:07:09 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:07:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:07:14 Testing upsert operation on source bucket
2021/12/24 18:07:14 Deploying app: TestAdvancedUpsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:07:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps stored in temp store"
}
2021/12/24 18:07:20 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/24 18:07:25 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/24 18:07:30 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/24 18:07:35 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/24 18:07:35 App: TestAdvancedUpsertOps got deployed
2021/12/24 18:07:35 Starting bucket ops to source bucket
2021/12/24 18:07:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:07:36 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:07:36 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:07:41 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/24 18:07:46 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/24 18:07:51 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/24 18:07:56 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/24 18:07:56 App: TestAdvancedUpsertOps got un-deployed
2021/12/24 18:07:56 No eventing-con process running
2021/12/24 18:07:56 Function: TestAdvancedUpsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps deleting in background"
}
2021/12/24 18:07:58 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:08:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:08:05 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:08:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedUpsertOps (127.80s)
=== RUN   TestAdvancedReplaceOps
2021/12/24 18:08:10 Starting bucket ops to source bucket
2021/12/24 18:08:11 Deploying app: TestAdvancedReplaceOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:08:12 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps stored in temp store"
}
2021/12/24 18:08:17 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/24 18:08:22 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/24 18:08:27 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/24 18:08:32 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/24 18:08:32 App: TestAdvancedReplaceOps got deployed
2021/12/24 18:08:32 Starting bucket ops to source bucket
2021/12/24 18:08:38 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/24 18:08:43 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/24 18:08:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:08:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:08:43 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:08:48 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/24 18:08:53 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/24 18:08:58 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/24 18:09:03 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/24 18:09:04 App: TestAdvancedReplaceOps got un-deployed
2021/12/24 18:09:04 No eventing-con process running
2021/12/24 18:09:04 Function: TestAdvancedReplaceOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps deleting in background"
}
2021/12/24 18:09:05 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:09:15 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/24 18:09:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:09:17 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:09:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:09:22 Testing upsert operation on source bucket
2021/12/24 18:09:22 Deploying app: TestAdvancedReplaceOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:09:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps stored in temp store"
}
2021/12/24 18:09:28 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/24 18:09:33 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/24 18:09:38 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/24 18:09:43 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/24 18:09:43 App: TestAdvancedReplaceOps got deployed
2021/12/24 18:09:43 Starting bucket ops to source bucket
2021/12/24 18:09:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:09:45 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:09:45 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:09:50 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/24 18:09:55 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/24 18:10:00 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/24 18:10:05 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/24 18:10:05 App: TestAdvancedReplaceOps got un-deployed
2021/12/24 18:10:05 No eventing-con process running
2021/12/24 18:10:05 Function: TestAdvancedReplaceOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps deleting in background"
}
2021/12/24 18:10:06 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:10:16 Waiting for dst bucket item count to get to: 0 curr count: 162
2021/12/24 18:10:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:10:18 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:10:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedReplaceOps (133.09s)
=== RUN   TestAdvancedDeleteOps
2021/12/24 18:10:23 Starting bucket ops to source bucket
2021/12/24 18:10:23 Deploying app: TestAdvancedDeleteOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:10:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps stored in temp store"
}
2021/12/24 18:10:30 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/24 18:10:35 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/24 18:10:40 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/24 18:10:45 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/24 18:10:45 App: TestAdvancedDeleteOps got deployed
2021/12/24 18:10:45 Starting bucket ops to source bucket
2021/12/24 18:10:50 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:10:55 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:10:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:10:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:10:55 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:11:00 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/24 18:11:05 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/24 18:11:10 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/24 18:11:15 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/24 18:11:15 App: TestAdvancedDeleteOps got un-deployed
2021/12/24 18:11:15 No eventing-con process running
2021/12/24 18:11:15 Function: TestAdvancedDeleteOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps deleting in background"
}
2021/12/24 18:11:17 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:11:27 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:11:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:11:28 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:11:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:11:33 Testing delete operation on source bucket
2021/12/24 18:11:33 Deploying app: TestAdvancedDeleteOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:11:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps stored in temp store"
}
2021/12/24 18:11:40 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/24 18:11:45 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/24 18:11:50 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/24 18:11:55 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/24 18:11:55 App: TestAdvancedDeleteOps got deployed
2021/12/24 18:11:55 Starting bucket ops to source bucket
2021/12/24 18:11:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:11:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:11:55 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:12:00 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/24 18:12:05 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/24 18:12:10 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/24 18:12:15 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/24 18:12:15 App: TestAdvancedDeleteOps got un-deployed
2021/12/24 18:12:15 No eventing-con process running
2021/12/24 18:12:15 Function: TestAdvancedDeleteOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps deleting in background"
}
2021/12/24 18:12:17 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:12:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:12:24 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:12:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedDeleteOps (125.71s)
=== RUN   TestEnoentAdvancedGet
2021/12/24 18:12:29 Deploying app: TestEnoentAdvancedGet. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:12:30 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet stored in temp store"
}
2021/12/24 18:12:35 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/24 18:12:40 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/24 18:12:45 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/24 18:12:50 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/24 18:12:50 App: TestEnoentAdvancedGet got deployed
2021/12/24 18:12:50 Starting bucket ops to source bucket
2021/12/24 18:12:55 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 18:13:00 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 18:13:00 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 18:13:00 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:13:00 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:13:05 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/24 18:13:10 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/24 18:13:15 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/24 18:13:20 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/24 18:13:20 App: TestEnoentAdvancedGet got un-deployed
2021/12/24 18:13:20 No eventing-con process running
2021/12/24 18:13:20 Function: TestEnoentAdvancedGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet deleting in background"
}
2021/12/24 18:13:22 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:13:32 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:13:37 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:13:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:13:39 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:13:49 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:13:54 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:13:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:13:54 Testing get enoent operation on source bucket
2021/12/24 18:13:54 Deploying app: TestEnoentAdvancedGet. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:13:55 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet stored in temp store"
}
2021/12/24 18:14:00 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/24 18:14:05 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/24 18:14:10 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/24 18:14:15 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/24 18:14:15 App: TestEnoentAdvancedGet got deployed
2021/12/24 18:14:15 Starting bucket ops to source bucket
2021/12/24 18:14:20 Waiting for dst bucket item count to get to: 200 curr count: 0
2021/12/24 18:14:20 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2021/12/24 18:14:20 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:14:20 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:14:25 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/24 18:14:31 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/24 18:14:36 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/24 18:14:41 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/24 18:14:41 App: TestEnoentAdvancedGet got un-deployed
2021/12/24 18:14:41 No eventing-con process running
2021/12/24 18:14:41 Function: TestEnoentAdvancedGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet deleting in background"
}
2021/12/24 18:14:42 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:14:52 Waiting for dst bucket item count to get to: 0 curr count: 200
2021/12/24 18:14:57 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:14:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:14:59 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:15:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedGet (155.11s)
=== RUN   TestEnoentAdvancedReplace
2021/12/24 18:15:04 Deploying app: TestEnoentAdvancedReplace. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:15:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace stored in temp store"
}
2021/12/24 18:15:10 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/24 18:15:15 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/24 18:15:20 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/24 18:15:25 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/24 18:15:25 App: TestEnoentAdvancedReplace got deployed
2021/12/24 18:15:25 Starting bucket ops to source bucket
2021/12/24 18:15:30 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 18:15:30 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 18:15:30 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:15:30 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:15:35 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/24 18:15:41 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/24 18:15:46 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/24 18:15:51 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/24 18:15:51 App: TestEnoentAdvancedReplace got un-deployed
2021/12/24 18:15:51 No eventing-con process running
2021/12/24 18:15:51 Function: TestEnoentAdvancedReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace deleting in background"
}
2021/12/24 18:15:52 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:16:02 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:16:07 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:16:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:16:09 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:16:19 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:16:24 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:16:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:16:24 Testing get enoent operation on source bucket
2021/12/24 18:16:24 Deploying app: TestEnoentAdvancedReplace. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:16:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace stored in temp store"
}
2021/12/24 18:16:30 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/24 18:16:35 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/24 18:16:40 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/24 18:16:45 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/24 18:16:45 App: TestEnoentAdvancedReplace got deployed
2021/12/24 18:16:45 Starting bucket ops to source bucket
2021/12/24 18:16:50 Waiting for dst bucket item count to get to: 200 curr count: 0
2021/12/24 18:16:50 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2021/12/24 18:16:50 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:16:50 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:16:56 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/24 18:17:01 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/24 18:17:06 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/24 18:17:11 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/24 18:17:11 App: TestEnoentAdvancedReplace got un-deployed
2021/12/24 18:17:11 No eventing-con process running
2021/12/24 18:17:11 Function: TestEnoentAdvancedReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace deleting in background"
}
2021/12/24 18:17:12 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:17:22 Waiting for dst bucket item count to get to: 0 curr count: 200
2021/12/24 18:17:27 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:17:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:17:29 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:17:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedReplace (150.03s)
=== RUN   TestEnoentAdvancedDelete
2021/12/24 18:17:34 Deploying app: TestEnoentAdvancedDelete. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:17:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete stored in temp store"
}
2021/12/24 18:17:40 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/24 18:17:45 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/24 18:17:50 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/24 18:17:55 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/24 18:17:55 App: TestEnoentAdvancedDelete got deployed
2021/12/24 18:17:55 Starting bucket ops to source bucket
2021/12/24 18:18:00 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 18:18:00 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 18:18:00 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:18:00 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:18:05 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/24 18:18:10 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/24 18:18:15 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/24 18:18:21 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/24 18:18:21 App: TestEnoentAdvancedDelete got un-deployed
2021/12/24 18:18:21 No eventing-con process running
2021/12/24 18:18:21 Function: TestEnoentAdvancedDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete deleting in background"
}
2021/12/24 18:18:22 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:18:32 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:18:37 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:18:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:18:39 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:18:49 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:18:54 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:18:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:18:54 Testing get enoent operation on source bucket
2021/12/24 18:18:54 Deploying app: TestEnoentAdvancedDelete. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:18:55 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete stored in temp store"
}
2021/12/24 18:19:00 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/24 18:19:05 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/24 18:19:10 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/24 18:19:15 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/24 18:19:15 App: TestEnoentAdvancedDelete got deployed
2021/12/24 18:19:15 Starting bucket ops to source bucket
2021/12/24 18:19:21 Waiting for dst bucket item count to get to: 200 curr count: 0
2021/12/24 18:19:21 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2021/12/24 18:19:21 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:19:21 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:19:26 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/24 18:19:31 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/24 18:19:36 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/24 18:19:41 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/24 18:19:41 App: TestEnoentAdvancedDelete got un-deployed
2021/12/24 18:19:41 No eventing-con process running
2021/12/24 18:19:41 Function: TestEnoentAdvancedDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete deleting in background"
}
2021/12/24 18:19:42 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:19:52 Waiting for dst bucket item count to get to: 0 curr count: 200
2021/12/24 18:19:57 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:19:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:19:59 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:20:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedDelete (150.13s)
=== RUN   TestAdvancedInsertKeyExist
2021/12/24 18:20:04 Deploying app: TestAdvancedInsertKeyExist. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:20:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist stored in temp store"
}
2021/12/24 18:20:10 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/24 18:20:15 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/24 18:20:21 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/24 18:20:26 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/24 18:20:26 App: TestAdvancedInsertKeyExist got deployed
2021/12/24 18:20:26 Starting bucket ops to source bucket
2021/12/24 18:20:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:20:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:20:26 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:20:31 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/24 18:20:36 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/24 18:20:41 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/24 18:20:46 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/24 18:20:46 App: TestAdvancedInsertKeyExist got un-deployed
2021/12/24 18:20:46 No eventing-con process running
2021/12/24 18:20:46 Function: TestAdvancedInsertKeyExist delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist deleting in background"
}
2021/12/24 18:20:48 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:20:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:20:55 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:21:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:21:00 Pumping document in the destination bucket
2021/12/24 18:21:00 Starting bucket ops to source bucket
2021/12/24 18:21:00 Deploying app: TestAdvancedInsertKeyExist. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:21:01 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist stored in temp store"
}
2021/12/24 18:21:06 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/24 18:21:11 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/24 18:21:16 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/24 18:21:21 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/24 18:21:21 App: TestAdvancedInsertKeyExist got deployed
2021/12/24 18:21:21 Starting bucket ops to source bucket
2021/12/24 18:21:26 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:21:31 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:21:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:21:31 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:21:31 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:21:37 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/24 18:21:42 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/24 18:21:47 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/24 18:21:52 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/24 18:21:52 App: TestAdvancedInsertKeyExist got un-deployed
2021/12/24 18:21:52 No eventing-con process running
2021/12/24 18:21:52 Function: TestAdvancedInsertKeyExist delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist deleting in background"
}
2021/12/24 18:21:53 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:22:03 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:22:08 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:22:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:22:10 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:22:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedInsertKeyExist (130.91s)
=== RUN   TestExipryGet
2021/12/24 18:22:15 Deploying app: TestExipryGet. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:22:16 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet stored in temp store"
}
2021/12/24 18:22:21 Waiting for app: TestExipryGet to get deployed
2021/12/24 18:22:26 Waiting for app: TestExipryGet to get deployed
2021/12/24 18:22:31 Waiting for app: TestExipryGet to get deployed
2021/12/24 18:22:36 Waiting for app: TestExipryGet to get deployed
2021/12/24 18:22:36 App: TestExipryGet got deployed
2021/12/24 18:22:36 Starting bucket ops to source bucket
2021/12/24 18:23:22 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:23:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:23:22 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:23:22 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:23:27 Waiting for app: TestExipryGet to get un-deployed
2021/12/24 18:23:32 Waiting for app: TestExipryGet to get un-deployed
2021/12/24 18:23:37 Waiting for app: TestExipryGet to get un-deployed
2021/12/24 18:23:42 Waiting for app: TestExipryGet to get un-deployed
2021/12/24 18:23:42 App: TestExipryGet got un-deployed
2021/12/24 18:23:42 No eventing-con process running
2021/12/24 18:23:42 Function: TestExipryGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet deleting in background"
}
2021/12/24 18:23:44 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:23:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:23:51 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:23:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:23:56 Pumping document in the destination bucket for expiry get
2021/12/24 18:23:56 Starting bucket ops to source bucket
2021/12/24 18:23:56 Deploying app: TestExipryGet. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:23:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet stored in temp store"
}
2021/12/24 18:24:02 Waiting for app: TestExipryGet to get deployed
2021/12/24 18:24:07 Waiting for app: TestExipryGet to get deployed
2021/12/24 18:24:12 Waiting for app: TestExipryGet to get deployed
2021/12/24 18:24:17 Waiting for app: TestExipryGet to get deployed
2021/12/24 18:24:17 App: TestExipryGet got deployed
2021/12/24 18:24:17 Starting bucket ops to source bucket
2021/12/24 18:25:02 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:25:07 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:25:12 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:25:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:25:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:25:12 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:25:17 Waiting for app: TestExipryGet to get un-deployed
2021/12/24 18:25:22 Waiting for app: TestExipryGet to get un-deployed
2021/12/24 18:25:28 Waiting for app: TestExipryGet to get un-deployed
2021/12/24 18:25:33 Waiting for app: TestExipryGet to get un-deployed
2021/12/24 18:25:33 App: TestExipryGet got un-deployed
2021/12/24 18:25:33 No eventing-con process running
2021/12/24 18:25:33 Function: TestExipryGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet deleting in background"
}
2021/12/24 18:25:34 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:25:44 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:25:49 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:25:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:25:51 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:25:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryGet (220.88s)
=== RUN   TestExipryInsert
2021/12/24 18:25:56 Deploying app: TestExipryInsert. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:25:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert stored in temp store"
}
2021/12/24 18:26:02 Waiting for app: TestExipryInsert to get deployed
2021/12/24 18:26:07 Waiting for app: TestExipryInsert to get deployed
2021/12/24 18:26:12 Waiting for app: TestExipryInsert to get deployed
2021/12/24 18:26:17 Waiting for app: TestExipryInsert to get deployed
2021/12/24 18:26:17 App: TestExipryInsert got deployed
2021/12/24 18:26:17 Starting bucket ops to source bucket
2021/12/24 18:27:02 Waiting for dst bucket item count to get to: 0 curr count: 200
2021/12/24 18:27:08 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:27:13 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:27:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:27:13 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:27:13 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:27:18 Waiting for app: TestExipryInsert to get un-deployed
2021/12/24 18:27:23 Waiting for app: TestExipryInsert to get un-deployed
2021/12/24 18:27:28 Waiting for app: TestExipryInsert to get un-deployed
2021/12/24 18:27:33 Waiting for app: TestExipryInsert to get un-deployed
2021/12/24 18:27:33 App: TestExipryInsert got un-deployed
2021/12/24 18:27:33 No eventing-con process running
2021/12/24 18:27:33 Function: TestExipryInsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert deleting in background"
}
2021/12/24 18:27:34 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:27:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:27:42 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:27:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:27:47 Testing on the destination bucket for expiry insert
2021/12/24 18:27:47 Deploying app: TestExipryInsert. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:27:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert stored in temp store"
}
2021/12/24 18:27:53 Waiting for app: TestExipryInsert to get deployed
2021/12/24 18:27:58 Waiting for app: TestExipryInsert to get deployed
2021/12/24 18:28:03 Waiting for app: TestExipryInsert to get deployed
2021/12/24 18:28:08 Waiting for app: TestExipryInsert to get deployed
2021/12/24 18:28:08 App: TestExipryInsert got deployed
2021/12/24 18:28:08 Starting bucket ops to source bucket
2021/12/24 18:28:53 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:28:58 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:28:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:28:58 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:28:58 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:29:03 Waiting for app: TestExipryInsert to get un-deployed
2021/12/24 18:29:08 Waiting for app: TestExipryInsert to get un-deployed
2021/12/24 18:29:13 Waiting for app: TestExipryInsert to get un-deployed
2021/12/24 18:29:18 Waiting for app: TestExipryInsert to get un-deployed
2021/12/24 18:29:18 App: TestExipryInsert got un-deployed
2021/12/24 18:29:18 No eventing-con process running
2021/12/24 18:29:18 Function: TestExipryInsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert deleting in background"
}
2021/12/24 18:29:20 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:29:30 Waiting for dst bucket item count to get to: 0 curr count: 56
2021/12/24 18:29:35 Waiting for dst bucket item count to get to: 0 curr count: 56
2021/12/24 18:29:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:29:37 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:29:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryInsert (225.64s)
=== RUN   TestExipryReplace
2021/12/24 18:29:42 Deploying app: TestExipryReplace. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:29:43 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace stored in temp store"
}
2021/12/24 18:29:48 Waiting for app: TestExipryReplace to get deployed
2021/12/24 18:29:53 Waiting for app: TestExipryReplace to get deployed
2021/12/24 18:29:58 Waiting for app: TestExipryReplace to get deployed
2021/12/24 18:30:03 Waiting for app: TestExipryReplace to get deployed
2021/12/24 18:30:03 App: TestExipryReplace got deployed
2021/12/24 18:30:03 Starting bucket ops to source bucket
2021/12/24 18:30:48 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:30:53 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:30:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:30:53 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:30:53 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:30:58 Waiting for app: TestExipryReplace to get un-deployed
2021/12/24 18:31:03 Waiting for app: TestExipryReplace to get un-deployed
2021/12/24 18:31:08 Waiting for app: TestExipryReplace to get un-deployed
2021/12/24 18:31:13 Waiting for app: TestExipryReplace to get un-deployed
2021/12/24 18:31:13 App: TestExipryReplace got un-deployed
2021/12/24 18:31:13 No eventing-con process running
2021/12/24 18:31:13 Function: TestExipryReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace deleting in background"
}
2021/12/24 18:31:15 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:31:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:31:22 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:31:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:31:27 Testing on the destination bucket for expiry insert
2021/12/24 18:31:27 Deploying app: TestExipryReplace. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:31:29 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace stored in temp store"
}
2021/12/24 18:31:34 Waiting for app: TestExipryReplace to get deployed
2021/12/24 18:31:39 Waiting for app: TestExipryReplace to get deployed
2021/12/24 18:31:44 Waiting for app: TestExipryReplace to get deployed
2021/12/24 18:31:49 Waiting for app: TestExipryReplace to get deployed
2021/12/24 18:31:49 App: TestExipryReplace got deployed
2021/12/24 18:31:49 Starting bucket ops to source bucket
2021/12/24 18:32:34 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:32:39 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:32:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:32:39 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:32:39 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:32:44 Waiting for app: TestExipryReplace to get un-deployed
2021/12/24 18:32:49 Waiting for app: TestExipryReplace to get un-deployed
2021/12/24 18:32:54 Waiting for app: TestExipryReplace to get un-deployed
2021/12/24 18:32:59 Waiting for app: TestExipryReplace to get un-deployed
2021/12/24 18:32:59 App: TestExipryReplace got un-deployed
2021/12/24 18:32:59 No eventing-con process running
2021/12/24 18:32:59 Function: TestExipryReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace deleting in background"
}
2021/12/24 18:33:01 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:33:11 Waiting for dst bucket item count to get to: 0 curr count: 85
2021/12/24 18:33:16 Waiting for dst bucket item count to get to: 0 curr count: 85
2021/12/24 18:33:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:33:17 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:33:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryReplace (220.71s)
=== RUN   TestExipryUpsert
2021/12/24 18:33:22 Deploying app: TestExipryUpsert. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:33:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert stored in temp store"
}
2021/12/24 18:33:29 Waiting for app: TestExipryUpsert to get deployed
2021/12/24 18:33:34 Waiting for app: TestExipryUpsert to get deployed
2021/12/24 18:33:39 Waiting for app: TestExipryUpsert to get deployed
2021/12/24 18:33:44 Waiting for app: TestExipryUpsert to get deployed
2021/12/24 18:33:44 App: TestExipryUpsert got deployed
2021/12/24 18:33:44 Starting bucket ops to source bucket
2021/12/24 18:34:29 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:34:34 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:34:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:34:34 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:34:34 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:34:39 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/24 18:34:44 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/24 18:34:49 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/24 18:34:54 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/24 18:34:54 App: TestExipryUpsert got un-deployed
2021/12/24 18:34:54 No eventing-con process running
2021/12/24 18:34:54 Function: TestExipryUpsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert deleting in background"
}
2021/12/24 18:34:56 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:35:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:35:03 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:35:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:35:08 Testing on the destination bucket for expiry insert
2021/12/24 18:35:08 Deploying app: TestExipryUpsert. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:35:09 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert stored in temp store"
}
2021/12/24 18:35:14 Waiting for app: TestExipryUpsert to get deployed
2021/12/24 18:35:19 Waiting for app: TestExipryUpsert to get deployed
2021/12/24 18:35:24 Waiting for app: TestExipryUpsert to get deployed
2021/12/24 18:35:29 Waiting for app: TestExipryUpsert to get deployed
2021/12/24 18:35:29 App: TestExipryUpsert got deployed
2021/12/24 18:35:29 Starting bucket ops to source bucket
2021/12/24 18:36:14 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:36:19 Waiting for dst bucket item count to get to: 0 curr count: 53
2021/12/24 18:36:24 Waiting for dst bucket item count to get to: 0 curr count: 3
2021/12/24 18:36:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:36:24 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:36:24 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:36:29 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/24 18:36:34 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/24 18:36:39 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/24 18:36:44 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/24 18:36:44 App: TestExipryUpsert got un-deployed
2021/12/24 18:36:44 No eventing-con process running
2021/12/24 18:36:45 Function: TestExipryUpsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert deleting in background"
}
2021/12/24 18:36:46 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:36:56 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:36:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:36:58 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:37:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryUpsert (220.60s)
=== RUN   TestCasReplace
2021/12/24 18:37:03 Deploying app: TestCasReplace. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:37:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace stored in temp store"
}
2021/12/24 18:37:09 Waiting for app: TestCasReplace to get deployed
2021/12/24 18:37:14 Waiting for app: TestCasReplace to get deployed
2021/12/24 18:37:19 Waiting for app: TestCasReplace to get deployed
2021/12/24 18:37:24 Waiting for app: TestCasReplace to get deployed
2021/12/24 18:37:24 App: TestCasReplace got deployed
2021/12/24 18:37:24 Starting bucket ops to source bucket
2021/12/24 18:37:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:37:24 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:37:25 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:37:30 Waiting for app: TestCasReplace to get un-deployed
2021/12/24 18:37:35 Waiting for app: TestCasReplace to get un-deployed
2021/12/24 18:37:40 Waiting for app: TestCasReplace to get un-deployed
2021/12/24 18:37:45 Waiting for app: TestCasReplace to get un-deployed
2021/12/24 18:37:45 App: TestCasReplace got un-deployed
2021/12/24 18:37:45 No eventing-con process running
2021/12/24 18:37:45 Function: TestCasReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace deleting in background"
}
2021/12/24 18:37:46 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:37:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:37:54 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:37:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:37:59 Testing on the destination bucket for upsert with cas
2021/12/24 18:37:59 Starting bucket ops to source bucket
2021/12/24 18:37:59 Deploying app: TestCasReplace. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:38:00 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace stored in temp store"
}
2021/12/24 18:38:05 Waiting for app: TestCasReplace to get deployed
2021/12/24 18:38:10 Waiting for app: TestCasReplace to get deployed
2021/12/24 18:38:15 Waiting for app: TestCasReplace to get deployed
2021/12/24 18:38:20 Waiting for app: TestCasReplace to get deployed
2021/12/24 18:38:20 App: TestCasReplace got deployed
2021/12/24 18:38:20 Starting bucket ops to source bucket
2021/12/24 18:38:25 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:38:30 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:38:35 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:38:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:38:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:38:35 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:38:40 Waiting for app: TestCasReplace to get un-deployed
2021/12/24 18:38:45 Waiting for app: TestCasReplace to get un-deployed
2021/12/24 18:38:50 Waiting for app: TestCasReplace to get un-deployed
2021/12/24 18:38:55 Waiting for app: TestCasReplace to get un-deployed
2021/12/24 18:38:55 App: TestCasReplace got un-deployed
2021/12/24 18:38:55 No eventing-con process running
2021/12/24 18:38:55 Function: TestCasReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace deleting in background"
}
2021/12/24 18:38:57 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:39:07 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:39:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:39:09 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:39:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCasReplace (130.80s)
=== RUN   TestCasDelete
2021/12/24 18:39:14 Deploying app: TestCasDelete. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:39:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete stored in temp store"
}
2021/12/24 18:39:20 Waiting for app: TestCasDelete to get deployed
2021/12/24 18:39:25 Waiting for app: TestCasDelete to get deployed
2021/12/24 18:39:30 Waiting for app: TestCasDelete to get deployed
2021/12/24 18:39:35 Waiting for app: TestCasDelete to get deployed
2021/12/24 18:39:35 App: TestCasDelete got deployed
2021/12/24 18:39:35 Starting bucket ops to source bucket
2021/12/24 18:39:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:39:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:39:35 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:39:40 Waiting for app: TestCasDelete to get un-deployed
2021/12/24 18:39:45 Waiting for app: TestCasDelete to get un-deployed
2021/12/24 18:39:50 Waiting for app: TestCasDelete to get un-deployed
2021/12/24 18:39:55 Waiting for app: TestCasDelete to get un-deployed
2021/12/24 18:39:55 App: TestCasDelete got un-deployed
2021/12/24 18:39:55 No eventing-con process running
2021/12/24 18:39:55 Function: TestCasDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete deleting in background"
}
2021/12/24 18:39:57 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:40:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:40:04 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:40:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:40:09 Testing on the destination bucket for delete with cas
2021/12/24 18:40:09 Starting bucket ops to source bucket
2021/12/24 18:40:10 Deploying app: TestCasDelete. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:40:11 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete stored in temp store"
}
2021/12/24 18:40:16 Waiting for app: TestCasDelete to get deployed
2021/12/24 18:40:21 Waiting for app: TestCasDelete to get deployed
2021/12/24 18:40:26 Waiting for app: TestCasDelete to get deployed
2021/12/24 18:40:31 Waiting for app: TestCasDelete to get deployed
2021/12/24 18:40:31 App: TestCasDelete got deployed
2021/12/24 18:40:31 Starting bucket ops to source bucket
2021/12/24 18:40:36 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:40:41 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:40:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:40:41 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:40:41 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 18:40:46 Waiting for app: TestCasDelete to get un-deployed
2021/12/24 18:40:51 Waiting for app: TestCasDelete to get un-deployed
2021/12/24 18:40:56 Waiting for app: TestCasDelete to get un-deployed
2021/12/24 18:41:01 Waiting for app: TestCasDelete to get un-deployed
2021/12/24 18:41:01 App: TestCasDelete got un-deployed
2021/12/24 18:41:01 No eventing-con process running
2021/12/24 18:41:01 Function: TestCasDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete deleting in background"
}
2021/12/24 18:41:03 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:41:13 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:41:18 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:41:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:41:19 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:41:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCasDelete (130.76s)
=== RUN   TestCountersIncrement
2021/12/24 18:41:25 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 18:41:30 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 18:41:31 Removing node(s): [] from the cluster
2021/12/24 18:41:36 Rebalance progress: 100
2021/12/24 18:41:36 Deploying app: TestCountersIncrement. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:41:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement stored in temp store"
}
2021/12/24 18:41:42 Waiting for app: TestCountersIncrement to get deployed
2021/12/24 18:41:47 Waiting for app: TestCountersIncrement to get deployed
2021/12/24 18:41:52 Waiting for app: TestCountersIncrement to get deployed
2021/12/24 18:41:57 Waiting for app: TestCountersIncrement to get deployed
2021/12/24 18:41:57 App: TestCountersIncrement got deployed
2021/12/24 18:41:57 Starting bucket ops to source bucket
2021/12/24 18:42:03 Waiting for dst bucket item count to get to: 1024 curr count: 0
2021/12/24 18:42:08 Waiting for dst bucket item count to get to: 1024 curr count: 512
2021/12/24 18:42:13 Waiting for dst bucket item count to get to: 1024 curr count: 512
2021/12/24 18:42:13 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2021/12/24 18:42:13 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:42:18 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/24 18:42:23 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/24 18:42:28 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/24 18:42:33 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/24 18:42:33 App: TestCountersIncrement got un-deployed
2021/12/24 18:42:33 No eventing-con process running
2021/12/24 18:42:33 Function: TestCountersIncrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement deleting in background"
}
2021/12/24 18:42:35 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:42:45 Waiting for dst bucket item count to get to: 0 curr count: 1025
2021/12/24 18:42:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:42:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:42:57 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/24 18:42:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:42:57 Deploying app: TestCountersIncrement. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:42:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement stored in temp store"
}
2021/12/24 18:43:03 Waiting for app: TestCountersIncrement to get deployed
2021/12/24 18:43:08 Waiting for app: TestCountersIncrement to get deployed
2021/12/24 18:43:13 Waiting for app: TestCountersIncrement to get deployed
2021/12/24 18:43:18 Waiting for app: TestCountersIncrement to get deployed
2021/12/24 18:43:18 App: TestCountersIncrement got deployed
2021/12/24 18:43:18 Starting bucket ops to source bucket
2021/12/24 18:43:24 Waiting for dst bucket item count to get to: 2048 curr count: 0
2021/12/24 18:43:29 Waiting for dst bucket item count to get to: 2048 curr count: 1024
2021/12/24 18:43:29 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2021/12/24 18:43:29 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:43:34 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/24 18:43:39 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/24 18:43:44 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/24 18:43:49 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/24 18:43:50 App: TestCountersIncrement got un-deployed
2021/12/24 18:43:50 No eventing-con process running
2021/12/24 18:43:50 Function: TestCountersIncrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement deleting in background"
}
2021/12/24 18:43:51 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:44:01 Waiting for dst bucket item count to get to: 0 curr count: 2048
2021/12/24 18:44:06 Waiting for dst bucket item count to get to: 0 curr count: 2048
2021/12/24 18:44:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:44:08 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:44:18 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/24 18:44:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:44:18 Removing node(s): [http://127.0.0.1:19002 http://127.0.0.1:19003] from the cluster
2021/12/24 18:44:23 Rebalance progress: 100
--- PASS: TestCountersIncrement (178.63s)
=== RUN   TestCountersDecrement
2021/12/24 18:44:23 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 18:44:24 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 18:44:24 Removing node(s): [] from the cluster
2021/12/24 18:44:29 Rebalance progress: 100
2021/12/24 18:44:29 Deploying app: TestCountersDecrement. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:44:30 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement stored in temp store"
}
2021/12/24 18:44:35 Waiting for app: TestCountersDecrement to get deployed
2021/12/24 18:44:40 Waiting for app: TestCountersDecrement to get deployed
2021/12/24 18:44:45 Waiting for app: TestCountersDecrement to get deployed
2021/12/24 18:44:50 Waiting for app: TestCountersDecrement to get deployed
2021/12/24 18:44:50 App: TestCountersDecrement got deployed
2021/12/24 18:44:50 Starting bucket ops to source bucket
2021/12/24 18:44:56 Waiting for dst bucket item count to get to: 1024 curr count: 0
2021/12/24 18:45:01 Waiting for dst bucket item count to get to: 1024 curr count: 0
2021/12/24 18:45:06 Waiting for dst bucket item count to get to: 1024 curr count: 512
2021/12/24 18:45:06 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2021/12/24 18:45:06 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:45:11 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/24 18:45:16 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/24 18:45:21 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/24 18:45:26 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/24 18:45:26 App: TestCountersDecrement got un-deployed
2021/12/24 18:45:26 No eventing-con process running
2021/12/24 18:45:27 Function: TestCountersDecrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement deleting in background"
}
2021/12/24 18:45:28 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:45:38 Waiting for dst bucket item count to get to: 0 curr count: 810
2021/12/24 18:45:43 Waiting for dst bucket item count to get to: 0 curr count: 297
2021/12/24 18:45:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:45:45 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:45:55 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/24 18:45:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:45:55 Deploying app: TestCountersDecrement. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:45:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement stored in temp store"
}
2021/12/24 18:46:01 Waiting for app: TestCountersDecrement to get deployed
2021/12/24 18:46:06 Waiting for app: TestCountersDecrement to get deployed
2021/12/24 18:46:11 Waiting for app: TestCountersDecrement to get deployed
2021/12/24 18:46:16 Waiting for app: TestCountersDecrement to get deployed
2021/12/24 18:46:16 App: TestCountersDecrement got deployed
2021/12/24 18:46:16 Starting bucket ops to source bucket
2021/12/24 18:46:22 Waiting for dst bucket item count to get to: 2048 curr count: 0
2021/12/24 18:46:27 Waiting for dst bucket item count to get to: 2048 curr count: 1842
2021/12/24 18:46:32 Waiting for dst bucket item count to get to: 2048 curr count: 1842
2021/12/24 18:46:32 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2021/12/24 18:46:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:46:38 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/24 18:46:43 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/24 18:46:48 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/24 18:46:53 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/24 18:46:53 App: TestCountersDecrement got un-deployed
2021/12/24 18:46:53 No eventing-con process running
2021/12/24 18:46:53 Function: TestCountersDecrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement deleting in background"
}
2021/12/24 18:46:54 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:47:04 Waiting for dst bucket item count to get to: 0 curr count: 2048
2021/12/24 18:47:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:47:06 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:47:16 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/24 18:47:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:47:16 Removing node(s): [http://127.0.0.1:19002 http://127.0.0.1:19003] from the cluster
2021/12/24 18:47:21 Rebalance progress: 100
--- PASS: TestCountersDecrement (178.08s)
=== RUN   TestCacheGet
2021/12/24 18:47:21 Deploying app: TestCacheGet. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:47:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheGet stored in temp store"
}
2021/12/24 18:47:28 Waiting for app: TestCacheGet to get deployed
2021/12/24 18:47:33 Waiting for app: TestCacheGet to get deployed
2021/12/24 18:47:38 Waiting for app: TestCacheGet to get deployed
2021/12/24 18:47:43 Waiting for app: TestCacheGet to get deployed
2021/12/24 18:47:43 App: TestCacheGet got deployed
2021/12/24 18:47:43 Starting bucket ops to source bucket
2021/12/24 18:47:48 Waiting for dst bucket item count to get to: 20 curr count: 0
2021/12/24 18:47:53 Waiting for dst bucket item count to get to: 20 curr count: 0
2021/12/24 18:47:58 Waiting for dst bucket item count to get to: 20 curr count: 0
2021/12/24 18:48:03 Waiting for dst bucket item count to get to: 20 curr count: 0
2021/12/24 18:48:08 Waiting for dst bucket item count to get to: 20 curr count: 16
2021/12/24 18:48:13 Waiting for dst bucket item count to get to: 20 curr count: 16
2021/12/24 18:48:13 src & dst bucket item count matched up. src bucket count: 20 dst bucket count: 20
2021/12/24 18:48:13 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:48:18 Waiting for app: TestCacheGet to get un-deployed
2021/12/24 18:48:23 Waiting for app: TestCacheGet to get un-deployed
2021/12/24 18:48:28 Waiting for app: TestCacheGet to get un-deployed
2021/12/24 18:48:33 Waiting for app: TestCacheGet to get un-deployed
2021/12/24 18:48:33 App: TestCacheGet got un-deployed
2021/12/24 18:48:33 No eventing-con process running
2021/12/24 18:48:33 Function: TestCacheGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheGet deleting in background"
}
2021/12/24 18:48:35 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:48:45 Waiting for dst bucket item count to get to: 0 curr count: 20
2021/12/24 18:48:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:48:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:48:57 Waiting for dst bucket item count to get to: 0 curr count: 20
2021/12/24 18:48:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheGet (95.39s)
=== RUN   TestCacheRYOW
2021/12/24 18:48:57 Deploying app: TestCacheRYOW. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:48:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheRYOW stored in temp store"
}
2021/12/24 18:49:03 Waiting for app: TestCacheRYOW to get deployed
2021/12/24 18:49:08 Waiting for app: TestCacheRYOW to get deployed
2021/12/24 18:49:13 Waiting for app: TestCacheRYOW to get deployed
2021/12/24 18:49:18 Waiting for app: TestCacheRYOW to get deployed
2021/12/24 18:49:18 App: TestCacheRYOW got deployed
2021/12/24 18:49:18 Starting bucket ops to source bucket
2021/12/24 18:49:23 Waiting for dst bucket item count to get to: 50 curr count: 0
2021/12/24 18:49:28 Waiting for dst bucket item count to get to: 50 curr count: 25
2021/12/24 18:49:33 Waiting for dst bucket item count to get to: 50 curr count: 25
2021/12/24 18:49:33 src & dst bucket item count matched up. src bucket count: 50 dst bucket count: 50
2021/12/24 18:49:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:49:38 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/24 18:49:43 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/24 18:49:48 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/24 18:49:53 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/24 18:49:53 App: TestCacheRYOW got un-deployed
2021/12/24 18:49:53 No eventing-con process running
2021/12/24 18:49:53 Function: TestCacheRYOW delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheRYOW deleting in background"
}
2021/12/24 18:49:55 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:50:05 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:50:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:50:07 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:50:17 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:50:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheRYOW (80.28s)
=== RUN   TestCacheExpiry
2021/12/24 18:50:17 Deploying app: TestCacheExpiry. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:50:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiry stored in temp store"
}
2021/12/24 18:50:23 Waiting for app: TestCacheExpiry to get deployed
2021/12/24 18:50:28 Waiting for app: TestCacheExpiry to get deployed
2021/12/24 18:50:33 Waiting for app: TestCacheExpiry to get deployed
2021/12/24 18:50:38 Waiting for app: TestCacheExpiry to get deployed
2021/12/24 18:50:38 App: TestCacheExpiry got deployed
2021/12/24 18:50:38 Starting bucket ops to source bucket
2021/12/24 18:50:43 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 18:50:48 Waiting for dst bucket item count to get to: 100 curr count: 3
2021/12/24 18:50:53 Waiting for dst bucket item count to get to: 100 curr count: 42
2021/12/24 18:50:58 Waiting for dst bucket item count to get to: 100 curr count: 86
2021/12/24 18:51:03 Waiting for dst bucket item count to get to: 100 curr count: 97
2021/12/24 18:51:03 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 18:51:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:51:09 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/24 18:51:14 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/24 18:51:19 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/24 18:51:24 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/24 18:51:24 App: TestCacheExpiry got un-deployed
2021/12/24 18:51:24 No eventing-con process running
2021/12/24 18:51:24 Function: TestCacheExpiry delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiry deleting in background"
}
2021/12/24 18:51:25 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:51:35 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:51:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:51:37 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:51:47 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:51:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheExpiry (90.27s)
=== RUN   TestCacheExpiryCustom
2021/12/24 18:51:47 Deploying app: TestCacheExpiryCustom. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:51:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiryCustom stored in temp store"
}
2021/12/24 18:51:53 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/24 18:51:58 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/24 18:52:03 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/24 18:52:08 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/24 18:52:09 App: TestCacheExpiryCustom got deployed
2021/12/24 18:52:09 Starting bucket ops to source bucket
2021/12/24 18:52:14 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 18:52:19 Waiting for dst bucket item count to get to: 100 curr count: 3
2021/12/24 18:52:24 Waiting for dst bucket item count to get to: 100 curr count: 42
2021/12/24 18:52:29 Waiting for dst bucket item count to get to: 100 curr count: 86
2021/12/24 18:52:34 Waiting for dst bucket item count to get to: 100 curr count: 97
2021/12/24 18:52:34 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 18:52:34 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:52:39 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/24 18:52:44 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/24 18:52:49 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/24 18:52:54 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/24 18:52:54 App: TestCacheExpiryCustom got un-deployed
2021/12/24 18:52:54 No eventing-con process running
2021/12/24 18:52:54 Function: TestCacheExpiryCustom delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiryCustom deleting in background"
}
2021/12/24 18:52:56 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:53:06 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:53:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:53:08 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:53:18 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:53:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheExpiryCustom (90.37s)
=== RUN   TestCacheOverflowCustom
2021/12/24 18:53:18 Deploying app: TestCacheOverflowCustom. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:53:19 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheOverflowCustom stored in temp store"
}
2021/12/24 18:53:24 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/24 18:53:29 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/24 18:53:34 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/24 18:53:39 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/24 18:53:39 App: TestCacheOverflowCustom got deployed
2021/12/24 18:53:39 Starting bucket ops to source bucket
2021/12/24 18:53:44 Waiting for dst bucket item count to get to: 35 curr count: 0
2021/12/24 18:53:49 Waiting for dst bucket item count to get to: 35 curr count: 0
2021/12/24 18:53:54 Waiting for dst bucket item count to get to: 35 curr count: 9
2021/12/24 18:53:59 Waiting for dst bucket item count to get to: 35 curr count: 20
2021/12/24 18:54:04 Waiting for dst bucket item count to get to: 35 curr count: 28
2021/12/24 18:54:09 Waiting for dst bucket item count to get to: 35 curr count: 34
2021/12/24 18:54:14 Waiting for dst bucket item count to get to: 35 curr count: 34
2021/12/24 18:54:14 src & dst bucket item count matched up. src bucket count: 35 dst bucket count: 35
2021/12/24 18:54:14 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:54:19 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/24 18:54:24 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/24 18:54:29 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/24 18:54:34 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/24 18:54:34 App: TestCacheOverflowCustom got un-deployed
2021/12/24 18:54:34 No eventing-con process running
2021/12/24 18:54:34 Function: TestCacheOverflowCustom delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheOverflowCustom deleting in background"
}
2021/12/24 18:54:36 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:54:46 Waiting for dst bucket item count to get to: 0 curr count: 5
2021/12/24 18:54:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:54:48 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:54:58 Waiting for dst bucket item count to get to: 0 curr count: 24
2021/12/24 18:55:03 Waiting for dst bucket item count to get to: 0 curr count: 6
2021/12/24 18:55:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheOverflowCustom (105.36s)
=== RUN   TestStrictMode
2021/12/24 18:55:03 Deploying app: TestStrictMode. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:55:04 Context: Post to main store, response code: 422 dump: {
 "name": "ERR_HANDLER_COMPILATION",
 "code": 27,
 "description": {
  "area": "handlerCode",
  "column_number": 63,
  "compile_success": false,
  "description": "        destination[meta.id] = 00000000000000000000000000000101;\n                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nSyntaxError: Octal literals are not allowed in strict mode.\n",
  "index": 132,
  "language": "JavaScript",
  "line_number": 4
 }
}
--- PASS: TestStrictMode (1.07s)
=== RUN   TestDataTypes
2021/12/24 18:55:04 Deploying app: TestDataTypes. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:55:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDataTypes stored in temp store"
}
2021/12/24 18:55:10 Waiting for app: TestDataTypes to get deployed
2021/12/24 18:55:15 Waiting for app: TestDataTypes to get deployed
2021/12/24 18:55:20 Waiting for app: TestDataTypes to get deployed
2021/12/24 18:55:25 Waiting for app: TestDataTypes to get deployed
2021/12/24 18:55:25 App: TestDataTypes got deployed
2021/12/24 18:55:25 Starting bucket ops to source bucket
2021/12/24 18:55:30 Waiting for dst bucket item count to get to: 18 curr count: 0
2021/12/24 18:55:35 Waiting for dst bucket item count to get to: 18 curr count: 8
2021/12/24 18:55:35 src & dst bucket item count matched up. src bucket count: 18 dst bucket count: 18
2021/12/24 18:55:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:55:40 Waiting for app: TestDataTypes to get un-deployed
2021/12/24 18:55:46 Waiting for app: TestDataTypes to get un-deployed
2021/12/24 18:55:51 Waiting for app: TestDataTypes to get un-deployed
2021/12/24 18:55:56 Waiting for app: TestDataTypes to get un-deployed
2021/12/24 18:55:56 App: TestDataTypes got un-deployed
2021/12/24 18:55:56 No eventing-con process running
2021/12/24 18:55:56 Function: TestDataTypes delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDataTypes deleting in background"
}
2021/12/24 18:55:57 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:56:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:56:05 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:56:15 Waiting for dst bucket item count to get to: 0 curr count: 18
2021/12/24 18:56:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDataTypes (70.80s)
=== RUN   TestEnoentGet
2021/12/24 18:56:15 Deploying app: TestEnoentGet. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:56:16 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet stored in temp store"
}
2021/12/24 18:56:21 Waiting for app: TestEnoentGet to get deployed
2021/12/24 18:56:26 Waiting for app: TestEnoentGet to get deployed
2021/12/24 18:56:31 Waiting for app: TestEnoentGet to get deployed
2021/12/24 18:56:36 Waiting for app: TestEnoentGet to get deployed
2021/12/24 18:56:36 App: TestEnoentGet got deployed
2021/12/24 18:56:36 Starting bucket ops to source bucket
2021/12/24 18:56:41 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 18:56:41 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 18:56:41 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:56:46 Waiting for app: TestEnoentGet to get un-deployed
2021/12/24 18:56:51 Waiting for app: TestEnoentGet to get un-deployed
2021/12/24 18:56:56 Waiting for app: TestEnoentGet to get un-deployed
2021/12/24 18:57:01 Waiting for app: TestEnoentGet to get un-deployed
2021/12/24 18:57:01 App: TestEnoentGet got un-deployed
2021/12/24 18:57:01 No eventing-con process running
2021/12/24 18:57:02 Function: TestEnoentGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet deleting in background"
}
2021/12/24 18:57:03 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:57:13 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:57:18 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:57:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:57:20 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:57:30 Waiting for dst bucket item count to get to: 0 curr count: 65
2021/12/24 18:57:35 Waiting for dst bucket item count to get to: 0 curr count: 65
2021/12/24 18:57:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:57:35 Deploying app: TestEnoentGet. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:57:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet stored in temp store"
}
2021/12/24 18:57:41 Waiting for app: TestEnoentGet to get deployed
2021/12/24 18:57:46 Waiting for app: TestEnoentGet to get deployed
2021/12/24 18:57:51 Waiting for app: TestEnoentGet to get deployed
2021/12/24 18:57:56 Waiting for app: TestEnoentGet to get deployed
2021/12/24 18:57:56 App: TestEnoentGet got deployed
2021/12/24 18:57:56 Starting bucket ops to source bucket
2021/12/24 18:58:01 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 18:58:01 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 18:58:01 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:58:07 Waiting for app: TestEnoentGet to get un-deployed
2021/12/24 18:58:12 Waiting for app: TestEnoentGet to get un-deployed
2021/12/24 18:58:17 Waiting for app: TestEnoentGet to get un-deployed
2021/12/24 18:58:22 Waiting for app: TestEnoentGet to get un-deployed
2021/12/24 18:58:22 App: TestEnoentGet got un-deployed
2021/12/24 18:58:22 No eventing-con process running
2021/12/24 18:58:22 Function: TestEnoentGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet deleting in background"
}
2021/12/24 18:58:23 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:58:33 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:58:38 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:58:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 18:58:40 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:58:50 Waiting for dst bucket item count to get to: 0 curr count: 76
2021/12/24 18:58:55 Waiting for dst bucket item count to get to: 0 curr count: 76
2021/12/24 18:58:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentGet (160.52s)
=== RUN   TestEnoentDelete
2021/12/24 18:58:55 Deploying app: TestEnoentDelete. Item count src bucket: 0 dst bucket: 0
2021/12/24 18:58:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete stored in temp store"
}
2021/12/24 18:59:01 Waiting for app: TestEnoentDelete to get deployed
2021/12/24 18:59:06 Waiting for app: TestEnoentDelete to get deployed
2021/12/24 18:59:11 Waiting for app: TestEnoentDelete to get deployed
2021/12/24 18:59:16 Waiting for app: TestEnoentDelete to get deployed
2021/12/24 18:59:16 App: TestEnoentDelete got deployed
2021/12/24 18:59:16 Starting bucket ops to source bucket
2021/12/24 18:59:22 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 18:59:22 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 18:59:22 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 18:59:27 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/24 18:59:32 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/24 18:59:37 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/24 18:59:42 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/24 18:59:42 App: TestEnoentDelete got un-deployed
2021/12/24 18:59:42 No eventing-con process running
2021/12/24 18:59:42 Function: TestEnoentDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete deleting in background"
}
2021/12/24 18:59:44 Context: Bucket flush, response code: 200 dump: 
2021/12/24 18:59:54 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 18:59:59 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 18:59:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:00:01 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:00:11 Waiting for dst bucket item count to get to: 0 curr count: 82
2021/12/24 19:00:16 Waiting for dst bucket item count to get to: 0 curr count: 82
2021/12/24 19:00:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:00:16 Deploying app: TestEnoentDelete. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:00:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete stored in temp store"
}
2021/12/24 19:00:22 Waiting for app: TestEnoentDelete to get deployed
2021/12/24 19:00:27 Waiting for app: TestEnoentDelete to get deployed
2021/12/24 19:00:32 Waiting for app: TestEnoentDelete to get deployed
2021/12/24 19:00:37 Waiting for app: TestEnoentDelete to get deployed
2021/12/24 19:00:37 App: TestEnoentDelete got deployed
2021/12/24 19:00:37 Starting bucket ops to source bucket
2021/12/24 19:00:42 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 19:00:42 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 19:00:42 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:00:47 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/24 19:00:52 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/24 19:00:57 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/24 19:01:02 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/24 19:01:02 App: TestEnoentDelete got un-deployed
2021/12/24 19:01:02 No eventing-con process running
2021/12/24 19:01:02 Function: TestEnoentDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete deleting in background"
}
2021/12/24 19:01:04 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:01:14 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 19:01:19 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 19:01:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:01:21 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:01:31 Waiting for dst bucket item count to get to: 0 curr count: 89
2021/12/24 19:01:36 Waiting for dst bucket item count to get to: 0 curr count: 89
2021/12/24 19:01:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentDelete (160.50s)
=== RUN   TestError
2021/12/24 19:01:46 Waiting for app: TestError to get un-deployed
2021/12/24 19:01:46 App: TestError got un-deployed
2021/12/24 19:01:46 No eventing-con process running
2021/12/24 19:01:46 Function: TestError delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestError not found"
}
2021/12/24 19:01:48 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:01:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:01:54 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:01:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:01:59 Deploying app: TestError. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:02:00 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestError stored in temp store"
}
2021/12/24 19:02:05 Waiting for app: TestError to get deployed
2021/12/24 19:02:10 Waiting for app: TestError to get deployed
2021/12/24 19:02:15 Waiting for app: TestError to get deployed
2021/12/24 19:02:20 Waiting for app: TestError to get deployed
2021/12/24 19:02:21 App: TestError got deployed
2021/12/24 19:02:21 Starting bucket ops to source bucket
2021/12/24 19:02:26 Waiting for dst bucket item count to get to: 300 curr count: 0
2021/12/24 19:02:31 Waiting for dst bucket item count to get to: 300 curr count: 0
2021/12/24 19:02:31 src & dst bucket item count matched up. src bucket count: 300 dst bucket count: 300
2021/12/24 19:02:31 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:02:36 Waiting for app: TestError to get un-deployed
2021/12/24 19:02:41 Waiting for app: TestError to get un-deployed
2021/12/24 19:02:46 Waiting for app: TestError to get un-deployed
2021/12/24 19:02:51 Waiting for app: TestError to get un-deployed
2021/12/24 19:02:51 App: TestError got un-deployed
2021/12/24 19:02:51 No eventing-con process running
2021/12/24 19:02:51 Function: TestError delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestError deleting in background"
}
2021/12/24 19:02:53 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:03:03 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 19:03:08 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/24 19:03:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:03:10 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:03:20 Waiting for dst bucket item count to get to: 0 curr count: 156
2021/12/24 19:03:25 Waiting for dst bucket item count to get to: 0 curr count: 156
2021/12/24 19:03:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestError (108.80s)
=== RUN   TestCRLF
2021/12/24 19:03:35 Waiting for app: TestCRLF to get un-deployed
2021/12/24 19:03:35 App: TestCRLF got un-deployed
2021/12/24 19:03:35 No eventing-con process running
2021/12/24 19:03:35 Function: TestCRLF delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCRLF not found"
}
2021/12/24 19:03:36 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:03:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:03:43 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:03:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:03:48 Deploying app: TestCRLF. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:03:49 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCRLF stored in temp store"
}
2021/12/24 19:03:54 Waiting for app: TestCRLF to get deployed
2021/12/24 19:03:59 Waiting for app: TestCRLF to get deployed
2021/12/24 19:04:04 Waiting for app: TestCRLF to get deployed
2021/12/24 19:04:09 Waiting for app: TestCRLF to get deployed
2021/12/24 19:04:09 App: TestCRLF got deployed
2021/12/24 19:04:09 Starting bucket ops to source bucket
2021/12/24 19:04:15 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 19:04:20 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 19:04:25 Waiting for dst bucket item count to get to: 100 curr count: 47
2021/12/24 19:04:25 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 19:04:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:04:30 Waiting for app: TestCRLF to get un-deployed
2021/12/24 19:04:35 Waiting for app: TestCRLF to get un-deployed
2021/12/24 19:04:40 Waiting for app: TestCRLF to get un-deployed
2021/12/24 19:04:45 Waiting for app: TestCRLF to get un-deployed
2021/12/24 19:04:45 App: TestCRLF got un-deployed
2021/12/24 19:04:45 No eventing-con process running
2021/12/24 19:04:45 Function: TestCRLF delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCRLF deleting in background"
}
2021/12/24 19:04:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:04:57 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 19:04:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:04:58 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:05:08 Waiting for dst bucket item count to get to: 0 curr count: 88
2021/12/24 19:05:13 Waiting for dst bucket item count to get to: 0 curr count: 35
2021/12/24 19:05:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCRLF (108.91s)
=== RUN   TestImportExport
2021/12/24 19:05:23 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/24 19:05:24 App: TestImportExport_n1ql_insert_on_update got un-deployed
2021/12/24 19:05:24 No eventing-con process running
2021/12/24 19:05:24 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestImportExport_n1ql_insert_on_update not found"
}
2021/12/24 19:05:25 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:05:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:05:32 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:05:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:05:42 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/24 19:05:42 App: TestImportExport_bucket_op_on_update got un-deployed
2021/12/24 19:05:42 No eventing-con process running
2021/12/24 19:05:42 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestImportExport_bucket_op_on_update not found"
}
2021/12/24 19:05:44 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:05:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:05:51 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:05:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:05:56 Deploying app: TestImportExport_n1ql_insert_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:05:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update stored in temp store"
}
2021/12/24 19:05:57 Deploying app: TestImportExport_bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:05:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update stored in temp store"
}
2021/12/24 19:06:03 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/24 19:06:08 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/24 19:06:13 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/24 19:06:18 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/24 19:06:18 App: TestImportExport_n1ql_insert_on_update got deployed
2021/12/24 19:06:23 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2021/12/24 19:06:28 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2021/12/24 19:06:33 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2021/12/24 19:06:33 App: TestImportExport_bucket_op_on_update got deployed
2021/12/24 19:06:38 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/24 19:06:43 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/24 19:06:48 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/24 19:06:53 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/24 19:06:54 App: TestImportExport_n1ql_insert_on_update got un-deployed
2021/12/24 19:06:54 No eventing-con process running
2021/12/24 19:06:54 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update deleting in background"
}
2021/12/24 19:06:59 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/24 19:07:04 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/24 19:07:09 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/24 19:07:14 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/24 19:07:14 App: TestImportExport_bucket_op_on_update got un-deployed
2021/12/24 19:07:14 No eventing-con process running
2021/12/24 19:07:14 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update deleting in background"
}
2021/12/24 19:07:31 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/24 19:07:31 App: TestImportExport_bucket_op_on_update got un-deployed
2021/12/24 19:07:31 No eventing-con process running
2021/12/24 19:07:31 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update deleting in background"
}
2021/12/24 19:07:33 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:07:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:07:40 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:07:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:07:50 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/24 19:07:50 App: TestImportExport_n1ql_insert_on_update got un-deployed
2021/12/24 19:07:50 No eventing-con process running
2021/12/24 19:07:50 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update deleting in background"
}
2021/12/24 19:07:52 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:07:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:07:58 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:08:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestImportExport (169.81s)
=== RUN   TestDeployUndeployLoopNonDefaultSettings
2021/12/24 19:08:13 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:08:13 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/24 19:08:13 No eventing-con process running
2021/12/24 19:08:13 Function: TestDeployUndeployLoopNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeployUndeployLoopNonDefaultSettings not found"
}
2021/12/24 19:08:15 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:08:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:08:22 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:08:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:08:27 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:08:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/24 19:08:28 Starting bucket ops to source bucket
2021/12/24 19:08:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:08:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:08:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:08:51 Waiting for dst bucket item count to get to: 5000 curr count: 75
2021/12/24 19:08:56 Waiting for dst bucket item count to get to: 5000 curr count: 75
2021/12/24 19:08:56 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:09:01 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/24 19:09:01 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/24 19:09:01 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:09:01 Undeploying app: bucket_op_on_update
2021/12/24 19:09:06 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:09:11 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:09:16 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:09:21 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:09:21 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/24 19:09:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:09:21 No eventing-con process running
2021/12/24 19:09:23 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:09:30 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:10:06 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:10:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/24 19:10:07 Starting bucket ops to source bucket
2021/12/24 19:10:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:10:20 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:10:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:10:30 Waiting for dst bucket item count to get to: 5000 curr count: 1410
2021/12/24 19:10:35 Waiting for dst bucket item count to get to: 5000 curr count: 1410
2021/12/24 19:10:35 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:10:40 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/24 19:10:40 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/24 19:10:40 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:10:40 Undeploying app: bucket_op_on_update
2021/12/24 19:10:45 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:10:50 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:10:55 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:11:00 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:11:00 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/24 19:11:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:11:00 No eventing-con process running
2021/12/24 19:11:02 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:11:09 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:11:44 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:11:45 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/24 19:11:45 Starting bucket ops to source bucket
2021/12/24 19:11:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:11:58 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:12:03 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:12:08 Waiting for dst bucket item count to get to: 5000 curr count: 3205
2021/12/24 19:12:13 Waiting for dst bucket item count to get to: 5000 curr count: 3205
2021/12/24 19:12:13 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:12:18 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/24 19:12:18 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/24 19:12:18 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:12:18 Undeploying app: bucket_op_on_update
2021/12/24 19:12:23 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:12:28 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:12:33 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:12:38 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:12:38 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/24 19:12:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:12:38 No eventing-con process running
2021/12/24 19:12:40 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:12:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:13:22 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:13:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/24 19:13:23 Starting bucket ops to source bucket
2021/12/24 19:13:31 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:13:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:13:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:13:46 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/24 19:13:46 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:13:51 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/24 19:13:51 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/24 19:13:51 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:13:51 Undeploying app: bucket_op_on_update
2021/12/24 19:13:56 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:14:01 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:14:06 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:14:11 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:14:11 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/24 19:14:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:14:11 No eventing-con process running
2021/12/24 19:14:13 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:14:20 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:14:55 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:14:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/24 19:14:57 Starting bucket ops to source bucket
2021/12/24 19:15:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:15:10 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:15:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:15:20 Waiting for dst bucket item count to get to: 5000 curr count: 1357
2021/12/24 19:15:25 Waiting for dst bucket item count to get to: 5000 curr count: 1357
2021/12/24 19:15:25 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:15:30 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/24 19:15:30 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/24 19:15:30 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:15:30 Undeploying app: bucket_op_on_update
2021/12/24 19:15:35 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:15:40 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:15:45 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:15:50 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/24 19:15:50 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/24 19:15:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:15:50 No eventing-con process running
2021/12/24 19:15:52 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:15:59 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:16:34 Function: TestDeployUndeployLoopNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings deleting in background"
}
--- PASS: TestDeployUndeployLoopNonDefaultSettings (510.57s)
=== RUN   TestOnUpdateN1QLOp
2021/12/24 19:16:44 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/24 19:16:44 App: TestOnUpdateN1QLOp got un-deployed
2021/12/24 19:16:44 No eventing-con process running
2021/12/24 19:16:44 Function: TestOnUpdateN1QLOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateN1QLOp not found"
}
2021/12/24 19:16:46 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:16:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:16:52 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:16:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:16:57 Deploying app: TestOnUpdateN1QLOp. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:16:59 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateN1QLOp stored in temp store"
}
2021/12/24 19:16:59 Starting bucket ops to source bucket
2021/12/24 19:17:06 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:17:11 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:17:16 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:17:21 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:17:27 Waiting for dst bucket item count to get to: 5000 curr count: 2544
2021/12/24 19:17:27 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:17:27 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:17:32 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/24 19:17:37 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/24 19:17:42 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/24 19:17:47 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/24 19:17:47 App: TestOnUpdateN1QLOp got un-deployed
2021/12/24 19:17:47 No eventing-con process running
2021/12/24 19:17:47 Function: TestOnUpdateN1QLOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateN1QLOp deleting in background"
}
2021/12/24 19:17:49 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:17:59 Waiting for dst bucket item count to get to: 0 curr count: 4455
2021/12/24 19:18:04 Waiting for dst bucket item count to get to: 0 curr count: 1955
2021/12/24 19:18:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:18:05 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:18:15 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 19:18:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateN1QLOp (101.56s)
=== RUN   TestOnUpdateBucketOpDefaultSettings
2021/12/24 19:18:25 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/24 19:18:25 App: TestOnUpdateBucketOpDefaultSettings got un-deployed
2021/12/24 19:18:25 No eventing-con process running
2021/12/24 19:18:25 Function: TestOnUpdateBucketOpDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings not found"
}
2021/12/24 19:18:27 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:18:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:18:34 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:18:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:18:39 Deploying app: TestOnUpdateBucketOpDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:18:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings stored in temp store"
}
2021/12/24 19:18:40 Starting bucket ops to source bucket
2021/12/24 19:18:48 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:18:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:18:58 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:19:03 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:19:08 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/24 19:19:08 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:19:08 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:19:13 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/24 19:19:18 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/24 19:19:23 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/24 19:19:28 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/24 19:19:28 App: TestOnUpdateBucketOpDefaultSettings got un-deployed
2021/12/24 19:19:28 No eventing-con process running
2021/12/24 19:19:28 Function: TestOnUpdateBucketOpDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings deleting in background"
}
2021/12/24 19:19:30 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:19:40 Waiting for dst bucket item count to get to: 0 curr count: 3055
2021/12/24 19:19:45 Waiting for dst bucket item count to get to: 0 curr count: 3055
2021/12/24 19:19:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:19:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:19:57 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 19:19:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings (101.36s)
=== RUN   TestOnUpdateBucketOpNonDefaultSettings
2021/12/24 19:20:07 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 19:20:07 App: TestOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/24 19:20:07 No eventing-con process running
2021/12/24 19:20:07 Function: TestOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpNonDefaultSettings not found"
}
2021/12/24 19:20:09 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:20:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:20:15 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:20:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:20:20 Deploying app: TestOnUpdateBucketOpNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:20:21 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpNonDefaultSettings stored in temp store"
}
2021/12/24 19:20:21 Starting bucket ops to source bucket
2021/12/24 19:20:29 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:20:34 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:20:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:20:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:20:45 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:20:45 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:20:50 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 19:20:55 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 19:21:00 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 19:21:05 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 19:21:05 App: TestOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/24 19:21:05 No eventing-con process running
2021/12/24 19:21:05 Function: TestOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpNonDefaultSettings deleting in background"
}
2021/12/24 19:21:07 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:21:17 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 19:21:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:21:18 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:21:28 Waiting for dst bucket item count to get to: 0 curr count: 4168
2021/12/24 19:21:33 Waiting for dst bucket item count to get to: 0 curr count: 1668
2021/12/24 19:21:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpNonDefaultSettings (96.60s)
=== RUN   TestOnUpdateBucketOpDefaultSettings10K
2021/12/24 19:21:43 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/24 19:21:43 App: TestOnUpdateBucketOpDefaultSettings10K got un-deployed
2021/12/24 19:21:43 No eventing-con process running
2021/12/24 19:21:43 Function: TestOnUpdateBucketOpDefaultSettings10K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings10K not found"
}
2021/12/24 19:21:45 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:21:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:21:52 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:21:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:21:57 Deploying app: TestOnUpdateBucketOpDefaultSettings10K. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:21:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings10K stored in temp store"
}
2021/12/24 19:21:58 Starting bucket ops to source bucket
2021/12/24 19:22:06 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:22:11 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:22:16 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:22:21 Waiting for dst bucket item count to get to: 5000 curr count: 54
2021/12/24 19:22:26 Waiting for dst bucket item count to get to: 5000 curr count: 54
2021/12/24 19:22:26 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:22:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:22:31 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/24 19:22:36 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/24 19:22:41 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/24 19:22:46 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/24 19:22:46 App: TestOnUpdateBucketOpDefaultSettings10K got un-deployed
2021/12/24 19:22:46 No eventing-con process running
2021/12/24 19:22:46 Function: TestOnUpdateBucketOpDefaultSettings10K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings10K deleting in background"
}
2021/12/24 19:22:48 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:22:58 Waiting for dst bucket item count to get to: 0 curr count: 3548
2021/12/24 19:23:03 Waiting for dst bucket item count to get to: 0 curr count: 1048
2021/12/24 19:23:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:23:05 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:23:15 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 19:23:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings10K (101.59s)
=== RUN   TestOnUpdateBucketOpDefaultSettings100K
2021/12/24 19:23:25 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/24 19:23:25 App: TestOnUpdateBucketOpDefaultSettings100K got un-deployed
2021/12/24 19:23:25 No eventing-con process running
2021/12/24 19:23:25 Function: TestOnUpdateBucketOpDefaultSettings100K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings100K not found"
}
2021/12/24 19:23:27 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:23:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:23:33 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:23:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:23:38 Deploying app: TestOnUpdateBucketOpDefaultSettings100K. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:23:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings100K stored in temp store"
}
2021/12/24 19:23:40 Starting bucket ops to source bucket
2021/12/24 19:23:48 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:23:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:23:58 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:24:03 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:24:08 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/24 19:24:08 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:24:08 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:24:13 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/24 19:24:18 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/24 19:24:23 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/24 19:24:28 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/24 19:24:28 App: TestOnUpdateBucketOpDefaultSettings100K got un-deployed
2021/12/24 19:24:28 No eventing-con process running
2021/12/24 19:24:28 Function: TestOnUpdateBucketOpDefaultSettings100K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings100K deleting in background"
}
2021/12/24 19:24:30 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:24:40 Waiting for dst bucket item count to get to: 0 curr count: 3407
2021/12/24 19:24:45 Waiting for dst bucket item count to get to: 0 curr count: 3407
2021/12/24 19:24:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:24:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:24:57 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 19:24:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings100K (102.04s)
=== RUN   TestOnDeleteBucketOp
2021/12/24 19:25:07 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/24 19:25:07 App: TestOnDeleteBucketOp got un-deployed
2021/12/24 19:25:07 No eventing-con process running
2021/12/24 19:25:07 Function: TestOnDeleteBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteBucketOp not found"
}
2021/12/24 19:25:09 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:25:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:25:16 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:25:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:25:21 Deploying app: TestOnDeleteBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:25:22 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp stored in temp store"
}
2021/12/24 19:25:22 Starting bucket ops to source bucket
2021/12/24 19:25:33 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:25:38 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:25:43 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:25:43 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:25:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:25:48 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/24 19:25:53 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/24 19:25:58 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/24 19:26:03 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/24 19:26:03 App: TestOnDeleteBucketOp got un-deployed
2021/12/24 19:26:03 No eventing-con process running
2021/12/24 19:26:03 Function: TestOnDeleteBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp deleting in background"
}
2021/12/24 19:26:04 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:26:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:26:12 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:26:22 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 19:26:27 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 19:26:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteBucketOp (89.76s)
=== RUN   TestOnDeleteBucketOp5K
2021/12/24 19:26:37 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/24 19:26:37 App: TestOnDeleteBucketOp5K got un-deployed
2021/12/24 19:26:37 No eventing-con process running
2021/12/24 19:26:37 Function: TestOnDeleteBucketOp5K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteBucketOp5K not found"
}
2021/12/24 19:26:39 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:26:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:26:45 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:26:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:26:50 Deploying app: TestOnDeleteBucketOp5K. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:26:52 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp5K stored in temp store"
}
2021/12/24 19:26:52 Starting bucket ops to source bucket
2021/12/24 19:27:02 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:27:07 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:27:12 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:27:12 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:27:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:27:17 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/24 19:27:22 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/24 19:27:27 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/24 19:27:32 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/24 19:27:32 App: TestOnDeleteBucketOp5K got un-deployed
2021/12/24 19:27:32 No eventing-con process running
2021/12/24 19:27:33 Function: TestOnDeleteBucketOp5K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp5K deleting in background"
}
2021/12/24 19:27:34 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:27:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:27:42 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:27:52 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 19:27:57 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 19:27:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteBucketOp5K (89.80s)
=== RUN   TestTimerBucketOp
2021/12/24 19:28:07 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/24 19:28:07 App: TestTimerBucketOp got un-deployed
2021/12/24 19:28:07 No eventing-con process running
2021/12/24 19:28:07 Function: TestTimerBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerBucketOp not found"
}
2021/12/24 19:28:08 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:28:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:28:15 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:28:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:28:20 Deploying app: TestTimerBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:28:21 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerBucketOp stored in temp store"
}
2021/12/24 19:28:21 Starting bucket ops to source bucket
2021/12/24 19:28:29 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:28:34 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:28:39 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:28:44 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:28:49 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:28:54 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:28:59 Waiting for dst bucket item count to get to: 5000 curr count: 1692
2021/12/24 19:29:04 Waiting for dst bucket item count to get to: 5000 curr count: 1692
2021/12/24 19:29:04 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:29:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:29:09 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/24 19:29:14 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/24 19:29:19 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/24 19:29:24 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/24 19:29:24 App: TestTimerBucketOp got un-deployed
2021/12/24 19:29:24 No eventing-con process running
2021/12/24 19:29:24 Function: TestTimerBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerBucketOp deleting in background"
}
2021/12/24 19:29:26 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:29:36 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 19:29:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:29:38 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:29:48 Waiting for dst bucket item count to get to: 0 curr count: 3273
2021/12/24 19:29:53 Waiting for dst bucket item count to get to: 0 curr count: 773
2021/12/24 19:29:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerBucketOp (116.33s)
=== RUN   TestTimerInPastBucketOp
2021/12/24 19:30:03 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/24 19:30:03 App: TestTimerInPastBucketOp got un-deployed
2021/12/24 19:30:03 No eventing-con process running
2021/12/24 19:30:03 Function: TestTimerInPastBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerInPastBucketOp not found"
}
2021/12/24 19:30:05 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:30:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:30:11 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:30:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:30:16 Deploying app: TestTimerInPastBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:30:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerInPastBucketOp stored in temp store"
}
2021/12/24 19:30:18 Starting bucket ops to source bucket
2021/12/24 19:30:26 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:30:31 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:30:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:30:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:30:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:30:51 Waiting for dst bucket item count to get to: 5000 curr count: 687
2021/12/24 19:30:56 Waiting for dst bucket item count to get to: 5000 curr count: 687
2021/12/24 19:30:56 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:30:56 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:31:01 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/24 19:31:06 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/24 19:31:11 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/24 19:31:16 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/24 19:31:16 App: TestTimerInPastBucketOp got un-deployed
2021/12/24 19:31:16 No eventing-con process running
2021/12/24 19:31:16 Function: TestTimerInPastBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerInPastBucketOp deleting in background"
}
2021/12/24 19:31:18 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:31:28 Waiting for dst bucket item count to get to: 0 curr count: 2702
2021/12/24 19:31:33 Waiting for dst bucket item count to get to: 0 curr count: 202
2021/12/24 19:31:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:31:35 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:31:45 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 19:31:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerInPastBucketOp (111.67s)
=== RUN   TestDeployUndeployLoopTimer
2021/12/24 19:31:55 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:31:55 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/24 19:31:55 No eventing-con process running
2021/12/24 19:31:55 Function: TestDeployUndeployLoopTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeployUndeployLoopTimer not found"
}
2021/12/24 19:31:56 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:32:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:32:03 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:32:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:32:08 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:32:09 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/24 19:32:09 Starting bucket ops to source bucket
2021/12/24 19:32:17 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:32:22 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:32:27 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:32:32 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:32:37 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:32:42 Waiting for dst bucket item count to get to: 5000 curr count: 572
2021/12/24 19:32:47 Waiting for dst bucket item count to get to: 5000 curr count: 2457
2021/12/24 19:32:52 Waiting for dst bucket item count to get to: 5000 curr count: 4385
2021/12/24 19:32:52 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:32:57 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/24 19:32:57 App: TestDeployUndeployLoopTimer got deployed
2021/12/24 19:32:57 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:32:57 Undeploying app: bucket_op_with_timer
2021/12/24 19:33:02 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:33:08 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:33:13 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:33:18 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:33:18 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/24 19:33:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:33:18 No eventing-con process running
2021/12/24 19:33:19 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:33:27 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:34:02 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:34:03 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/24 19:34:03 Starting bucket ops to source bucket
2021/12/24 19:34:11 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:34:16 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:34:21 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:34:26 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:34:31 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:34:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:34:41 Waiting for dst bucket item count to get to: 5000 curr count: 134
2021/12/24 19:34:46 Waiting for dst bucket item count to get to: 5000 curr count: 2634
2021/12/24 19:34:46 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:34:51 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/24 19:34:51 App: TestDeployUndeployLoopTimer got deployed
2021/12/24 19:34:51 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:34:51 Undeploying app: bucket_op_with_timer
2021/12/24 19:34:56 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:35:01 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:35:06 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:35:11 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:35:11 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/24 19:35:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:35:11 No eventing-con process running
2021/12/24 19:35:13 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:35:20 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:35:55 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:35:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/24 19:35:56 Starting bucket ops to source bucket
2021/12/24 19:36:04 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:36:09 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:36:14 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:36:19 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:36:24 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:36:29 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:36:34 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:36:34 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:36:39 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/24 19:36:39 App: TestDeployUndeployLoopTimer got deployed
2021/12/24 19:36:39 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:36:39 Undeploying app: bucket_op_with_timer
2021/12/24 19:36:44 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:36:49 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:36:54 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:36:59 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:36:59 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/24 19:36:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:36:59 No eventing-con process running
2021/12/24 19:37:01 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:37:08 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:37:43 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:37:45 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/24 19:37:45 Starting bucket ops to source bucket
2021/12/24 19:37:52 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:37:57 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:38:02 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:38:07 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:38:12 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:38:17 Waiting for dst bucket item count to get to: 5000 curr count: 689
2021/12/24 19:38:22 Waiting for dst bucket item count to get to: 5000 curr count: 1896
2021/12/24 19:38:22 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:38:27 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/24 19:38:27 App: TestDeployUndeployLoopTimer got deployed
2021/12/24 19:38:27 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:38:28 Undeploying app: bucket_op_with_timer
2021/12/24 19:38:33 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:38:38 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:38:43 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:38:48 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:38:48 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/24 19:38:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:38:48 No eventing-con process running
2021/12/24 19:38:49 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:38:57 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:39:32 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:39:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/24 19:39:33 Starting bucket ops to source bucket
2021/12/24 19:39:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:39:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:39:51 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:39:56 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:40:01 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:40:06 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:40:11 Waiting for dst bucket item count to get to: 5000 curr count: 95
2021/12/24 19:40:16 Waiting for dst bucket item count to get to: 5000 curr count: 2595
2021/12/24 19:40:16 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:40:21 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/24 19:40:21 App: TestDeployUndeployLoopTimer got deployed
2021/12/24 19:40:21 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:40:21 Undeploying app: bucket_op_with_timer
2021/12/24 19:40:26 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:40:31 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:40:36 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:40:41 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/24 19:40:41 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/24 19:40:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:40:41 No eventing-con process running
2021/12/24 19:40:43 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:40:50 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:41:25 Function: TestDeployUndeployLoopTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer deleting in background"
}
--- PASS: TestDeployUndeployLoopTimer (580.45s)
=== RUN   TestMultipleHandlers
2021/12/24 19:41:35 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/24 19:41:35 App: TestMultipleHandlers_bucket_op_on_update got un-deployed
2021/12/24 19:41:35 No eventing-con process running
2021/12/24 19:41:35 Function: TestMultipleHandlers_bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMultipleHandlers_bucket_op_on_update not found"
}
2021/12/24 19:41:37 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:41:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:41:44 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:41:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:41:54 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/24 19:41:54 App: TestMultipleHandlers_bucket_op_on_delete got un-deployed
2021/12/24 19:41:54 No eventing-con process running
2021/12/24 19:41:54 Function: TestMultipleHandlers_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMultipleHandlers_bucket_op_on_delete not found"
}
2021/12/24 19:41:55 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:42:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:42:02 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:42:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:42:07 Deploying app: TestMultipleHandlers_bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:42:08 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_update stored in temp store"
}
2021/12/24 19:42:08 Deploying app: TestMultipleHandlers_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:42:10 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_delete stored in temp store"
}
2021/12/24 19:42:15 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/24 19:42:20 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/24 19:42:25 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/24 19:42:30 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/24 19:42:30 App: TestMultipleHandlers_bucket_op_on_update got deployed
2021/12/24 19:42:35 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2021/12/24 19:42:40 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2021/12/24 19:42:45 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2021/12/24 19:42:45 App: TestMultipleHandlers_bucket_op_on_delete got deployed
2021/12/24 19:42:45 Starting bucket ops to source bucket
2021/12/24 19:42:55 Waiting for dst bucket item count to get to: 5000 curr count: 1158
2021/12/24 19:43:00 Waiting for dst bucket item count to get to: 5000 curr count: 3406
2021/12/24 19:43:05 Waiting for dst bucket item count to get to: 5000 curr count: 4748
2021/12/24 19:43:05 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:43:05 Starting bucket ops to source bucket
2021/12/24 19:43:20 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 19:43:25 Waiting for dst bucket item count to get to: 10000 curr count: 7504
2021/12/24 19:43:25 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 19:43:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:43:25 Function: TestMultipleHandlers_bucket_op_on_update update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:43:25 Function: TestMultipleHandlers_bucket_op_on_delete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:43:30 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/24 19:43:35 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/24 19:43:40 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/24 19:43:45 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/24 19:43:45 App: TestMultipleHandlers_bucket_op_on_update got un-deployed
2021/12/24 19:43:45 No eventing-con process running
2021/12/24 19:43:45 Function: TestMultipleHandlers_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_update deleting in background"
}
2021/12/24 19:43:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:43:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:43:54 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:44:04 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/24 19:44:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:44:09 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/24 19:44:15 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/24 19:44:20 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/24 19:44:25 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/24 19:44:25 App: TestMultipleHandlers_bucket_op_on_delete got un-deployed
2021/12/24 19:44:25 No eventing-con process running
2021/12/24 19:44:25 Function: TestMultipleHandlers_bucket_op_on_delete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_delete deleting in background"
}
2021/12/24 19:44:26 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:44:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:44:33 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:44:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMultipleHandlers (193.12s)
=== RUN   TestPauseResumeLoopDefaultSettings
2021/12/24 19:44:48 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/24 19:44:48 App: TestPauseResumeLoopDefaultSettings got un-deployed
2021/12/24 19:44:48 No eventing-con process running
2021/12/24 19:44:48 Function: TestPauseResumeLoopDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeLoopDefaultSettings not found"
}
2021/12/24 19:44:50 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:44:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:44:57 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:45:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:45:02 Deploying app: TestPauseResumeLoopDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:45:03 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopDefaultSettings stored in temp store"
}
2021/12/24 19:45:03 Starting bucket ops to source bucket
2021/12/24 19:45:11 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:45:16 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:45:21 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:45:26 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:45:26 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:45:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:45:31 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/24 19:45:31 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/24 19:45:31 Pausing app: bucket_op_on_update
2021/12/24 19:45:31 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:45:36 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/24 19:45:36 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/24 19:45:36 Resuming app: bucket_op_on_update
2021/12/24 19:45:37 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:45:37 Starting bucket ops to source bucket
2021/12/24 19:45:45 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 19:45:50 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 19:45:55 Waiting for dst bucket item count to get to: 10000 curr count: 7500
2021/12/24 19:45:55 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 19:45:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:46:00 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/24 19:46:00 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/24 19:46:00 Pausing app: bucket_op_on_update
2021/12/24 19:46:00 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:46:05 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/24 19:46:05 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/24 19:46:05 Resuming app: bucket_op_on_update
2021/12/24 19:46:07 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:46:07 Starting bucket ops to source bucket
2021/12/24 19:46:15 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/24 19:46:20 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/24 19:46:25 Waiting for dst bucket item count to get to: 15000 curr count: 12500
2021/12/24 19:46:25 src & dst bucket item count matched up. src bucket count: 15000 dst bucket count: 15000
2021/12/24 19:46:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:46:30 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/24 19:46:30 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/24 19:46:30 Pausing app: bucket_op_on_update
2021/12/24 19:46:30 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:46:35 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/24 19:46:35 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/24 19:46:35 Resuming app: bucket_op_on_update
2021/12/24 19:46:36 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:46:36 Starting bucket ops to source bucket
2021/12/24 19:46:44 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/24 19:46:49 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/24 19:46:54 Waiting for dst bucket item count to get to: 20000 curr count: 17500
2021/12/24 19:46:54 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2021/12/24 19:46:54 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:46:59 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/24 19:46:59 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/24 19:46:59 Pausing app: bucket_op_on_update
2021/12/24 19:46:59 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:47:04 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/24 19:47:04 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/24 19:47:04 Resuming app: bucket_op_on_update
2021/12/24 19:47:05 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:47:05 Starting bucket ops to source bucket
2021/12/24 19:47:13 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/24 19:47:18 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/24 19:47:23 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/24 19:47:28 Waiting for dst bucket item count to get to: 25000 curr count: 22500
2021/12/24 19:47:28 src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2021/12/24 19:47:28 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:47:33 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/24 19:47:33 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/24 19:47:33 Pausing app: bucket_op_on_update
2021/12/24 19:47:34 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:47:39 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/24 19:47:39 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/24 19:47:44 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/24 19:47:49 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/24 19:47:54 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/24 19:47:59 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/24 19:47:59 App: TestPauseResumeLoopDefaultSettings got un-deployed
2021/12/24 19:47:59 No eventing-con process running
2021/12/24 19:47:59 Function: TestPauseResumeLoopDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopDefaultSettings deleting in background"
}
2021/12/24 19:48:01 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:48:11 Waiting for dst bucket item count to get to: 0 curr count: 20852
2021/12/24 19:48:16 Waiting for dst bucket item count to get to: 0 curr count: 20852
2021/12/24 19:48:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:48:17 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:48:27 Waiting for dst bucket item count to get to: 0 curr count: 12500
2021/12/24 19:48:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeLoopDefaultSettings (229.27s)
=== RUN   TestPauseResumeLoopNonDefaultSettings
2021/12/24 19:48:37 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/24 19:48:37 App: TestPauseResumeLoopNonDefaultSettings got un-deployed
2021/12/24 19:48:37 No eventing-con process running
2021/12/24 19:48:37 Function: TestPauseResumeLoopNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeLoopNonDefaultSettings not found"
}
2021/12/24 19:48:39 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:48:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:48:46 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:48:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:48:51 Deploying app: TestPauseResumeLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:48:52 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopNonDefaultSettings stored in temp store"
}
2021/12/24 19:48:52 Starting bucket ops to source bucket
2021/12/24 19:49:00 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:49:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:49:10 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:49:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:49:20 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:49:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:49:30 Waiting for dst bucket item count to get to: 5000 curr count: 1295
2021/12/24 19:49:35 Waiting for dst bucket item count to get to: 5000 curr count: 1295
2021/12/24 19:49:35 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:49:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:49:40 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/24 19:49:40 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/24 19:49:40 Pausing app: bucket_op_with_timer
2021/12/24 19:49:40 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:49:45 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/24 19:49:45 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/24 19:49:45 Resuming app: bucket_op_with_timer
2021/12/24 19:49:46 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:49:46 Starting bucket ops to source bucket
2021/12/24 19:49:54 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 19:49:59 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 19:50:04 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 19:50:09 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 19:50:14 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 19:50:19 Waiting for dst bucket item count to get to: 10000 curr count: 7336
2021/12/24 19:50:24 Waiting for dst bucket item count to get to: 10000 curr count: 7336
2021/12/24 19:50:24 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 19:50:24 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:50:29 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/24 19:50:29 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/24 19:50:29 Pausing app: bucket_op_with_timer
2021/12/24 19:50:30 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:50:35 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/24 19:50:35 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/24 19:50:35 Resuming app: bucket_op_with_timer
2021/12/24 19:50:36 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:50:36 Starting bucket ops to source bucket
2021/12/24 19:50:44 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/24 19:50:49 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/24 19:50:54 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/24 19:50:59 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/24 19:51:04 Waiting for dst bucket item count to get to: 15000 curr count: 10284
2021/12/24 19:51:09 Waiting for dst bucket item count to get to: 15000 curr count: 12784
2021/12/24 19:51:09 src & dst bucket item count matched up. src bucket count: 15000 dst bucket count: 15000
2021/12/24 19:51:09 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:51:14 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/24 19:51:14 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/24 19:51:14 Pausing app: bucket_op_with_timer
2021/12/24 19:51:14 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:51:19 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/24 19:51:19 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/24 19:51:19 Resuming app: bucket_op_with_timer
2021/12/24 19:51:20 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:51:20 Starting bucket ops to source bucket
2021/12/24 19:51:28 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/24 19:51:33 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/24 19:51:38 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/24 19:51:43 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/24 19:51:48 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/24 19:51:53 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/24 19:51:58 Waiting for dst bucket item count to get to: 20000 curr count: 17500
2021/12/24 19:51:58 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2021/12/24 19:51:58 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:52:03 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/24 19:52:03 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/24 19:52:03 Pausing app: bucket_op_with_timer
2021/12/24 19:52:03 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:52:08 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/24 19:52:08 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/24 19:52:08 Resuming app: bucket_op_with_timer
2021/12/24 19:52:09 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:52:09 Starting bucket ops to source bucket
2021/12/24 19:52:17 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/24 19:52:22 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/24 19:52:27 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/24 19:52:32 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/24 19:52:37 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/24 19:52:42 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/24 19:52:47 Waiting for dst bucket item count to get to: 25000 curr count: 22500
2021/12/24 19:52:47 src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2021/12/24 19:52:47 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:52:52 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/24 19:52:52 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/24 19:52:52 Pausing app: bucket_op_with_timer
2021/12/24 19:52:53 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:52:58 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/24 19:52:58 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/24 19:53:03 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/24 19:53:08 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/24 19:53:13 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/24 19:53:18 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/24 19:53:18 App: TestPauseResumeLoopNonDefaultSettings got un-deployed
2021/12/24 19:53:18 No eventing-con process running
2021/12/24 19:53:18 Function: TestPauseResumeLoopNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopNonDefaultSettings deleting in background"
}
2021/12/24 19:53:19 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:53:29 Waiting for dst bucket item count to get to: 0 curr count: 12500
2021/12/24 19:53:34 Waiting for dst bucket item count to get to: 0 curr count: 12500
2021/12/24 19:53:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:53:36 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:53:46 Waiting for dst bucket item count to get to: 0 curr count: 25000
2021/12/24 19:53:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeLoopNonDefaultSettings (318.84s)
=== RUN   TestPauseAndResumeWithWorkerCountChange
2021/12/24 19:53:56 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/24 19:53:56 App: TestPauseAndResumeWithWorkerCountChange got un-deployed
2021/12/24 19:53:56 No eventing-con process running
2021/12/24 19:53:56 Function: TestPauseAndResumeWithWorkerCountChange delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseAndResumeWithWorkerCountChange not found"
}
2021/12/24 19:53:58 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:54:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:54:05 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:54:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:54:10 Deploying app: TestPauseAndResumeWithWorkerCountChange. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:54:11 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseAndResumeWithWorkerCountChange stored in temp store"
}
2021/12/24 19:54:16 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/24 19:54:21 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/24 19:54:26 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/24 19:54:31 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/24 19:54:31 App: TestPauseAndResumeWithWorkerCountChange got deployed
2021/12/24 19:54:31 Starting bucket ops to source bucket
2021/12/24 19:54:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:54:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:54:50 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:54:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:55:00 Waiting for dst bucket item count to get to: 5000 curr count: 490
2021/12/24 19:55:05 Waiting for dst bucket item count to get to: 5000 curr count: 490
2021/12/24 19:55:05 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:55:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:55:05 Pausing app: bucket_op_with_timer
2021/12/24 19:55:05 Function: TestPauseAndResumeWithWorkerCountChange update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:55:10 Waiting for function: TestPauseAndResumeWithWorkerCountChange status to change to paused
2021/12/24 19:55:10 Function: TestPauseAndResumeWithWorkerCountChange status changed to paused
2021/12/24 19:55:10 Resuming app: bucket_op_with_timer
2021/12/24 19:55:12 Function: TestPauseAndResumeWithWorkerCountChange update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:6] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:55:12 Starting bucket ops to source bucket
2021/12/24 19:55:23 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 19:55:28 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 19:55:33 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 19:55:38 Waiting for dst bucket item count to get to: 10000 curr count: 5179
2021/12/24 19:55:43 Waiting for dst bucket item count to get to: 10000 curr count: 5179
2021/12/24 19:55:48 Waiting for dst bucket item count to get to: 10000 curr count: 6948
2021/12/24 19:55:53 Waiting for dst bucket item count to get to: 10000 curr count: 6948
2021/12/24 19:55:53 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 19:55:58 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/24 19:56:03 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/24 19:56:08 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/24 19:56:13 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/24 19:56:13 App: TestPauseAndResumeWithWorkerCountChange got un-deployed
2021/12/24 19:56:13 No eventing-con process running
2021/12/24 19:56:13 Function: TestPauseAndResumeWithWorkerCountChange delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseAndResumeWithWorkerCountChange deleting in background"
}
2021/12/24 19:56:15 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:56:25 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/24 19:56:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:56:27 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:56:37 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/24 19:56:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseAndResumeWithWorkerCountChange (170.72s)
=== RUN   TestPauseResumeWithEventingReb
2021/12/24 19:56:47 Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/24 19:56:47 App: TestPauseResumeWithEventingReb got un-deployed
2021/12/24 19:56:47 No eventing-con process running
2021/12/24 19:56:47 Function: TestPauseResumeWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeWithEventingReb not found"
}
2021/12/24 19:56:49 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:56:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:56:56 Context: Bucket flush, response code: 200 dump: 
2021/12/24 19:57:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 19:57:01 Deploying app: TestPauseResumeWithEventingReb. Item count src bucket: 0 dst bucket: 0
2021/12/24 19:57:02 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeWithEventingReb stored in temp store"
}
2021/12/24 19:57:07 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/24 19:57:12 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/24 19:57:17 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/24 19:57:22 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/24 19:57:22 App: TestPauseResumeWithEventingReb got deployed
2021/12/24 19:57:22 Starting bucket ops to source bucket
2021/12/24 19:57:31 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:57:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:57:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:57:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 19:57:51 Waiting for dst bucket item count to get to: 5000 curr count: 4695
2021/12/24 19:57:56 Waiting for dst bucket item count to get to: 5000 curr count: 4695
2021/12/24 19:57:56 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 19:57:56 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 19:57:56 Pausing app: bucket_op_with_timer
2021/12/24 19:57:56 Function: TestPauseResumeWithEventingReb update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:58:01 Waiting for function: TestPauseResumeWithEventingReb status to change to paused
2021/12/24 19:58:01 Function: TestPauseResumeWithEventingReb status changed to paused
2021/12/24 19:58:01 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 19:58:02 Removing node(s): [] from the cluster
2021/12/24 19:58:07 Rebalance progress: 29.16666666666666
2021/12/24 19:58:12 Rebalance progress: 29.16666666666666
2021/12/24 19:58:17 Rebalance progress: 100
2021/12/24 19:58:17 Resuming app: bucket_op_with_timer
2021/12/24 19:58:18 Function: TestPauseResumeWithEventingReb update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:6] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 19:58:18 Starting bucket ops to source bucket
2021/12/24 19:58:30 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 19:58:35 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 19:58:40 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 19:58:45 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 19:58:50 Waiting for dst bucket item count to get to: 10000 curr count: 5128
2021/12/24 19:58:55 Waiting for dst bucket item count to get to: 10000 curr count: 5128
2021/12/24 19:58:55 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 19:58:55 Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/24 19:59:00 Rebalance progress: 29.16666666666666
2021/12/24 19:59:05 Rebalance progress: 29.16666666666666
2021/12/24 19:59:10 Rebalance progress: 100

VB distribution across eventing nodes and their workers::

2021/12/24 19:59:15 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 19:59:30 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 19:59:45 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 20:00:00 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 20:00:15 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 20:00:30 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 20:00:45 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 20:01:00 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 20:01:15 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 20:01:30 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 20:01:45 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:79} {Name:#primary Bucket:hello-world Completion:100}]

DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: 94af6aa2e7fbf35999493861d5e6bd6e
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [114-170]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [171-227]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [228-284]
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 57
	v: [285-341]
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [0-56]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [57-113]
Producer node: 172.31.2.134:9300	Node UUID: 29b53ee928fc64856754b9f5d2db2047
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [740-796]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [797-853]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [854-910]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [911-967]
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 56
	v: [968-1023]
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [683-739]
Producer node: 127.0.0.1:9303	Node UUID: f9091069bcc9098aacf7e9ff52343eaa
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [342-398]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [399-455]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [456-512]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [513-569]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [570-626]
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 56
	v: [627-682]


2021/12/24 20:02:00 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:02:05 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/24 20:02:10 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/24 20:02:15 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/24 20:02:21 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/24 20:02:21 clusterSetup.go:405: App: TestPauseResumeWithEventingReb got un-deployed
2021/12/24 20:02:21 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:02:21 eventingSetup.go:418: Function: TestPauseResumeWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeWithEventingReb deleting in background"
}
2021/12/24 20:02:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:02:32 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/24 20:02:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 20:02:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:02:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:02:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/24 20:02:54 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 20:02:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeWithEventingReb (377.13s)
=== RUN   TestBucketDeleteAfterPause
2021/12/24 20:03:04 clusterSetup.go:397: Waiting for app: TestBucketDeleteAfterPause to get un-deployed
2021/12/24 20:03:04 clusterSetup.go:405: App: TestBucketDeleteAfterPause got un-deployed
2021/12/24 20:03:04 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:03:04 eventingSetup.go:418: Function: TestBucketDeleteAfterPause delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketDeleteAfterPause not found"
}
2021/12/24 20:03:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:03:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:03:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:03:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:03:18 eventingSetup.go:125: Deploying app: TestBucketDeleteAfterPause. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:03:19 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteAfterPause stored in temp store"
}
2021/12/24 20:03:24 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/24 20:03:29 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/24 20:03:34 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/24 20:03:39 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/24 20:03:39 clusterSetup.go:354: App: TestBucketDeleteAfterPause got deployed
2021/12/24 20:03:39 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 20:03:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 87
2021/12/24 20:03:54 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2587
2021/12/24 20:03:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 20:03:54 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:03:54 handler_test.go:712: Pausing app: bucket_op_on_update
2021/12/24 20:03:54 eventingSetup.go:270: Function: TestBucketDeleteAfterPause update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 20:03:59 eventingSetup.go:719: Waiting for function: TestBucketDeleteAfterPause status to change to paused
2021/12/24 20:03:59 eventingSetup.go:727: Function: TestBucketDeleteAfterPause status changed to paused
2021/12/24 20:03:59 handler_test.go:716: Deleting source bucket: default
2021/12/24 20:04:05 eventingSetup.go:719: Waiting for function: TestBucketDeleteAfterPause status to change to undeployed
2021/12/24 20:04:05 eventingSetup.go:727: Function: TestBucketDeleteAfterPause status changed to undeployed
2021/12/24 20:04:11 clusterSetup.go:397: Waiting for app: TestBucketDeleteAfterPause to get un-deployed
2021/12/24 20:04:11 clusterSetup.go:405: App: TestBucketDeleteAfterPause got un-deployed
2021/12/24 20:04:11 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:04:11 eventingSetup.go:418: Function: TestBucketDeleteAfterPause delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteAfterPause deleting in background"
}
2021/12/24 20:04:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:04:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:04:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:04:29 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4531
2021/12/24 20:04:34 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2031
2021/12/24 20:04:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBucketDeleteAfterPause (99.50s)
=== RUN   TestChangeFnCodeBetweenPauseResume
2021/12/24 20:04:44 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/24 20:04:44 clusterSetup.go:405: App: TestChangeFnCodeBetweenPauseResume got un-deployed
2021/12/24 20:04:44 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:04:44 eventingSetup.go:418: Function: TestChangeFnCodeBetweenPauseResume delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestChangeFnCodeBetweenPauseResume not found"
}
2021/12/24 20:04:45 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:04:50 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:04:52 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:04:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:04:57 eventingSetup.go:125: Deploying app: TestChangeFnCodeBetweenPauseResume. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:04:58 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume stored in temp store"
}
2021/12/24 20:05:03 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/24 20:05:08 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/24 20:05:13 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/24 20:05:18 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/24 20:05:18 clusterSetup.go:354: App: TestChangeFnCodeBetweenPauseResume got deployed
2021/12/24 20:05:18 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 20:05:53 handler_test.go:739: Pausing function: TestChangeFnCodeBetweenPauseResume
2021/12/24 20:05:53 eventingSetup.go:270: Function: TestChangeFnCodeBetweenPauseResume update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 20:05:58 eventingSetup.go:719: Waiting for function: TestChangeFnCodeBetweenPauseResume status to change to paused
2021/12/24 20:05:58 eventingSetup.go:727: Function: TestChangeFnCodeBetweenPauseResume status changed to paused
2021/12/24 20:08:58 handler_test.go:748: Resuming function: TestChangeFnCodeBetweenPauseResume
2021/12/24 20:08:58 eventingSetup.go:125: Deploying app: TestChangeFnCodeBetweenPauseResume. Item count src bucket: 5000 dst bucket: 0
2021/12/24 20:08:59 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume stored in temp store"
}
2021/12/24 20:09:04 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2021/12/24 20:09:04 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:09:04 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 0 expected 5000
2021/12/24 20:09:09 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2021/12/24 20:09:09 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:09:09 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 2964 expected 5000
2021/12/24 20:09:14 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2021/12/24 20:09:14 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:09:14 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 3901 expected 5000
2021/12/24 20:09:19 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2021/12/24 20:09:19 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:09:19 eventingSetup.go:804: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 5000
2021/12/24 20:09:19 handler_test.go:753: Undeploying function: TestChangeFnCodeBetweenPauseResume
2021/12/24 20:09:19 eventingSetup.go:270: Function: TestChangeFnCodeBetweenPauseResume update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 20:09:29 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/24 20:09:35 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/24 20:09:40 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/24 20:09:40 clusterSetup.go:405: App: TestChangeFnCodeBetweenPauseResume got un-deployed
2021/12/24 20:09:40 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:09:40 eventingSetup.go:418: Function: TestChangeFnCodeBetweenPauseResume delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume deleting in background"
}
2021/12/24 20:09:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:09:51 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 20:09:56 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 20:09:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:09:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:10:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestChangeFnCodeBetweenPauseResume (329.04s)
=== RUN   TestCommentUnCommentOnDelete
2021/12/24 20:10:13 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/24 20:10:13 clusterSetup.go:405: App: TestCommentUnCommentOnDelete got un-deployed
2021/12/24 20:10:13 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:10:13 eventingSetup.go:418: Function: TestCommentUnCommentOnDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCommentUnCommentOnDelete not found"
}
2021/12/24 20:10:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:10:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:10:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:10:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:10:26 eventingSetup.go:125: Deploying app: TestCommentUnCommentOnDelete. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:10:27 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete stored in temp store"
}
2021/12/24 20:10:32 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/24 20:10:37 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/24 20:10:42 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/24 20:10:47 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/24 20:10:47 clusterSetup.go:354: App: TestCommentUnCommentOnDelete got deployed
2021/12/24 20:10:47 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 20:10:56 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:11:01 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 1499
2021/12/24 20:11:06 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 1499
2021/12/24 20:11:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 20:11:06 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:11:06 handler_test.go:780: Undeploying app: TestCommentUnCommentOnDelete
2021/12/24 20:11:06 eventingSetup.go:270: Function: TestCommentUnCommentOnDelete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 20:11:36 eventingSetup.go:125: Deploying app: TestCommentUnCommentOnDelete. Item count src bucket: 5000 dst bucket: 5000
2021/12/24 20:11:37 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete stored in temp store"
}
2021/12/24 20:11:42 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/24 20:11:47 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/24 20:11:52 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/24 20:11:57 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/24 20:11:57 clusterSetup.go:354: App: TestCommentUnCommentOnDelete got deployed
2021/12/24 20:11:57 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 20:12:10 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 20:12:15 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 20:12:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:12:15 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:12:15 handler_test.go:799: Undeploying app: TestCommentUnCommentOnDelete
2021/12/24 20:12:15 eventingSetup.go:270: Function: TestCommentUnCommentOnDelete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 20:12:25 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/24 20:12:30 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/24 20:12:35 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/24 20:12:35 clusterSetup.go:405: App: TestCommentUnCommentOnDelete got un-deployed
2021/12/24 20:12:35 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:12:35 eventingSetup.go:418: Function: TestCommentUnCommentOnDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete deleting in background"
}
2021/12/24 20:12:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:12:41 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:12:43 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:12:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCommentUnCommentOnDelete (165.53s)
=== RUN   TestCPPWorkerCleanup
2021/12/24 20:12:58 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/24 20:12:58 clusterSetup.go:405: App: TestCPPWorkerCleanup got un-deployed
2021/12/24 20:12:58 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:12:58 eventingSetup.go:418: Function: TestCPPWorkerCleanup delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCPPWorkerCleanup not found"
}
2021/12/24 20:13:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:13:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:13:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:13:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:13:11 eventingSetup.go:125: Deploying app: TestCPPWorkerCleanup. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:13:12 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCPPWorkerCleanup stored in temp store"
}
2021/12/24 20:13:12 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 20:13:19 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:13:24 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:13:29 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:13:34 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:13:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2810
2021/12/24 20:13:44 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2810
2021/12/24 20:13:44 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 20:13:44 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:13:50 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/24 20:13:55 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/24 20:14:00 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/24 20:14:05 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/24 20:14:05 clusterSetup.go:405: App: TestCPPWorkerCleanup got un-deployed
2021/12/24 20:14:05 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:14:05 eventingSetup.go:418: Function: TestCPPWorkerCleanup delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCPPWorkerCleanup deleting in background"
}
2021/12/24 20:14:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:14:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 20:14:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:14:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:14:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3179
2021/12/24 20:14:33 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 679
2021/12/24 20:14:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCPPWorkerCleanup (134.67s)
=== RUN   TestWithUserXattrs
2021/12/24 20:15:13 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/24 20:15:13 clusterSetup.go:405: App: TestWithUserXattrs got un-deployed
2021/12/24 20:15:13 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:15:13 eventingSetup.go:418: Function: TestWithUserXattrs delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestWithUserXattrs not found"
}
2021/12/24 20:15:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:15:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:15:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:15:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:15:26 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 20:15:28 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 20:15:30 eventingSetup.go:125: Deploying app: TestWithUserXattrs. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:15:31 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestWithUserXattrs stored in temp store"
}
2021/12/24 20:15:36 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/24 20:15:41 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/24 20:15:46 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/24 20:15:51 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/24 20:15:51 clusterSetup.go:354: App: TestWithUserXattrs got deployed
2021/12/24 20:15:51 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 20:16:00 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:16:05 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:16:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 20:16:05 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:16:10 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/24 20:16:16 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/24 20:16:21 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/24 20:16:26 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/24 20:16:26 clusterSetup.go:405: App: TestWithUserXattrs got un-deployed
2021/12/24 20:16:26 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:16:26 eventingSetup.go:418: Function: TestWithUserXattrs delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestWithUserXattrs deleting in background"
}
2021/12/24 20:16:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:16:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 20:16:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:16:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:16:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4481
2021/12/24 20:16:54 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1981
2021/12/24 20:16:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestWithUserXattrs (110.73s)
=== RUN   TestEventProcessingPostBucketFlush
2021/12/24 20:17:04 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/24 20:17:04 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2021/12/24 20:17:04 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:17:04 eventingSetup.go:418: Function: TestEventProcessingPostBucketFlush delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventProcessingPostBucketFlush not found"
}
2021/12/24 20:17:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:17:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:17:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:17:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:17:17 eventingSetup.go:125: Deploying app: TestEventProcessingPostBucketFlush. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:17:18 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventProcessingPostBucketFlush stored in temp store"
}
2021/12/24 20:17:23 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/24 20:17:28 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/24 20:17:33 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/24 20:17:38 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/24 20:17:38 clusterSetup.go:354: App: TestEventProcessingPostBucketFlush got deployed
2021/12/24 20:17:38 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 20:17:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:17:52 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 906
2021/12/24 20:17:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 906
2021/12/24 20:17:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 20:17:57 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:18:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:18:11 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2556
2021/12/24 20:18:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2556
2021/12/24 20:18:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:18:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:18:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3255
2021/12/24 20:18:33 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 755
2021/12/24 20:18:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:18:33 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 20:18:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 25000 curr count: 13146
2021/12/24 20:19:02 eventingSetup.go:441: Waiting for dst bucket item count to get to: 25000 curr count: 19578
2021/12/24 20:19:07 eventingSetup.go:441: Waiting for dst bucket item count to get to: 25000 curr count: 22964
2021/12/24 20:19:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2021/12/24 20:19:07 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:19:08 eventingSetup.go:270: Function: TestEventProcessingPostBucketFlush update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 20:19:13 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/24 20:19:18 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/24 20:19:23 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/24 20:19:28 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/24 20:19:28 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2021/12/24 20:19:28 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:19:33 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/24 20:19:33 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2021/12/24 20:19:33 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:19:33 eventingSetup.go:418: Function: TestEventProcessingPostBucketFlush delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventProcessingPostBucketFlush deleting in background"
}
2021/12/24 20:19:34 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:19:44 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 25000
2021/12/24 20:19:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12500
2021/12/24 20:19:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:19:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:20:01 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 22843
2021/12/24 20:20:06 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 22843
2021/12/24 20:20:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventProcessingPostBucketFlush (192.22s)
=== RUN   TestMetaBucketDelete
2021/12/24 20:20:16 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2021/12/24 20:20:16 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2021/12/24 20:20:16 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:20:16 eventingSetup.go:418: Function: TestMetaBucketDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaBucketDelete not found"
}
2021/12/24 20:20:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:20:22 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:20:24 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:20:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:20:29 eventingSetup.go:125: Deploying app: TestMetaBucketDelete. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:20:30 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDelete stored in temp store"
}
2021/12/24 20:20:35 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/24 20:20:40 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/24 20:20:45 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/24 20:20:50 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/24 20:20:50 clusterSetup.go:354: App: TestMetaBucketDelete got deployed
2021/12/24 20:20:50 handler_test.go:902: Deleting metadata bucket: eventing
2021/12/24 20:20:51 handler_test.go:904: Deleted metadata bucket: eventing
2021/12/24 20:20:56 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2021/12/24 20:20:56 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2021/12/24 20:21:11 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2021/12/24 20:21:11 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2021/12/24 20:21:11 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:21:11 eventingSetup.go:418: Function: TestMetaBucketDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDelete deleting in background"
}
2021/12/24 20:21:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:21:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:21:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:21:24 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaBucketDelete (78.53s)
=== RUN   TestMetaBucketDeleteWithBootstrap
2021/12/24 20:21:34 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/24 20:21:34 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2021/12/24 20:21:34 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:21:34 eventingSetup.go:418: Function: TestMetaBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaBucketDeleteWithBootstrap not found"
}
2021/12/24 20:21:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:21:41 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:21:42 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:21:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:21:47 eventingSetup.go:125: Deploying app: TestMetaBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:21:49 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDeleteWithBootstrap stored in temp store"
}
2021/12/24 20:22:07 handler_test.go:923: Deleting metadata bucket: eventing
2021/12/24 20:22:08 handler_test.go:925: Deleted metadata bucket: eventing
2021/12/24 20:22:23 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/24 20:22:23 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2021/12/24 20:22:38 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/24 20:22:38 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2021/12/24 20:22:38 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:22:38 eventingSetup.go:418: Function: TestMetaBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDeleteWithBootstrap deleting in background"
}
2021/12/24 20:22:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:22:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:22:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:22:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaBucketDeleteWithBootstrap (87.05s)
=== RUN   TestSourceBucketDelete
2021/12/24 20:23:01 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2021/12/24 20:23:01 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2021/12/24 20:23:01 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:23:01 eventingSetup.go:418: Function: TestSourceBucketDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceBucketDelete not found"
}
2021/12/24 20:23:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:23:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:23:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:23:14 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:23:14 eventingSetup.go:125: Deploying app: TestSourceBucketDelete. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:23:16 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDelete stored in temp store"
}
2021/12/24 20:23:21 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/24 20:23:26 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/24 20:23:31 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/24 20:23:36 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/24 20:23:36 clusterSetup.go:354: App: TestSourceBucketDelete got deployed
2021/12/24 20:23:36 handler_test.go:945: Deleting source bucket: default
2021/12/24 20:23:37 handler_test.go:947: Deleted source bucket: default
2021/12/24 20:23:42 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2021/12/24 20:23:42 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2021/12/24 20:23:57 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2021/12/24 20:23:57 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2021/12/24 20:23:57 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:23:57 eventingSetup.go:418: Function: TestSourceBucketDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDelete deleting in background"
}
2021/12/24 20:23:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:24:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:24:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:24:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceBucketDelete (78.51s)
=== RUN   TestSourceBucketDeleteWithBootstrap
2021/12/24 20:24:20 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2021/12/24 20:24:20 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2021/12/24 20:24:20 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:24:20 eventingSetup.go:418: Function: TestSourceBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceBucketDeleteWithBootstrap not found"
}
2021/12/24 20:24:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:24:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:24:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:24:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:24:33 eventingSetup.go:125: Deploying app: TestSourceBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:24:34 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDeleteWithBootstrap stored in temp store"
}
2021/12/24 20:24:53 handler_test.go:966: Deleting source bucket: default
2021/12/24 20:24:55 handler_test.go:968: Deleted source bucket: default
2021/12/24 20:25:10 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2021/12/24 20:25:10 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2021/12/24 20:25:25 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2021/12/24 20:25:25 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2021/12/24 20:25:25 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:25:25 eventingSetup.go:418: Function: TestSourceBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDeleteWithBootstrap deleting in background"
}
2021/12/24 20:25:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:25:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:25:33 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:25:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceBucketDeleteWithBootstrap (87.83s)
=== RUN   TestSourceAndMetaBucketDeleteWithBootstrap
2021/12/24 20:25:48 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/24 20:25:48 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2021/12/24 20:25:48 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:25:48 eventingSetup.go:418: Function: TestSourceAndMetaBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceAndMetaBucketDeleteWithBootstrap not found"
}
2021/12/24 20:25:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:25:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:25:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:26:01 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:26:01 eventingSetup.go:125: Deploying app: TestSourceAndMetaBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:26:02 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceAndMetaBucketDeleteWithBootstrap stored in temp store"
}
2021/12/24 20:26:21 handler_test.go:988: Deleting source bucket: default
2021/12/24 20:26:22 handler_test.go:990: Deleted source bucket: default
2021/12/24 20:26:22 handler_test.go:992: Deleting metadata bucket: eventing
2021/12/24 20:26:23 handler_test.go:994: Deleted metadata bucket: eventing
2021/12/24 20:26:38 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/24 20:26:38 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2021/12/24 20:26:53 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/24 20:26:53 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2021/12/24 20:26:53 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:26:53 eventingSetup.go:418: Function: TestSourceAndMetaBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceAndMetaBucketDeleteWithBootstrap deleting in background"
}
2021/12/24 20:26:54 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:26:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:27:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:27:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceAndMetaBucketDeleteWithBootstrap (88.28s)
=== RUN   TestUndeployDuringBootstrap
2021/12/24 20:27:16 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/24 20:27:16 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2021/12/24 20:27:16 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:27:16 eventingSetup.go:418: Function: TestUndeployDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployDuringBootstrap not found"
}
2021/12/24 20:27:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:27:22 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:27:24 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:27:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:27:29 eventingSetup.go:125: Deploying app: TestUndeployDuringBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:27:30 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployDuringBootstrap stored in temp store"
}
2021/12/24 20:27:30 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 20:27:42 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:27:42 clusterSetup.go:375: Apps undergoing bootstrap: true
2021/12/24 20:27:42 clusterSetup.go:378: App: TestUndeployDuringBootstrap started bootstrap
2021/12/24 20:27:42 clusterSetup.go:375: Apps undergoing bootstrap: true
2021/12/24 20:27:47 clusterSetup.go:367: No apps undergoing bootstrap
2021/12/24 20:27:52 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/24 20:27:57 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/24 20:28:02 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/24 20:28:02 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2021/12/24 20:28:02 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:28:27 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/24 20:28:27 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2021/12/24 20:28:27 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:28:27 eventingSetup.go:418: Function: TestUndeployDuringBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployDuringBootstrap deleting in background"
}
2021/12/24 20:28:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:28:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 20:28:44 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 20:28:44 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:28:45 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:28:55 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2129
2021/12/24 20:28:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployDuringBootstrap (109.47s)
=== RUN   TestDeleteBeforeUndeploy
2021/12/24 20:29:00 eventingSetup.go:125: Deploying app: TestDeleteBeforeUndeploy. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:29:02 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeleteBeforeUndeploy stored in temp store"
}
2021/12/24 20:29:07 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/24 20:29:12 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/24 20:29:17 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/24 20:29:22 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/24 20:29:22 clusterSetup.go:354: App: TestDeleteBeforeUndeploy got deployed
2021/12/24 20:29:22 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 422 dump: {
 "name": "ERR_APP_NOT_UNDEPLOYED",
 "code": 22,
 "description": "Function: TestDeleteBeforeUndeploy skipping delete request as it hasn't been undeployed"
}
2021/12/24 20:29:22 eventingSetup.go:270: Function: TestDeleteBeforeUndeploy update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 20:29:22 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeleteBeforeUndeploy deleting in background"
}
2021/12/24 20:29:27 clusterSetup.go:397: Waiting for app: TestDeleteBeforeUndeploy to get un-deployed
2021/12/24 20:29:27 clusterSetup.go:405: App: TestDeleteBeforeUndeploy got un-deployed
2021/12/24 20:29:27 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:29:27 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeleteBeforeUndeploy not found"
}
2021/12/24 20:29:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:29:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:29:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:29:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDeleteBeforeUndeploy (44.65s)
=== RUN   TestUndeployWhenTimersAreFired
2021/12/24 20:29:50 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/24 20:29:50 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2021/12/24 20:29:50 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:29:50 eventingSetup.go:418: Function: TestUndeployWhenTimersAreFired delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployWhenTimersAreFired not found"
}
2021/12/24 20:29:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:29:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:29:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:30:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:30:03 eventingSetup.go:125: Deploying app: TestUndeployWhenTimersAreFired. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:30:05 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWhenTimersAreFired stored in temp store"
}
2021/12/24 20:30:10 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/24 20:30:15 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/24 20:30:20 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/24 20:30:25 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/24 20:30:25 clusterSetup.go:354: App: TestUndeployWhenTimersAreFired got deployed
2021/12/24 20:30:25 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 20:31:00 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/24 20:31:05 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/24 20:31:10 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/24 20:31:15 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/24 20:31:15 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2021/12/24 20:31:15 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:33:00 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/24 20:33:00 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2021/12/24 20:33:00 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:33:00 eventingSetup.go:418: Function: TestUndeployWhenTimersAreFired delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWhenTimersAreFired deleting in background"
}
2021/12/24 20:33:02 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:33:12 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 20:33:17 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 20:33:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:33:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:33:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4133
2021/12/24 20:33:33 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1633
2021/12/24 20:33:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployWhenTimersAreFired (233.26s)
=== RUN   TestUndeployWithKVFailover
2021/12/24 20:33:43 clusterSetup.go:397: Waiting for app: TestUndeployWithKVFailover to get un-deployed
2021/12/24 20:33:43 clusterSetup.go:405: App: TestUndeployWithKVFailover got un-deployed
2021/12/24 20:33:43 eventingSetup.go:46: No eventing-con process running
2021/12/24 20:33:43 eventingSetup.go:418: Function: TestUndeployWithKVFailover delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployWithKVFailover not found"
}
2021/12/24 20:33:45 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:33:50 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:33:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:33:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:33:56 eventingSetup.go:125: Deploying app: TestUndeployWithKVFailover. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:33:58 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWithKVFailover stored in temp store"
}
2021/12/24 20:33:58 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 20:34:04 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:34:09 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:34:15 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:34:20 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:34:25 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:34:30 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:34:35 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:34:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 20:34:35 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/24 20:34:35 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 20:34:40 Rebalance progress: 29.16666666666666
2021/12/24 20:34:45 Rebalance progress: 29.16666666666666
2021/12/24 20:34:50 Rebalance progress: 100
2021/12/24 20:34:50 Failing over: [127.0.0.1:19003]
2021/12/24 20:35:00 Function: TestUndeployWithKVFailover update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/24 20:36:00 Removing node(s): [] from the cluster
2021/12/24 20:36:05 Rebalance progress: 29.16666666666666
2021/12/24 20:36:10 Rebalance progress: 29.16666666666666
2021/12/24 20:36:15 Rebalance progress: 100
2021/12/24 20:36:20 Waiting for app: TestUndeployWithKVFailover to get un-deployed
2021/12/24 20:36:20 App: TestUndeployWithKVFailover got un-deployed
2021/12/24 20:36:20 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:36:25 Waiting for app: TestUndeployWithKVFailover to get un-deployed
2021/12/24 20:36:25 App: TestUndeployWithKVFailover got un-deployed
2021/12/24 20:36:25 No eventing-con process running
2021/12/24 20:36:25 Function: TestUndeployWithKVFailover delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWithKVFailover deleting in background"
}
2021/12/24 20:36:27 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:36:37 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 20:36:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:36:38 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:36:48 Waiting for dst bucket item count to get to: 0 curr count: 4098
2021/12/24 20:36:53 Waiting for dst bucket item count to get to: 0 curr count: 1598
2021/12/24 20:36:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployWithKVFailover (199.95s)
=== RUN   TestBucketFlushWhileFnDeployed
2021/12/24 20:37:03 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/24 20:37:03 App: TestBucketFlushWhileFnDeployed got un-deployed
2021/12/24 20:37:03 No eventing-con process running
2021/12/24 20:37:03 Function: TestBucketFlushWhileFnDeployed delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketFlushWhileFnDeployed not found"
}
2021/12/24 20:37:05 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:37:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:37:11 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:37:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:37:16 Deploying app: TestBucketFlushWhileFnDeployed. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:37:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketFlushWhileFnDeployed stored in temp store"
}
2021/12/24 20:37:23 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/24 20:37:28 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/24 20:37:33 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/24 20:37:38 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/24 20:37:38 App: TestBucketFlushWhileFnDeployed got deployed
2021/12/24 20:37:38 Starting bucket ops to source bucket
2021/12/24 20:37:58 Waiting for dst bucket item count to get to: 20000 curr count: 13756
2021/12/24 20:38:03 Waiting for dst bucket item count to get to: 20000 curr count: 13756
2021/12/24 20:38:03 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2021/12/24 20:38:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:38:06 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:38:16 Waiting for dst bucket item count to get to: 0 curr count: 20000
2021/12/24 20:38:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:38:18 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:38:28 Waiting for dst bucket item count to get to: 0 curr count: 12785
2021/12/24 20:38:33 Waiting for dst bucket item count to get to: 0 curr count: 2785
2021/12/24 20:38:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:38:33 Starting bucket ops to source bucket
2021/12/24 20:38:46 Waiting for dst bucket item count to get to: 10000 curr count: 2725
2021/12/24 20:38:51 Waiting for dst bucket item count to get to: 10000 curr count: 6872
2021/12/24 20:38:56 Waiting for dst bucket item count to get to: 10000 curr count: 9147
2021/12/24 20:38:56 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 20:38:56 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:39:01 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/24 20:39:06 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/24 20:39:11 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/24 20:39:16 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/24 20:39:16 App: TestBucketFlushWhileFnDeployed got un-deployed
2021/12/24 20:39:16 No eventing-con process running
2021/12/24 20:39:16 Function: TestBucketFlushWhileFnDeployed delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketFlushWhileFnDeployed deleting in background"
}
2021/12/24 20:39:17 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:39:27 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/24 20:39:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:39:29 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:39:39 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/24 20:39:44 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 20:39:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBucketFlushWhileFnDeployed (170.60s)
=== RUN   TestTimerOverwrite
2021/12/24 20:39:54 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/24 20:39:54 App: TestTimerOverwrite got un-deployed
2021/12/24 20:39:54 No eventing-con process running
2021/12/24 20:39:54 Function: TestTimerOverwrite delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerOverwrite not found"
}
2021/12/24 20:39:55 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:40:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:40:02 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:40:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:40:07 Deploying app: TestTimerOverwrite. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:40:08 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverwrite stored in temp store"
}
2021/12/24 20:40:13 Waiting for app: TestTimerOverwrite to get deployed
2021/12/24 20:40:18 Waiting for app: TestTimerOverwrite to get deployed
2021/12/24 20:40:23 Waiting for app: TestTimerOverwrite to get deployed
2021/12/24 20:40:28 Waiting for app: TestTimerOverwrite to get deployed
2021/12/24 20:40:28 App: TestTimerOverwrite got deployed
2021/12/24 20:40:38 Starting bucket ops to source bucket
2021/12/24 20:40:48 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:40:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:40:58 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:41:03 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:41:08 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:41:13 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:41:18 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:41:23 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:41:28 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:41:33 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:41:38 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:41:43 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 20:41:48 Waiting for dst bucket item count to get to: 5000 curr count: 1252
2021/12/24 20:41:53 Waiting for dst bucket item count to get to: 5000 curr count: 3777
2021/12/24 20:41:53 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 20:42:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:42:08 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/24 20:42:13 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/24 20:42:18 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/24 20:42:23 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/24 20:42:23 App: TestTimerOverwrite got un-deployed
2021/12/24 20:42:23 No eventing-con process running
2021/12/24 20:42:23 Function: TestTimerOverwrite delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverwrite deleting in background"
}
2021/12/24 20:42:24 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:42:34 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 20:42:39 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 20:42:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:42:41 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:42:51 Waiting for dst bucket item count to get to: 0 curr count: 4914
2021/12/24 20:42:56 Waiting for dst bucket item count to get to: 0 curr count: 4914
2021/12/24 20:42:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerOverwrite (192.05s)
=== RUN   TestUndeployBackdoorDuringBootstrap
2021/12/24 20:43:01 Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/24 20:43:01 Removing node(s): [] from the cluster
2021/12/24 20:43:06 Rebalance progress: 100
2021/12/24 20:43:06 Failing over: [127.0.0.1:19003]
2021/12/24 20:43:11 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2021/12/24 20:43:11 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2021/12/24 20:43:11 No eventing-con process running
2021/12/24 20:43:11 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployBackdoorDuringBootstrap not found"
}
2021/12/24 20:43:13 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:43:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:43:20 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:43:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:43:25 Deploying app: TestUndeployBackdoorDuringBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:43:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployBackdoorDuringBootstrap stored in temp store"
}
2021/12/24 20:43:26 Starting bucket ops to source bucket
2021/12/24 20:43:36 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:43:36 Context: Post to set retry counter, response code: 200 dump: {
 "code": 0
}
2021/12/24 20:43:36 set retry counter, response &{[123 10 32 34 99 111 100 101 34 58 32 48 10 125] }
2021/12/24 20:44:41 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2021/12/24 20:44:41 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2021/12/24 20:44:41 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:44:41 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployBackdoorDuringBootstrap deleting in background"
}
2021/12/24 20:44:46 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2021/12/24 20:44:46 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2021/12/24 20:44:46 No eventing-con process running
2021/12/24 20:44:46 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployBackdoorDuringBootstrap not found"
}
2021/12/24 20:44:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:44:57 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 20:44:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:44:59 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:45:09 Waiting for dst bucket item count to get to: 0 curr count: 1671
2021/12/24 20:45:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:45:09 Removing node(s): [] from the cluster
2021/12/24 20:45:14 Rebalance progress: 100
--- PASS: TestUndeployBackdoorDuringBootstrap (137.96s)
=== RUN   TestOnUpdateSrcMutation
2021/12/24 20:45:24 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/24 20:45:24 App: TestOnUpdateSrcMutation got un-deployed
2021/12/24 20:45:24 No eventing-con process running
2021/12/24 20:45:24 Function: TestOnUpdateSrcMutation delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateSrcMutation not found"
}
2021/12/24 20:45:25 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:45:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:45:32 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:45:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:45:37 Deploying app: TestOnUpdateSrcMutation. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:45:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutation stored in temp store"
}
2021/12/24 20:45:38 Starting bucket ops to source bucket
2021/12/24 20:46:05 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 20:46:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:46:10 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/24 20:46:15 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/24 20:46:20 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/24 20:46:25 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/24 20:46:25 App: TestOnUpdateSrcMutation got un-deployed
2021/12/24 20:46:25 No eventing-con process running
2021/12/24 20:46:26 Function: TestOnUpdateSrcMutation delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutation deleting in background"
}
2021/12/24 20:46:27 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:46:37 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/24 20:46:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:46:39 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:46:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateSrcMutation (89.60s)
=== RUN   TestOnDeleteSrcMutation
2021/12/24 20:46:54 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/24 20:46:54 App: TestOnDeleteSrcMutation got un-deployed
2021/12/24 20:46:54 No eventing-con process running
2021/12/24 20:46:54 Function: TestOnDeleteSrcMutation delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteSrcMutation not found"
}
2021/12/24 20:46:55 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:47:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:47:02 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:47:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:47:07 Deploying app: TestOnDeleteSrcMutation. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:47:08 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutation stored in temp store"
}
2021/12/24 20:47:08 Starting bucket ops to source bucket
2021/12/24 20:47:36 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 20:47:36 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:47:42 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/24 20:47:47 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/24 20:47:52 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/24 20:47:57 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/24 20:47:57 App: TestOnDeleteSrcMutation got un-deployed
2021/12/24 20:47:57 No eventing-con process running
2021/12/24 20:47:57 Function: TestOnDeleteSrcMutation delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutation deleting in background"
}
2021/12/24 20:47:58 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:48:08 Waiting for dst bucket item count to get to: 0 curr count: 3579
2021/12/24 20:48:13 Waiting for dst bucket item count to get to: 0 curr count: 1079
2021/12/24 20:48:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:48:15 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:48:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteSrcMutation (96.15s)
=== RUN   TestOnUpdateSrcMutationWithTimer
2021/12/24 20:48:30 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/24 20:48:30 App: TestOnUpdateSrcMutationWithTimer got un-deployed
2021/12/24 20:48:30 No eventing-con process running
2021/12/24 20:48:30 Function: TestOnUpdateSrcMutationWithTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateSrcMutationWithTimer not found"
}
2021/12/24 20:48:31 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:48:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:48:38 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:48:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:48:43 Deploying app: TestOnUpdateSrcMutationWithTimer. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:48:44 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutationWithTimer stored in temp store"
}
2021/12/24 20:48:44 Starting bucket ops to source bucket
2021/12/24 20:49:26 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 20:49:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:49:31 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/24 20:49:36 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/24 20:49:41 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/24 20:49:46 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/24 20:49:46 App: TestOnUpdateSrcMutationWithTimer got un-deployed
2021/12/24 20:49:46 No eventing-con process running
2021/12/24 20:49:46 Function: TestOnUpdateSrcMutationWithTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutationWithTimer deleting in background"
}
2021/12/24 20:49:48 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:49:58 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 20:49:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:49:59 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:50:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateSrcMutationWithTimer (104.61s)
=== RUN   TestOnDeleteSrcMutationsWithTimer
2021/12/24 20:50:14 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/24 20:50:14 App: TestOnDeleteSrcMutationsWithTimer got un-deployed
2021/12/24 20:50:14 No eventing-con process running
2021/12/24 20:50:14 Function: TestOnDeleteSrcMutationsWithTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteSrcMutationsWithTimer not found"
}
2021/12/24 20:50:16 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:50:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:50:22 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:50:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:50:27 Deploying app: TestOnDeleteSrcMutationsWithTimer. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:50:29 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutationsWithTimer stored in temp store"
}
2021/12/24 20:50:29 Starting bucket ops to source bucket
2021/12/24 20:51:07 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 20:51:07 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 20:51:12 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/24 20:51:17 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/24 20:51:22 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/24 20:51:27 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/24 20:51:27 App: TestOnDeleteSrcMutationsWithTimer got un-deployed
2021/12/24 20:51:27 No eventing-con process running
2021/12/24 20:51:27 Function: TestOnDeleteSrcMutationsWithTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutationsWithTimer deleting in background"
}
2021/12/24 20:51:29 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:51:39 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 20:51:44 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 20:51:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:51:46 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:51:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteSrcMutationsWithTimer (106.20s)
=== RUN   TestInterHandlerRecursion
2021/12/24 20:52:01 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 20:52:01 App: TestInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/24 20:52:01 No eventing-con process running
2021/12/24 20:52:01 Function: TestInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_source_bucket_update_op not found"
}
2021/12/24 20:52:02 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:52:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:52:09 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:52:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:52:19 Waiting for app: TestInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/24 20:52:19 App: TestInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/24 20:52:19 No eventing-con process running
2021/12/24 20:52:19 Function: TestInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2021/12/24 20:52:20 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:52:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:52:27 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:52:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:52:32 Deploying app: TestInterHandlerRecursion_source_bucket_update_op. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:52:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op stored in temp store"
}
2021/12/24 20:52:33 response body {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op stored in temp store"
} err 
2021/12/24 20:52:38 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/24 20:52:43 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/24 20:52:48 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/24 20:52:53 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/24 20:52:53 App: TestInterHandlerRecursion_source_bucket_update_op got deployed
2021/12/24 20:52:53 Deploying app: TestInterHandlerRecursion_src_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:52:53 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_FUNCTION_RECURSION",
 "code": 50,
 "description": "Inter handler recursion error"
}
2021/12/24 20:52:53 response body {
 "name": "ERR_INTER_FUNCTION_RECURSION",
 "code": 50,
 "description": "Inter handler recursion error"
} err 
2021/12/24 20:52:58 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 20:53:03 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 20:53:08 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 20:53:13 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 20:53:13 App: TestInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/24 20:53:13 No eventing-con process running
2021/12/24 20:53:13 Function: TestInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op deleting in background"
}
2021/12/24 20:53:14 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:53:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:53:21 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:53:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:53:31 Waiting for app: TestInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/24 20:53:31 App: TestInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/24 20:53:31 No eventing-con process running
2021/12/24 20:53:31 Function: TestInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2021/12/24 20:53:33 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:53:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:53:39 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:53:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterHandlerRecursion (113.76s)
=== RUN   TestInterBucketRecursion
2021/12/24 20:53:49 Deploying app: TestInterBucketRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:53:50 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 stored in temp store"
}
2021/12/24 20:53:50 response body {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 stored in temp store"
} err 
2021/12/24 20:53:50 Deploying app: TestInterBucketRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:53:50 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestInterBucketRecursion_function2 causes a cycle involving functions: [TestInterBucketRecursion_function1], hence deployment is disallowed"
}
2021/12/24 20:53:55 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/24 20:54:00 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/24 20:54:06 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/24 20:54:11 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/24 20:54:11 App: TestInterBucketRecursion_function1 got deployed
2021/12/24 20:54:16 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/24 20:54:21 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/24 20:54:26 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/24 20:54:31 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/24 20:54:31 App: TestInterBucketRecursion_function1 got un-deployed
2021/12/24 20:54:31 No eventing-con process running
2021/12/24 20:54:31 Function: TestInterBucketRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 deleting in background"
}
2021/12/24 20:54:32 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:54:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:54:39 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:54:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:54:49 Waiting for app: TestInterBucketRecursion_function2 to get un-deployed
2021/12/24 20:54:49 App: TestInterBucketRecursion_function2 got un-deployed
2021/12/24 20:54:49 No eventing-con process running
2021/12/24 20:54:49 Function: TestInterBucketRecursion_function2 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterBucketRecursion_function2 not found"
}
2021/12/24 20:54:50 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:54:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:54:57 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:55:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterBucketRecursion (77.59s)
=== RUN   TestLargeHandler
2021/12/24 20:55:02 Changed force_compress value to false
2021/12/24 20:55:02 Deploying app: TestLargeHandler_function. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:55:02 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_APPCODE_SIZE",
 "code": 39,
 "description": "Function: TestLargeHandler_function handler Code size is more than 131072. Code Size: 131768"
}
2021/12/24 20:55:02 Changed force_compress value to true
2021/12/24 20:55:02 Deploying app: TestLargeHandler_function. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:55:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestLargeHandler_function stored in temp store"
}
2021/12/24 20:55:09 Waiting for app: TestLargeHandler_function to get deployed
2021/12/24 20:55:14 Waiting for app: TestLargeHandler_function to get deployed
2021/12/24 20:55:19 Waiting for app: TestLargeHandler_function to get deployed
2021/12/24 20:55:24 Waiting for app: TestLargeHandler_function to get deployed
2021/12/24 20:55:24 App: TestLargeHandler_function got deployed
2021/12/24 20:55:29 Waiting for app: TestLargeHandler_function to get un-deployed
2021/12/24 20:55:34 Waiting for app: TestLargeHandler_function to get un-deployed
2021/12/24 20:55:39 Waiting for app: TestLargeHandler_function to get un-deployed
2021/12/24 20:55:44 Waiting for app: TestLargeHandler_function to get un-deployed
2021/12/24 20:55:44 App: TestLargeHandler_function got un-deployed
2021/12/24 20:55:44 No eventing-con process running
2021/12/24 20:55:44 Function: TestLargeHandler_function delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestLargeHandler_function deleting in background"
}
2021/12/24 20:55:46 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:55:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:55:52 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:55:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestLargeHandler (55.39s)
=== RUN   TestAllowInterHandlerRecursion
2021/12/24 20:56:07 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 20:56:07 App: TestAllowInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/24 20:56:07 No eventing-con process running
2021/12/24 20:56:07 Function: TestAllowInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op not found"
}
2021/12/24 20:56:09 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:56:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:56:15 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:56:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:56:25 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/24 20:56:25 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/24 20:56:25 No eventing-con process running
2021/12/24 20:56:25 Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2021/12/24 20:56:27 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:56:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:56:33 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:56:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:56:38 Deploying app: TestAllowInterHandlerRecursion_source_bucket_update_op. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:56:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op stored in temp store"
}
2021/12/24 20:56:40 response body {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op stored in temp store"
} err 
2021/12/24 20:56:45 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/24 20:56:50 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/24 20:56:55 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/24 20:57:00 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/24 20:57:00 App: TestAllowInterHandlerRecursion_source_bucket_update_op got deployed
2021/12/24 20:57:00 Deploying app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:57:01 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete stored in temp store"
}
2021/12/24 20:57:01 response body {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete stored in temp store"
} err 
2021/12/24 20:57:06 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/24 20:57:11 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/24 20:57:16 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/24 20:57:21 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/24 20:57:21 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got deployed
2021/12/24 20:57:21 TestAllowInterHandlerRecursion_src_bucket_op_on_delete is deployed
2021/12/24 20:57:26 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 20:57:31 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 20:57:36 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 20:57:41 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/24 20:57:41 App: TestAllowInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/24 20:57:41 No eventing-con process running
2021/12/24 20:57:41 Function: TestAllowInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op deleting in background"
}
2021/12/24 20:57:43 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:57:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:57:50 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:57:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:58:00 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/24 20:58:05 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/24 20:58:11 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/24 20:58:16 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/24 20:58:16 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/24 20:58:16 No eventing-con process running
2021/12/24 20:58:16 Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete deleting in background"
}
2021/12/24 20:58:17 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:58:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:58:24 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:58:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAllowInterHandlerRecursion (151.37s)
=== RUN   TestAllowInterBucketRecursion
2021/12/24 20:58:34 Deploying app: TestAllowInterBucketRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:58:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 stored in temp store"
}
2021/12/24 20:58:35 response body {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 stored in temp store"
} err 
2021/12/24 20:58:40 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/24 20:58:45 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/24 20:58:50 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/24 20:58:55 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/24 20:58:55 App: TestAllowInterBucketRecursion_function1 got deployed
2021/12/24 20:58:55 Deploying app: TestAllowInterBucketRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/24 20:58:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 stored in temp store"
}
2021/12/24 20:58:56 response body {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 stored in temp store"
} err 
2021/12/24 20:59:01 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/24 20:59:06 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/24 20:59:11 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/24 20:59:16 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/24 20:59:16 App: TestAllowInterBucketRecursion_function2 got deployed
2021/12/24 20:59:16 TestAllowInterBucketRecursion_function2 is deployed
2021/12/24 20:59:21 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/24 20:59:26 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/24 20:59:31 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/24 20:59:36 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/24 20:59:36 App: TestAllowInterBucketRecursion_function1 got un-deployed
2021/12/24 20:59:36 No eventing-con process running
2021/12/24 20:59:37 Function: TestAllowInterBucketRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 deleting in background"
}
2021/12/24 20:59:38 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:59:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:59:46 Context: Bucket flush, response code: 200 dump: 
2021/12/24 20:59:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 20:59:56 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/24 21:00:01 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/24 21:00:06 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/24 21:00:11 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/24 21:00:11 App: TestAllowInterBucketRecursion_function2 got un-deployed
2021/12/24 21:00:11 No eventing-con process running
2021/12/24 21:00:11 Function: TestAllowInterBucketRecursion_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 deleting in background"
}
2021/12/24 21:00:12 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:00:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:00:19 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:00:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAllowInterBucketRecursion (115.31s)
=== RUN   TestInterBucketRecursion2
2021/12/24 21:00:30 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:00:36 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:00:42 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:00:48 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:00:53 Deploying app: TestInterBucketRecursion2_function1. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:00:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function1 stored in temp store"
}
2021/12/24 21:00:59 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/24 21:01:04 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/24 21:01:09 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/24 21:01:14 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/24 21:01:14 App: TestInterBucketRecursion2_function1 got deployed
2021/12/24 21:01:14 Deploying app: TestInterBucketRecursion2_function2. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:01:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function2 stored in temp store"
}
2021/12/24 21:01:20 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/24 21:01:25 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/24 21:01:30 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/24 21:01:35 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/24 21:01:35 App: TestInterBucketRecursion2_function2 got deployed
2021/12/24 21:01:35 Deploying app: TestInterBucketRecursion2_function3. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:01:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function3 stored in temp store"
}
2021/12/24 21:01:41 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/24 21:01:46 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/24 21:01:51 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/24 21:01:56 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/24 21:01:56 App: TestInterBucketRecursion2_function3 got deployed
2021/12/24 21:01:56 Deploying app: TestInterBucketRecursion2_function4. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:01:56 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestInterBucketRecursion2_function4 causes a cycle involving functions: [TestInterBucketRecursion2_function1 TestInterBucketRecursion2_function2 TestInterBucketRecursion2_function3], hence deployment is disallowed"
}
2021/12/24 21:02:01 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/24 21:02:07 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/24 21:02:12 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/24 21:02:17 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/24 21:02:17 App: TestInterBucketRecursion2_function1 got un-deployed
2021/12/24 21:02:17 No eventing-con process running
2021/12/24 21:02:17 Function: TestInterBucketRecursion2_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function1 deleting in background"
}
2021/12/24 21:02:18 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:02:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:02:25 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:02:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:02:35 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/24 21:02:40 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/24 21:02:45 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/24 21:02:50 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/24 21:02:50 App: TestInterBucketRecursion2_function2 got un-deployed
2021/12/24 21:02:50 No eventing-con process running
2021/12/24 21:02:50 Function: TestInterBucketRecursion2_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function2 deleting in background"
}
2021/12/24 21:02:51 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:02:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:02:58 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:03:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:03:08 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/24 21:03:13 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/24 21:03:18 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/24 21:03:23 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/24 21:03:23 App: TestInterBucketRecursion2_function3 got un-deployed
2021/12/24 21:03:23 No eventing-con process running
2021/12/24 21:03:24 Function: TestInterBucketRecursion2_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function3 deleting in background"
}
2021/12/24 21:03:25 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:03:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:03:32 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:03:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:03:42 Waiting for app: TestInterBucketRecursion2_function4 to get un-deployed
2021/12/24 21:03:42 App: TestInterBucketRecursion2_function4 got un-deployed
2021/12/24 21:03:42 No eventing-con process running
2021/12/24 21:03:42 Function: TestInterBucketRecursion2_function4 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterBucketRecursion2_function4 not found"
}
2021/12/24 21:03:43 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:03:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:03:50 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:03:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterBucketRecursion2 (212.87s)
=== RUN   TestBucketDeleteWithRebOut
2021/12/24 21:04:02 Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/24 21:04:07 Rebalance progress: 100

VB distribution across eventing nodes and their workers::

2021/12/24 21:04:10 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:04:25 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:04:40 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:04:55 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:05:10 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:05:25 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:05:40 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:05:55 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:06:10 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:06:25 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:06:40 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:06:55 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:07:10 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:07:25 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:07:40 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:07:55 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:08:10 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:08:25 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:08:40 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:08:55 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:09:10 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:09:25 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:09:40 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/24 21:09:55 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:65} {Name:#primary Bucket:hello-world Completion:100}]

DCP Stream statuses:

vbucket curr owner:


2021/12/24 21:10:10 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:10:10 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 21:10:11 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 21:10:16 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:

vbucket curr owner:


2021/12/24 21:10:16 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:10:16 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 21:10:16 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 21:10:21 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:

vbucket curr owner:


2021/12/24 21:10:21 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:10:26 clusterSetup.go:397: Waiting for app: TestBucketDeleteWithRebOut to get un-deployed
2021/12/24 21:10:26 clusterSetup.go:405: App: TestBucketDeleteWithRebOut got un-deployed
2021/12/24 21:10:26 eventingSetup.go:46: No eventing-con process running
2021/12/24 21:10:26 eventingSetup.go:418: Function: TestBucketDeleteWithRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketDeleteWithRebOut not found"
}
2021/12/24 21:10:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:10:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:10:34 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:10:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:10:44 eventingSetup.go:125: Deploying app: TestBucketDeleteWithRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:10:45 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteWithRebOut stored in temp store"
}
2021/12/24 21:10:50 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/24 21:10:55 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/24 21:11:00 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/24 21:11:05 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/24 21:11:05 clusterSetup.go:354: App: TestBucketDeleteWithRebOut got deployed

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: 94af6aa2e7fbf35999493861d5e6bd6e
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [0-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [114-227]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 114
	v: [228-341]
Producer node: 172.31.2.134:9300	Node UUID: 29b53ee928fc64856754b9f5d2db2047
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [911-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [683-796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [797-910]
Producer node: 127.0.0.1:9303	Node UUID: f9091069bcc9098aacf7e9ff52343eaa
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [342-455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [456-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [570-682]


2021/12/24 21:11:05 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:11:05 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 21:11:10 Rebalance progress: 29.16666666666666
2021/12/24 21:11:15 Rebalance progress: 29.16666666666666
2021/12/24 21:11:20 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: 94af6aa2e7fbf35999493861d5e6bd6e
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [0-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [114-227]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 114
	v: [228-341]
Producer node: 172.31.2.134:9300	Node UUID: 29b53ee928fc64856754b9f5d2db2047
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [683-796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [797-910]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [911-1023]
Producer node: 127.0.0.1:9303	Node UUID: f9091069bcc9098aacf7e9ff52343eaa
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [342-455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [456-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [570-682]


2021/12/24 21:11:21 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:11:21 handler_test.go:1674: Deleting source bucket: default
2021/12/24 21:11:22 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 21:11:23 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 21:11:28 Rebalance progress: 29.16666666666666
2021/12/24 21:11:33 Rebalance progress: 29.16666666666666
2021/12/24 21:11:38 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: stopped
	len: 123
	vb list dump: [0, 3, 7, 13, 18, 22, 43, 45, 49, 61, 76-77, 90, 109, 117, 139, 153, 166, 174, 181, 183, 190, 197-198, 200, 205, 213, 234, 236-238, 249, 255, 280, 298-299, 308, 316, 331-332, 346, 350, 354-355, 359-360, 362, 367, 382, 393, 397, 413, 430, 455-456, 460, 466-469, 477, 483-484, 489, 496, 500, 503, 584, 594, 597-598, 601-602, 616, 625, 642, 646, 649, 667, 697, 701, 710, 713-714, 716, 731, 739-740, 754, 757, 760, 766-767, 781, 806, 811, 824, 826, 836, 843, 848, 853, 859, 873, 879, 885, 896, 916, 919-920, 922, 936, 940, 951-952, 965, 970-971, 979-980, 982, 992, 1008]
	stream status: running
	len: 901
	vb list dump: [1-2, 4-6, 8-12, 14-17, 19-21, 23-42, 44, 46-48, 50-60, 62-75, 78-89, 91-108, 110-116, 118-138, 140-152, 154-165, 167-173, 175-180, 182, 184-189, 191-196, 199, 201-204, 206-212, 214-233, 235, 239-248, 250-254, 256-279, 281-297, 300-307, 309-315, 317-330, 333-345, 347-349, 351-353, 356-358, 361, 363-366, 368-381, 383-392, 394-396, 398-412, 414-429, 431-454, 457-459, 461-465, 470-476, 478-482, 485-488, 490-495, 497-499, 501-502, 504-583, 585-593, 595-596, 599-600, 603-615, 617-624, 626-641, 643-645, 647-648, 650-666, 668-696, 698-700, 702-709, 711-712, 715, 717-730, 732-738, 741-753, 755-756, 758-759, 761-765, 768-780, 782-805, 807-810, 812-823, 825, 827-835, 837-842, 844-847, 849-852, 854-858, 860-872, 874-878, 880-884, 886-895, 897-915, 917-918, 921, 923-935, 937-939, 941-950, 953-964, 966-969, 972-978, 981, 983-991, 993-1007, 1009-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: 94af6aa2e7fbf35999493861d5e6bd6e
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 100
	v: [1-2, 4-6, 8-12, 14-17, 19-21, 23-42, 44, 46-48, 50-60, 62-75, 78-89, 91-108, 110-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 101
	v: [114-116, 118-138, 140-152, 154-165, 167-173, 175-180, 182, 184-189, 191-196, 199, 201-204, 206-212, 214-227]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 101
	v: [228-233, 235, 239-248, 250-254, 256-279, 281-297, 300-307, 309-315, 317-330, 333-341]
Producer node: 172.31.2.134:9300	Node UUID: 29b53ee928fc64856754b9f5d2db2047
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 97
	v: [911-915, 917-918, 921, 923-935, 937-939, 941-950, 953-964, 966-969, 972-978, 981, 983-991, 993-1007, 1009-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 99
	v: [683-696, 698-700, 702-709, 711-712, 715, 717-730, 732-738, 741-753, 755-756, 758-759, 761-765, 768-780, 782-796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 101
	v: [797-805, 807-810, 812-823, 825, 827-835, 837-842, 844-847, 849-852, 854-858, 860-872, 874-878, 880-884, 886-895, 897-910]
Producer node: 127.0.0.1:9303	Node UUID: f9091069bcc9098aacf7e9ff52343eaa
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 100
	v: [342-345, 347-349, 351-353, 356-358, 361, 363-366, 368-381, 383-392, 394-396, 398-412, 414-429, 431-454]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 101
	v: [457-459, 461-465, 470-476, 478-482, 485-488, 490-495, 497-499, 501-502, 504-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 101
	v: [570-583, 585-593, 595-596, 599-600, 603-615, 617-624, 626-641, 643-645, 647-648, 650-666, 668-682]


2021/12/24 21:11:38 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:11:43 eventingSetup.go:719: Waiting for function: TestBucketDeleteWithRebOut status to change to undeployed
2021/12/24 21:11:43 eventingSetup.go:727: Function: TestBucketDeleteWithRebOut status changed to undeployed
2021/12/24 21:11:48 clusterSetup.go:397: Waiting for app: TestBucketDeleteWithRebOut to get un-deployed
2021/12/24 21:11:48 clusterSetup.go:405: App: TestBucketDeleteWithRebOut got un-deployed
2021/12/24 21:11:48 eventingSetup.go:46: No eventing-con process running
2021/12/24 21:11:48 eventingSetup.go:418: Function: TestBucketDeleteWithRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteWithRebOut deleting in background"
}
2021/12/24 21:11:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:11:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:11:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:12:01 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:12:01 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2021/12/24 21:12:01 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 21:12:06 Rebalance progress: 100
--- PASS: TestBucketDeleteWithRebOut (492.32s)
=== RUN   TestN1QLRecursion
2021/12/24 21:12:09 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 21:12:09 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2021/12/24 21:12:09 Removing node(s): [] from the cluster
2021/12/24 21:12:14 Rebalance progress: 100
2021/12/24 21:12:20 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:12:26 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:12:32 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:12:37 Deploying app: TestN1QLRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:12:39 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 stored in temp store"
}
2021/12/24 21:12:39 response body {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 stored in temp store"
} err 
2021/12/24 21:12:44 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/24 21:12:49 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/24 21:12:54 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/24 21:12:59 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/24 21:13:04 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/24 21:13:09 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/24 21:13:09 App: TestN1QLRecursion_function1 got deployed
2021/12/24 21:13:09 TestN1QLRecursion_function1 is deployed
2021/12/24 21:13:09 Deploying app: TestN1QLRecursion_function3. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:13:10 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 stored in temp store"
}
2021/12/24 21:13:10 response body {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 stored in temp store"
} err 
2021/12/24 21:13:15 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/24 21:13:20 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/24 21:13:25 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/24 21:13:30 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/24 21:13:30 App: TestN1QLRecursion_function3 got deployed
2021/12/24 21:13:30 TestN1QLRecursion_function3 is deployed
2021/12/24 21:13:30 Deploying app: TestN1QLRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:13:30 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestN1QLRecursion_function2 causes a cycle involving functions: [TestN1QLRecursion_function3 TestN1QLRecursion_function1], hence deployment is disallowed"
}
2021/12/24 21:13:30 response body {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestN1QLRecursion_function2 causes a cycle involving functions: [TestN1QLRecursion_function3 TestN1QLRecursion_function1], hence deployment is disallowed"
} err 
2021/12/24 21:13:30 Success: TestN1QLRecursion_function2 is not deployed
2021/12/24 21:13:35 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/24 21:13:40 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/24 21:13:45 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/24 21:13:50 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/24 21:13:50 App: TestN1QLRecursion_function1 got un-deployed
2021/12/24 21:13:50 No eventing-con process running
2021/12/24 21:13:50 Function: TestN1QLRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 deleting in background"
}
2021/12/24 21:13:52 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:13:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:13:59 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:14:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:14:09 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/24 21:14:14 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/24 21:14:19 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/24 21:14:24 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/24 21:14:24 App: TestN1QLRecursion_function3 got un-deployed
2021/12/24 21:14:24 No eventing-con process running
2021/12/24 21:14:24 Function: TestN1QLRecursion_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 deleting in background"
}
2021/12/24 21:14:26 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:14:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:14:33 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:14:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:14:39 Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/24 21:14:44 Rebalance progress: 100
--- PASS: TestN1QLRecursion (155.29s)
=== RUN   TestN1QLAllowRecursion
2021/12/24 21:14:44 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 21:14:45 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2021/12/24 21:14:45 Removing node(s): [] from the cluster
2021/12/24 21:14:50 Rebalance progress: 100
2021/12/24 21:14:56 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:15:02 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:15:08 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:15:13 Deploying app: TestN1QLAllowRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:15:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 stored in temp store"
}
2021/12/24 21:15:14 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 stored in temp store"
} err 
2021/12/24 21:15:19 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/24 21:15:24 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/24 21:15:29 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/24 21:15:34 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/24 21:15:34 App: TestN1QLAllowRecursion_function1 got deployed
2021/12/24 21:15:34 TestN1QLAllowRecursion_function1 is deployed
2021/12/24 21:15:34 Deploying app: TestN1QLAllowRecursion_function3. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:15:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 stored in temp store"
}
2021/12/24 21:15:36 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 stored in temp store"
} err 
2021/12/24 21:15:41 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/24 21:15:46 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/24 21:15:51 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/24 21:15:56 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/24 21:15:56 App: TestN1QLAllowRecursion_function3 got deployed
2021/12/24 21:15:56 TestN1QLAllowRecursion_function3 is deployed
2021/12/24 21:15:56 Deploying app: TestN1QLAllowRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:15:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 stored in temp store"
}
2021/12/24 21:15:57 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 stored in temp store"
} err 
2021/12/24 21:16:02 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/24 21:16:07 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/24 21:16:12 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/24 21:16:17 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/24 21:16:17 App: TestN1QLAllowRecursion_function2 got deployed
2021/12/24 21:16:17 Success: TestN1QLAllowRecursion_function2 is deployed after allow_interbucket_recursion
2021/12/24 21:16:22 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/24 21:16:27 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/24 21:16:32 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/24 21:16:37 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/24 21:16:37 App: TestN1QLAllowRecursion_function1 got un-deployed
2021/12/24 21:16:37 No eventing-con process running
2021/12/24 21:16:37 Function: TestN1QLAllowRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 deleting in background"
}
2021/12/24 21:16:39 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:16:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:16:46 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:16:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:16:56 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/24 21:17:01 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/24 21:17:06 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/24 21:17:11 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/24 21:17:11 App: TestN1QLAllowRecursion_function2 got un-deployed
2021/12/24 21:17:11 No eventing-con process running
2021/12/24 21:17:11 Function: TestN1QLAllowRecursion_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 deleting in background"
}
2021/12/24 21:17:13 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:17:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:17:20 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:17:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:17:30 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2021/12/24 21:17:35 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2021/12/24 21:17:40 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2021/12/24 21:17:45 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2021/12/24 21:17:45 App: TestN1QLAllowRecursion_function3 got un-deployed
2021/12/24 21:17:45 No eventing-con process running
2021/12/24 21:17:45 Function: TestN1QLAllowRecursion_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 deleting in background"
}
2021/12/24 21:17:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:17:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:17:54 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:17:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:18:00 Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/24 21:18:05 Rebalance progress: 100
--- PASS: TestN1QLAllowRecursion (200.92s)
=== RUN   TestOnDeleteExpiryBucketOp
2021/12/24 21:18:05 Sleeping for some time
2021/12/24 21:18:15 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/24 21:18:15 App: TestOnDeleteExpiryBucketOp got un-deployed
2021/12/24 21:18:15 No eventing-con process running
2021/12/24 21:18:15 Function: TestOnDeleteExpiryBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteExpiryBucketOp not found"
}
2021/12/24 21:18:17 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:18:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:18:24 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:18:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:18:29 Deploying app: TestOnDeleteExpiryBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:18:30 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteExpiryBucketOp stored in temp store"
}
2021/12/24 21:18:30 Starting bucket ops to source bucket
2021/12/24 21:19:19 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 21:19:24 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 21:19:24 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 21:19:24 Starting bucket ops to source bucket
2021/12/24 21:19:25 Starting bucket ops to source bucket
2021/12/24 21:20:31 Waiting for dst bucket item count to get to: 7000 curr count: 5000
2021/12/24 21:20:31 src & dst bucket item count matched up. src bucket count: 7000 dst bucket count: 7000
2021/12/24 21:20:31 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:20:36 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/24 21:20:41 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/24 21:20:46 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/24 21:20:51 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/24 21:20:51 App: TestOnDeleteExpiryBucketOp got un-deployed
2021/12/24 21:20:51 No eventing-con process running
2021/12/24 21:20:51 Function: TestOnDeleteExpiryBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteExpiryBucketOp deleting in background"
}
2021/12/24 21:20:53 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:21:03 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/24 21:21:08 Waiting for dst bucket item count to get to: 0 curr count: 501
2021/12/24 21:21:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:21:10 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:21:20 Waiting for dst bucket item count to get to: 0 curr count: 4641
2021/12/24 21:21:25 Waiting for dst bucket item count to get to: 0 curr count: 4641
2021/12/24 21:21:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteExpiryBucketOp (199.71s)
=== RUN   TestTimerOverWriteSameReference
2021/12/24 21:21:30 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/24 21:21:30 App: TestTimerOverWriteSameReference got un-deployed
2021/12/24 21:21:30 No eventing-con process running
2021/12/24 21:21:30 Function: TestTimerOverWriteSameReference delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerOverWriteSameReference not found"
}
2021/12/24 21:21:32 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:21:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:21:39 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:21:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:21:44 Deploying app: TestTimerOverWriteSameReference. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:21:45 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverWriteSameReference stored in temp store"
}
2021/12/24 21:21:50 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/24 21:21:55 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/24 21:22:00 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/24 21:22:05 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/24 21:22:05 App: TestTimerOverWriteSameReference got deployed
2021/12/24 21:22:15 Starting bucket ops to source bucket
2021/12/24 21:23:16 src & dst bucket item count matched up. src bucket count: 1 dst bucket count: 1
2021/12/24 21:23:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:23:31 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/24 21:23:36 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/24 21:23:41 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/24 21:23:46 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/24 21:23:46 App: TestTimerOverWriteSameReference got un-deployed
2021/12/24 21:23:46 No eventing-con process running
2021/12/24 21:23:46 Function: TestTimerOverWriteSameReference delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverWriteSameReference deleting in background"
}
2021/12/24 21:23:48 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:23:58 Waiting for dst bucket item count to get to: 0 curr count: 753
2021/12/24 21:24:03 Waiting for dst bucket item count to get to: 0 curr count: 253
2021/12/24 21:24:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:24:05 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:24:15 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/24 21:24:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerOverWriteSameReference (169.99s)
=== RUN   TestCancelTimerBucketop
2021/12/24 21:24:20 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/24 21:24:20 App: TestCancelTimerBucketop got un-deployed
2021/12/24 21:24:20 No eventing-con process running
2021/12/24 21:24:20 Function: TestCancelTimerBucketop delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCancelTimerBucketop not found"
}
2021/12/24 21:24:22 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:24:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:24:29 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:24:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:24:34 Deploying app: TestCancelTimerBucketop. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:24:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCancelTimerBucketop stored in temp store"
}
2021/12/24 21:24:40 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/24 21:24:45 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/24 21:24:50 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/24 21:24:55 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/24 21:24:55 App: TestCancelTimerBucketop got deployed
2021/12/24 21:24:55 Starting bucket ops to source bucket
2021/12/24 21:25:02 Starting bucket ops to source bucket
2021/12/24 21:26:04 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/24 21:26:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:26:10 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/24 21:26:15 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/24 21:26:20 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/24 21:26:25 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/24 21:26:25 App: TestCancelTimerBucketop got un-deployed
2021/12/24 21:26:25 No eventing-con process running
2021/12/24 21:26:25 Function: TestCancelTimerBucketop delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCancelTimerBucketop deleting in background"
}
2021/12/24 21:26:27 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:26:37 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/24 21:26:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:26:38 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:26:48 Waiting for dst bucket item count to get to: 0 curr count: 849
2021/12/24 21:26:53 Waiting for dst bucket item count to get to: 0 curr count: 349
2021/12/24 21:26:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCancelTimerBucketop (158.45s)
=== RUN   TestJSExpiryDate
2021/12/24 21:26:58 Starting bucket ops to source bucket
2021/12/24 21:27:16 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 21:27:16 Deploying app: TestJSExpiryDate. Item count src bucket: 5000 dst bucket: 0
2021/12/24 21:27:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestJSExpiryDate stored in temp store"
}
2021/12/24 21:27:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:27:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:27:48 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/24 21:27:53 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/24 21:27:58 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/24 21:28:03 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/24 21:28:03 App: TestJSExpiryDate got un-deployed
2021/12/24 21:28:03 No eventing-con process running
2021/12/24 21:28:03 Function: TestJSExpiryDate delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestJSExpiryDate deleting in background"
}
2021/12/24 21:28:05 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:28:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:28:12 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:28:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestJSExpiryDate (83.62s)
=== RUN   TestBinaryDoc
2021/12/24 21:28:22 Starting bucket ops to source bucket
2021/12/24 21:28:22 Deploying app: TestBinaryDoc. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:28:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBinaryDoc stored in temp store"
}
2021/12/24 21:28:23 Starting bucket ops to source bucket
2021/12/24 21:28:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:28:24 Deleting source bucket docs now
2021/12/24 21:28:24 Starting bucket ops to source bucket
2021/12/24 21:29:01 Waiting for dst bucket item count to get to: 32 curr count: 24
2021/12/24 21:29:06 Waiting for dst bucket item count to get to: 32 curr count: 28
2021/12/24 21:29:06 src & dst bucket item count matched up. src bucket count: 32 dst bucket count: 32
2021/12/24 21:29:06 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:29:11 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/24 21:29:16 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/24 21:29:21 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/24 21:29:26 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/24 21:29:26 App: TestBinaryDoc got un-deployed
2021/12/24 21:29:26 No eventing-con process running
2021/12/24 21:29:26 Function: TestBinaryDoc delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBinaryDoc deleting in background"
}
2021/12/24 21:29:28 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:29:38 Waiting for dst bucket item count to get to: 0 curr count: 20
2021/12/24 21:29:43 Waiting for dst bucket item count to get to: 0 curr count: 2
2021/12/24 21:29:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:29:45 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:29:55 Waiting for dst bucket item count to get to: 0 curr count: 32
2021/12/24 21:29:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBinaryDoc (97.46s)
=== RUN   TestConstantBindings
2021/12/24 21:29:55 Deploying app: TestConstantBindings. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:29:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestConstantBindings stored in temp store"
}
2021/12/24 21:29:56 Starting bucket ops to source bucket
2021/12/24 21:30:01 Waiting for dst bucket item count to get to: 6000 curr count: 0
2021/12/24 21:30:06 Waiting for dst bucket item count to get to: 6000 curr count: 0
2021/12/24 21:30:11 Waiting for dst bucket item count to get to: 6000 curr count: 0
2021/12/24 21:30:16 Waiting for dst bucket item count to get to: 6000 curr count: 2117
2021/12/24 21:30:21 Waiting for dst bucket item count to get to: 6000 curr count: 2117
2021/12/24 21:30:21 src & dst bucket item count matched up. src bucket count: 6000 dst bucket count: 6000
2021/12/24 21:30:21 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:30:27 Waiting for app: TestConstantBindings to get un-deployed
2021/12/24 21:30:32 Waiting for app: TestConstantBindings to get un-deployed
2021/12/24 21:30:37 Waiting for app: TestConstantBindings to get un-deployed
2021/12/24 21:30:42 Waiting for app: TestConstantBindings to get un-deployed
2021/12/24 21:30:42 App: TestConstantBindings got un-deployed
2021/12/24 21:30:42 No eventing-con process running
2021/12/24 21:30:42 Function: TestConstantBindings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestConstantBindings deleting in background"
}
2021/12/24 21:30:44 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:30:54 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/24 21:30:59 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/24 21:30:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:31:00 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:31:10 Waiting for dst bucket item count to get to: 0 curr count: 4585
2021/12/24 21:31:15 Waiting for dst bucket item count to get to: 0 curr count: 4585
2021/12/24 21:31:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestConstantBindings (80.76s)
=== RUN   TestCodeInsight
2021/12/24 21:31:20 Waiting for app: TestCodeInsight to get un-deployed
2021/12/24 21:31:20 App: TestCodeInsight got un-deployed
2021/12/24 21:31:20 No eventing-con process running
2021/12/24 21:31:20 Function: TestCodeInsight delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCodeInsight not found"
}
2021/12/24 21:31:22 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:31:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:31:29 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:31:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:31:34 Starting bucket ops to source bucket
2021/12/24 21:31:35 Deploying app: TestCodeInsight. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:31:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCodeInsight stored in temp store"
}
2021/12/24 21:31:41 Waiting for app: TestCodeInsight to get deployed
2021/12/24 21:31:46 Waiting for app: TestCodeInsight to get deployed
2021/12/24 21:31:51 Waiting for app: TestCodeInsight to get deployed
2021/12/24 21:31:56 Waiting for app: TestCodeInsight to get deployed
2021/12/24 21:31:56 App: TestCodeInsight got deployed
2021/12/24 21:32:01 Waiting for dst bucket item count to get to: 1000 curr count: 458
2021/12/24 21:32:01 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/24 21:32:06 Waiting for app: TestCodeInsight to get un-deployed
2021/12/24 21:32:11 Waiting for app: TestCodeInsight to get un-deployed
2021/12/24 21:32:16 Waiting for app: TestCodeInsight to get un-deployed
2021/12/24 21:32:21 Waiting for app: TestCodeInsight to get un-deployed
2021/12/24 21:32:21 App: TestCodeInsight got un-deployed
2021/12/24 21:32:21 No eventing-con process running
2021/12/24 21:32:21 Function: TestCodeInsight delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCodeInsight deleting in background"
}
2021/12/24 21:32:23 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:32:33 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/24 21:32:38 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/24 21:32:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:32:40 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:32:50 Waiting for dst bucket item count to get to: 0 curr count: 514
2021/12/24 21:32:55 Waiting for dst bucket item count to get to: 0 curr count: 514
2021/12/24 21:32:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCodeInsight (99.46s)
=== RUN   TestParserTransform
--- PASS: TestParserTransform (0.06s)
=== RUN   TestParserDetect
--- PASS: TestParserDetect (0.00s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	13188.952s

Functional tests took 3 hours, 39 minutes and 52 seconds.

N1ql tests

2021/12/24 21:33:03 Started n1ql
2021/12/24 21:33:13 Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2021/12/24 21:33:14 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2021/12/24 21:33:14 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 21:33:14 Removing node(s): [] from the cluster
2021/12/24 21:33:19 Rebalance progress: 100
=== RUN   TestRecursiveMutationN1QL
2021/12/24 21:33:24 Waiting for app: TestRecursiveMutationN1QL to get un-deployed
2021/12/24 21:33:24 App: TestRecursiveMutationN1QL got un-deployed
2021/12/24 21:33:24 No eventing-con process running
2021/12/24 21:33:24 Function: TestRecursiveMutationN1QL delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestRecursiveMutationN1QL not found"
}
2021/12/24 21:33:26 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:33:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:33:33 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:33:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:33:38 Deploying app: TestRecursiveMutationN1QL. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:33:38 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Function: TestRecursiveMutationN1QL N1QL DML to source keyspace default:default"
}
--- PASS: TestRecursiveMutationN1QL (18.57s)
=== RUN   TestFlexReset1
2021/12/24 21:33:43 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/24 21:33:43 App: TestFlexReset1 got un-deployed
2021/12/24 21:33:43 No eventing-con process running
2021/12/24 21:33:43 Function: TestFlexReset1 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestFlexReset1 not found"
}
2021/12/24 21:33:44 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:33:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:33:51 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:33:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:33:56 Starting bucket ops to source bucket
2021/12/24 21:33:57 Deploying app: TestFlexReset1. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:33:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset1 stored in temp store"
}
2021/12/24 21:34:03 Waiting for app: TestFlexReset1 to get deployed
2021/12/24 21:34:08 Waiting for app: TestFlexReset1 to get deployed
2021/12/24 21:34:13 Waiting for app: TestFlexReset1 to get deployed
2021/12/24 21:34:18 Waiting for app: TestFlexReset1 to get deployed
2021/12/24 21:34:18 App: TestFlexReset1 got deployed
2021/12/24 21:34:23 Waiting for dst bucket item count to get to: 1000 curr count: 19
2021/12/24 21:34:23 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/24 21:34:23 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:34:28 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/24 21:34:33 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/24 21:34:38 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/24 21:34:43 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/24 21:34:43 App: TestFlexReset1 got un-deployed
2021/12/24 21:34:43 No eventing-con process running
2021/12/24 21:34:43 Function: TestFlexReset1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset1 deleting in background"
}
2021/12/24 21:34:45 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:34:55 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/24 21:34:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:34:57 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:35:07 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/24 21:35:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestFlexReset1 (89.30s)
=== RUN   TestFlexReset2
2021/12/24 21:35:12 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/24 21:35:12 App: TestFlexReset2 got un-deployed
2021/12/24 21:35:12 No eventing-con process running
2021/12/24 21:35:12 Function: TestFlexReset2 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestFlexReset2 not found"
}
2021/12/24 21:35:14 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:35:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:35:21 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:35:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:35:26 Starting bucket ops to source bucket
2021/12/24 21:35:26 Deploying app: TestFlexReset2. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:35:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset2 stored in temp store"
}
2021/12/24 21:35:32 Waiting for app: TestFlexReset2 to get deployed
2021/12/24 21:35:37 Waiting for app: TestFlexReset2 to get deployed
2021/12/24 21:35:42 Waiting for app: TestFlexReset2 to get deployed
2021/12/24 21:35:47 Waiting for app: TestFlexReset2 to get deployed
2021/12/24 21:35:47 App: TestFlexReset2 got deployed
2021/12/24 21:35:52 Waiting for dst bucket item count to get to: 1000 curr count: 57
2021/12/24 21:35:52 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/24 21:35:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:35:58 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/24 21:36:03 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/24 21:36:08 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/24 21:36:13 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/24 21:36:13 App: TestFlexReset2 got un-deployed
2021/12/24 21:36:13 No eventing-con process running
2021/12/24 21:36:13 Function: TestFlexReset2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset2 deleting in background"
}
2021/12/24 21:36:14 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:36:24 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/24 21:36:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:36:26 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:36:36 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/24 21:36:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestFlexReset2 (89.29s)
=== RUN   TestN1QLLabelledBreak
2021/12/24 21:36:41 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/24 21:36:41 App: TestN1QLLabelledBreak got un-deployed
2021/12/24 21:36:41 No eventing-con process running
2021/12/24 21:36:41 Function: TestN1QLLabelledBreak delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLLabelledBreak not found"
}
2021/12/24 21:36:43 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:36:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:36:50 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:36:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:36:55 Deploying app: TestN1QLLabelledBreak. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:36:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLLabelledBreak stored in temp store"
}
2021/12/24 21:37:01 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/24 21:37:06 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/24 21:37:11 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/24 21:37:16 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/24 21:37:16 App: TestN1QLLabelledBreak got deployed
2021/12/24 21:37:16 Starting bucket ops to source bucket
2021/12/24 21:37:26 Waiting for dst bucket item count to get to: 10000 curr count: 301
2021/12/24 21:37:31 Waiting for dst bucket item count to get to: 10000 curr count: 301
2021/12/24 21:37:36 Waiting for dst bucket item count to get to: 10000 curr count: 301
2021/12/24 21:37:41 Waiting for dst bucket item count to get to: 10000 curr count: 3674
2021/12/24 21:37:46 Waiting for dst bucket item count to get to: 10000 curr count: 3674
2021/12/24 21:37:51 Waiting for dst bucket item count to get to: 10000 curr count: 7721
2021/12/24 21:37:56 Waiting for dst bucket item count to get to: 10000 curr count: 7721
2021/12/24 21:37:56 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 21:37:56 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:38:01 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/24 21:38:06 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/24 21:38:11 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/24 21:38:16 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/24 21:38:16 App: TestN1QLLabelledBreak got un-deployed
2021/12/24 21:38:16 No eventing-con process running
2021/12/24 21:38:16 Function: TestN1QLLabelledBreak delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLLabelledBreak deleting in background"
}
2021/12/24 21:38:18 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:38:28 Waiting for dst bucket item count to get to: 0 curr count: 3410
2021/12/24 21:38:33 Waiting for dst bucket item count to get to: 0 curr count: 910
2021/12/24 21:38:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:38:35 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:38:45 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/24 21:38:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLLabelledBreak (128.53s)
=== RUN   TestN1QLUnlabelledBreak
2021/12/24 21:38:50 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/24 21:38:50 App: TestN1QLUnlabelledBreak got un-deployed
2021/12/24 21:38:50 No eventing-con process running
2021/12/24 21:38:50 Function: TestN1QLUnlabelledBreak delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLUnlabelledBreak not found"
}
2021/12/24 21:38:52 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:38:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:38:58 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:39:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:39:03 Deploying app: TestN1QLUnlabelledBreak. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:39:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLUnlabelledBreak stored in temp store"
}
2021/12/24 21:39:09 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/24 21:39:15 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/24 21:39:20 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/24 21:39:25 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/24 21:39:25 App: TestN1QLUnlabelledBreak got deployed
2021/12/24 21:39:25 Starting bucket ops to source bucket
2021/12/24 21:39:34 Waiting for dst bucket item count to get to: 10000 curr count: 257
2021/12/24 21:39:39 Waiting for dst bucket item count to get to: 10000 curr count: 744
2021/12/24 21:39:44 Waiting for dst bucket item count to get to: 10000 curr count: 3222
2021/12/24 21:39:49 Waiting for dst bucket item count to get to: 10000 curr count: 3222
2021/12/24 21:39:54 Waiting for dst bucket item count to get to: 10000 curr count: 6078
2021/12/24 21:39:59 Waiting for dst bucket item count to get to: 10000 curr count: 8343
2021/12/24 21:39:59 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 21:39:59 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:40:04 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/24 21:40:10 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/24 21:40:15 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/24 21:40:20 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/24 21:40:20 App: TestN1QLUnlabelledBreak got un-deployed
2021/12/24 21:40:20 No eventing-con process running
2021/12/24 21:40:20 Function: TestN1QLUnlabelledBreak delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLUnlabelledBreak deleting in background"
}
2021/12/24 21:40:21 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:40:31 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 21:40:36 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 21:40:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:40:38 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:40:48 Waiting for dst bucket item count to get to: 0 curr count: 8189
2021/12/24 21:40:53 Waiting for dst bucket item count to get to: 0 curr count: 3189
2021/12/24 21:40:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLUnlabelledBreak (128.54s)
=== RUN   TestN1QLThrowStatement
2021/12/24 21:40:58 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/24 21:40:58 App: TestN1QLThrowStatement got un-deployed
2021/12/24 21:40:58 No eventing-con process running
2021/12/24 21:40:58 Function: TestN1QLThrowStatement delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLThrowStatement not found"
}
2021/12/24 21:41:00 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:41:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:41:07 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:41:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:41:12 Deploying app: TestN1QLThrowStatement. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:41:13 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLThrowStatement stored in temp store"
}
2021/12/24 21:41:18 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/24 21:41:23 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/24 21:41:28 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/24 21:41:33 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/24 21:41:33 App: TestN1QLThrowStatement got deployed
2021/12/24 21:41:33 Starting bucket ops to source bucket
2021/12/24 21:41:42 Waiting for dst bucket item count to get to: 10000 curr count: 0
2021/12/24 21:41:47 Waiting for dst bucket item count to get to: 10000 curr count: 0
2021/12/24 21:41:52 Waiting for dst bucket item count to get to: 10000 curr count: 958
2021/12/24 21:41:57 Waiting for dst bucket item count to get to: 10000 curr count: 2932
2021/12/24 21:42:02 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/24 21:42:07 Waiting for dst bucket item count to get to: 10000 curr count: 7051
2021/12/24 21:42:12 Waiting for dst bucket item count to get to: 10000 curr count: 9063
2021/12/24 21:42:17 Waiting for dst bucket item count to get to: 10000 curr count: 9743
2021/12/24 21:42:17 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/24 21:42:17 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:42:23 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/24 21:42:28 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/24 21:42:33 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/24 21:42:38 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/24 21:42:38 App: TestN1QLThrowStatement got un-deployed
2021/12/24 21:42:38 No eventing-con process running
2021/12/24 21:42:38 Function: TestN1QLThrowStatement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLThrowStatement deleting in background"
}
2021/12/24 21:42:39 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:42:50 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 21:42:55 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 21:42:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:42:56 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:43:06 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/24 21:43:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLThrowStatement (132.99s)
=== RUN   TestN1QLNestedForLoop
2021/12/24 21:43:11 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/24 21:43:11 App: TestN1QLNestedForLoop got un-deployed
2021/12/24 21:43:11 No eventing-con process running
2021/12/24 21:43:11 Function: TestN1QLNestedForLoop delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLNestedForLoop not found"
}
2021/12/24 21:43:13 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:43:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:43:20 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:43:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:43:25 Deploying app: TestN1QLNestedForLoop. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:43:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLNestedForLoop stored in temp store"
}
2021/12/24 21:43:31 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/24 21:43:36 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/24 21:43:41 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/24 21:43:46 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/24 21:43:46 App: TestN1QLNestedForLoop got deployed
2021/12/24 21:43:46 Starting bucket ops to source bucket
2021/12/24 21:43:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/24 21:44:00 Waiting for dst bucket item count to get to: 5000 curr count: 153
2021/12/24 21:44:05 Waiting for dst bucket item count to get to: 5000 curr count: 153
2021/12/24 21:44:10 Waiting for dst bucket item count to get to: 5000 curr count: 2200
2021/12/24 21:44:15 Waiting for dst bucket item count to get to: 5000 curr count: 2200
2021/12/24 21:44:20 Waiting for dst bucket item count to get to: 5000 curr count: 4584
2021/12/24 21:44:25 Waiting for dst bucket item count to get to: 5000 curr count: 4584
2021/12/24 21:44:25 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 21:44:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:44:31 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/24 21:44:36 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/24 21:44:41 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/24 21:44:46 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/24 21:44:46 App: TestN1QLNestedForLoop got un-deployed
2021/12/24 21:44:46 No eventing-con process running
2021/12/24 21:44:46 Function: TestN1QLNestedForLoop delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLNestedForLoop deleting in background"
}
2021/12/24 21:44:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:44:57 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 21:44:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:44:59 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:45:09 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 21:45:14 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/24 21:45:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLNestedForLoop (127.95s)
=== RUN   TestN1QLAutoClose
2021/12/24 21:45:19 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/24 21:45:19 App: TestN1QLAutoClose got un-deployed
2021/12/24 21:45:19 No eventing-con process running
2021/12/24 21:45:19 Function: TestN1QLAutoClose delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLAutoClose not found"
}
2021/12/24 21:45:21 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:45:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:45:28 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:45:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:45:33 Deploying app: TestN1QLAutoClose. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:45:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAutoClose stored in temp store"
}
2021/12/24 21:45:39 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/24 21:45:44 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/24 21:45:49 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/24 21:45:54 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/24 21:45:54 App: TestN1QLAutoClose got deployed
2021/12/24 21:45:54 Starting bucket ops to source bucket
2021/12/24 21:46:00 Waiting for dst bucket item count to get to: 500 curr count: 0
2021/12/24 21:46:05 Waiting for dst bucket item count to get to: 500 curr count: 4
2021/12/24 21:46:10 Waiting for dst bucket item count to get to: 500 curr count: 8
2021/12/24 21:46:15 Waiting for dst bucket item count to get to: 500 curr count: 17
2021/12/24 21:46:20 Waiting for dst bucket item count to get to: 500 curr count: 29
2021/12/24 21:46:25 Waiting for dst bucket item count to get to: 500 curr count: 39
2021/12/24 21:46:30 Waiting for dst bucket item count to get to: 500 curr count: 50
2021/12/24 21:46:35 Waiting for dst bucket item count to get to: 500 curr count: 60
2021/12/24 21:46:40 Waiting for dst bucket item count to get to: 500 curr count: 72
2021/12/24 21:46:45 Waiting for dst bucket item count to get to: 500 curr count: 83
2021/12/24 21:46:50 Waiting for dst bucket item count to get to: 500 curr count: 94
2021/12/24 21:46:55 Waiting for dst bucket item count to get to: 500 curr count: 114
2021/12/24 21:47:00 Waiting for dst bucket item count to get to: 500 curr count: 114
2021/12/24 21:47:05 Waiting for dst bucket item count to get to: 500 curr count: 114
2021/12/24 21:47:10 Waiting for dst bucket item count to get to: 500 curr count: 135
2021/12/24 21:47:15 Waiting for dst bucket item count to get to: 500 curr count: 135
2021/12/24 21:47:20 Waiting for dst bucket item count to get to: 500 curr count: 156
2021/12/24 21:47:25 Waiting for dst bucket item count to get to: 500 curr count: 156
2021/12/24 21:47:30 Waiting for dst bucket item count to get to: 500 curr count: 178
2021/12/24 21:47:35 Waiting for dst bucket item count to get to: 500 curr count: 178
2021/12/24 21:47:40 Waiting for dst bucket item count to get to: 500 curr count: 201
2021/12/24 21:47:45 Waiting for dst bucket item count to get to: 500 curr count: 201
2021/12/24 21:47:50 Waiting for dst bucket item count to get to: 500 curr count: 222
2021/12/24 21:47:55 Waiting for dst bucket item count to get to: 500 curr count: 222
2021/12/24 21:48:00 Waiting for dst bucket item count to get to: 500 curr count: 242
2021/12/24 21:48:05 Waiting for dst bucket item count to get to: 500 curr count: 242
2021/12/24 21:48:10 Waiting for dst bucket item count to get to: 500 curr count: 263
2021/12/24 21:48:15 Waiting for dst bucket item count to get to: 500 curr count: 263
2021/12/24 21:48:20 Waiting for dst bucket item count to get to: 500 curr count: 285
2021/12/24 21:48:25 Waiting for dst bucket item count to get to: 500 curr count: 285
2021/12/24 21:48:30 Waiting for dst bucket item count to get to: 500 curr count: 306
2021/12/24 21:48:35 Waiting for dst bucket item count to get to: 500 curr count: 306
2021/12/24 21:48:40 Waiting for dst bucket item count to get to: 500 curr count: 328
2021/12/24 21:48:45 Waiting for dst bucket item count to get to: 500 curr count: 328
2021/12/24 21:48:50 Waiting for dst bucket item count to get to: 500 curr count: 348
2021/12/24 21:48:55 Waiting for dst bucket item count to get to: 500 curr count: 348
2021/12/24 21:49:00 Waiting for dst bucket item count to get to: 500 curr count: 369
2021/12/24 21:49:05 Waiting for dst bucket item count to get to: 500 curr count: 369
2021/12/24 21:49:10 Waiting for dst bucket item count to get to: 500 curr count: 390
2021/12/24 21:49:15 Waiting for dst bucket item count to get to: 500 curr count: 390
2021/12/24 21:49:20 Waiting for dst bucket item count to get to: 500 curr count: 412
2021/12/24 21:49:25 Waiting for dst bucket item count to get to: 500 curr count: 425
2021/12/24 21:49:30 Waiting for dst bucket item count to get to: 500 curr count: 433
2021/12/24 21:49:35 Waiting for dst bucket item count to get to: 500 curr count: 445
2021/12/24 21:49:40 Waiting for dst bucket item count to get to: 500 curr count: 457
2021/12/24 21:49:45 Waiting for dst bucket item count to get to: 500 curr count: 468
2021/12/24 21:49:50 Waiting for dst bucket item count to get to: 500 curr count: 478
2021/12/24 21:49:55 Waiting for dst bucket item count to get to: 500 curr count: 486
2021/12/24 21:50:00 Waiting for dst bucket item count to get to: 500 curr count: 496
2021/12/24 21:50:00 src & dst bucket item count matched up. src bucket count: 500 dst bucket count: 500
2021/12/24 21:50:00 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:50:05 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/24 21:50:10 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/24 21:50:15 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/24 21:50:20 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/24 21:50:20 App: TestN1QLAutoClose got un-deployed
2021/12/24 21:50:20 No eventing-con process running
2021/12/24 21:50:20 Function: TestN1QLAutoClose delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAutoClose deleting in background"
}
2021/12/24 21:50:22 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:50:32 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/24 21:50:37 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/24 21:50:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:50:39 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:50:49 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/24 21:50:54 Waiting for dst bucket item count to get to: 0 curr count: 250
2021/12/24 21:50:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLAutoClose (339.65s)
=== RUN   TestN1QLPosParams
2021/12/24 21:50:59 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/24 21:50:59 App: TestN1QLPosParams got un-deployed
2021/12/24 21:50:59 No eventing-con process running
2021/12/24 21:50:59 Function: TestN1QLPosParams delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLPosParams not found"
}
2021/12/24 21:51:01 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:51:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:51:08 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:51:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:51:13 Deploying app: TestN1QLPosParams. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:51:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLPosParams stored in temp store"
}
2021/12/24 21:51:19 Waiting for app: TestN1QLPosParams to get deployed
2021/12/24 21:51:24 Waiting for app: TestN1QLPosParams to get deployed
2021/12/24 21:51:29 Waiting for app: TestN1QLPosParams to get deployed
2021/12/24 21:51:34 Waiting for app: TestN1QLPosParams to get deployed
2021/12/24 21:51:34 App: TestN1QLPosParams got deployed
2021/12/24 21:51:34 Starting bucket ops to source bucket
2021/12/24 21:51:43 Waiting for dst bucket item count to get to: 5000 curr count: 552
2021/12/24 21:51:48 Waiting for dst bucket item count to get to: 5000 curr count: 1650
2021/12/24 21:51:53 Waiting for dst bucket item count to get to: 5000 curr count: 3598
2021/12/24 21:51:53 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 21:51:53 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:51:59 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/24 21:52:04 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/24 21:52:09 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/24 21:52:14 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/24 21:52:14 App: TestN1QLPosParams got un-deployed
2021/12/24 21:52:14 No eventing-con process running
2021/12/24 21:52:14 Function: TestN1QLPosParams delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLPosParams deleting in background"
}
2021/12/24 21:52:16 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:52:26 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 21:52:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:52:27 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:52:37 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 21:52:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLPosParams (103.44s)
=== RUN   TestN1QLExhaustConnPool
2021/12/24 21:52:42 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/24 21:52:42 App: TestN1QLExhaustConnPool got un-deployed
2021/12/24 21:52:42 No eventing-con process running
2021/12/24 21:52:42 Function: TestN1QLExhaustConnPool delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLExhaustConnPool not found"
}
2021/12/24 21:52:44 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:52:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:52:51 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:52:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:52:56 Deploying app: TestN1QLExhaustConnPool. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:52:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLExhaustConnPool stored in temp store"
}
2021/12/24 21:53:02 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/24 21:53:07 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/24 21:53:12 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/24 21:53:17 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/24 21:53:17 App: TestN1QLExhaustConnPool got deployed
2021/12/24 21:53:17 Starting bucket ops to source bucket
2021/12/24 21:53:22 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/24 21:53:27 Waiting for dst bucket item count to get to: 100 curr count: 35
2021/12/24 21:53:32 Waiting for dst bucket item count to get to: 100 curr count: 35
2021/12/24 21:53:32 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/24 21:53:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:53:38 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/24 21:53:43 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/24 21:53:48 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/24 21:53:53 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/24 21:53:53 App: TestN1QLExhaustConnPool got un-deployed
2021/12/24 21:53:53 No eventing-con process running
2021/12/24 21:53:53 Function: TestN1QLExhaustConnPool delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLExhaustConnPool deleting in background"
}
2021/12/24 21:53:54 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:54:04 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 21:54:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:54:06 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:54:16 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/24 21:54:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLExhaustConnPool (98.86s)
=== RUN   TestN1QLGraceSufficientTimeOut
2021/12/24 21:54:21 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/24 21:54:21 App: TestN1QLGraceSufficientTimeOut got un-deployed
2021/12/24 21:54:21 No eventing-con process running
2021/12/24 21:54:21 Function: TestN1QLGraceSufficientTimeOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLGraceSufficientTimeOut not found"
}
2021/12/24 21:54:23 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:54:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:54:30 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:54:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:54:35 Starting bucket ops to source bucket
2021/12/24 21:54:52 Starting bucket ops to source bucket
2021/12/24 21:55:09 Deploying app: TestN1QLGraceSufficientTimeOut. Item count src bucket: 30000 dst bucket: 10558
2021/12/24 21:55:10 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLGraceSufficientTimeOut stored in temp store"
}
2021/12/24 21:55:15 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/24 21:55:21 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/24 21:55:26 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/24 21:55:31 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/24 21:55:31 App: TestN1QLGraceSufficientTimeOut got deployed
2021/12/24 21:55:31 Starting bucket ops to source bucket
2021/12/24 21:55:36 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 21:55:41 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 21:55:46 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 21:55:51 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 21:55:56 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 21:56:01 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 21:56:06 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 21:56:11 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 21:56:16 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 21:56:21 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 21:56:26 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/24 21:56:26 src & dst bucket item count matched up. src bucket count: 30001 dst bucket count: 30001
2021/12/24 21:56:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:56:31 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/24 21:56:36 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/24 21:56:41 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/24 21:56:46 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/24 21:56:46 App: TestN1QLGraceSufficientTimeOut got un-deployed
2021/12/24 21:56:46 No eventing-con process running
2021/12/24 21:56:46 Function: TestN1QLGraceSufficientTimeOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLGraceSufficientTimeOut deleting in background"
}
2021/12/24 21:56:48 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:56:58 Waiting for dst bucket item count to get to: 0 curr count: 18360
2021/12/24 21:57:03 Waiting for dst bucket item count to get to: 0 curr count: 3360
2021/12/24 21:57:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:57:05 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:57:15 Waiting for dst bucket item count to get to: 0 curr count: 30001
2021/12/24 21:57:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLGraceSufficientTimeOut (178.59s)
=== RUN   TestN1QLQueryConsistency
2021/12/24 21:57:20 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/24 21:57:20 App: n1qlquery_consistency got un-deployed
2021/12/24 21:57:20 No eventing-con process running
2021/12/24 21:57:20 Function: n1qlquery_consistency delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: n1qlquery_consistency not found"
}
2021/12/24 21:57:22 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:57:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:57:28 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:57:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:57:33 Starting bucket ops to source bucket
2021/12/24 21:57:37 Deploying app: n1qlquery_consistency. Item count src bucket: 0 dst bucket: 0
2021/12/24 21:57:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: n1qlquery_consistency stored in temp store"
}
2021/12/24 21:57:43 Waiting for app: n1qlquery_consistency to get deployed
2021/12/24 21:57:48 Waiting for app: n1qlquery_consistency to get deployed
2021/12/24 21:57:53 Waiting for app: n1qlquery_consistency to get deployed
2021/12/24 21:57:58 Waiting for app: n1qlquery_consistency to get deployed
2021/12/24 21:57:58 App: n1qlquery_consistency got deployed
2021/12/24 21:58:03 Waiting for dst bucket item count to get to: 5000 curr count: 13
2021/12/24 21:58:08 Waiting for dst bucket item count to get to: 5000 curr count: 2371
2021/12/24 21:58:13 Waiting for dst bucket item count to get to: 5000 curr count: 4858
2021/12/24 21:58:13 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/24 21:58:13 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/24 21:58:18 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/24 21:58:23 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/24 21:58:28 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/24 21:58:33 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/24 21:58:33 App: n1qlquery_consistency got un-deployed
2021/12/24 21:58:33 No eventing-con process running
2021/12/24 21:58:33 Function: n1qlquery_consistency delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: n1qlquery_consistency deleting in background"
}
2021/12/24 21:58:35 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:58:45 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 21:58:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 21:58:47 Context: Bucket flush, response code: 200 dump: 
2021/12/24 21:58:57 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/24 21:58:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLQueryConsistency (102.00s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	1548.826s

N1ql tests took 0 hours, 25 minutes and 54 seconds.

Starting server
Starting server: attempt 1

Rebalance tests

2021/12/24 22:00:32 Started rebalance
Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:45488->127.0.0.1:9000: read: connection reset by peer
Quota setup Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:45488->127.0.0.1:9000: read: connection reset by peer
=== RUN   TestDuplicateWithEventingRebIn
2021/12/24 22:00:50 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
running apps fetch error json: cannot unmarshal number into Go value of type string
2021/12/24 22:00:55 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/24 22:00:55 App: TestDuplicateWithEventingRebIn got un-deployed
2021/12/24 22:00:55 No eventing-con process running
2021/12/24 22:00:55 Function: TestDuplicateWithEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingRebIn not found"
}
2021/12/24 22:00:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:01:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:01:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:01:04 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:01:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:01:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:01:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:01:14 Deploying app: TestDuplicateWithEventingRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:01:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebIn stored in temp store"
}
2021/12/24 22:01:20 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/24 22:01:25 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/24 22:01:30 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/24 22:01:35 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/24 22:01:35 App: TestDuplicateWithEventingRebIn got deployed
2021/12/24 22:01:35 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 22:01:35 Starting bucket ops to source bucket
2021/12/24 22:01:50 Removing node(s): [] from the cluster
2021/12/24 22:01:55 Rebalance progress: 0
2021/12/24 22:02:00 Rebalance progress: 0
2021/12/24 22:02:05 Rebalance progress: 25
2021/12/24 22:02:10 Rebalance progress: 25
2021/12/24 22:02:15 Rebalance progress: 25
2021/12/24 22:02:20 Rebalance progress: 25
2021/12/24 22:02:25 Rebalance progress: 25
2021/12/24 22:02:30 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:02:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:02:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:02:30 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/24 22:02:30 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 22:02:30 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 22:02:35 Rebalance progress: 25
2021/12/24 22:02:40 Rebalance progress: 25
2021/12/24 22:02:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:02:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:02:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:02:45 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/24 22:02:45 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 22:02:45 Waiting for src bucket item count to get to: 200000 curr count: 103570
2021/12/24 22:02:50 Waiting for src bucket item count to get to: 200000 curr count: 103570
2021/12/24 22:02:55 Waiting for src bucket item count to get to: 200000 curr count: 119994
2021/12/24 22:03:00 Waiting for src bucket item count to get to: 200000 curr count: 119994
2021/12/24 22:03:05 Waiting for src bucket item count to get to: 200000 curr count: 136899
2021/12/24 22:03:10 Waiting for src bucket item count to get to: 200000 curr count: 136899
2021/12/24 22:03:15 Waiting for src bucket item count to get to: 200000 curr count: 153524
2021/12/24 22:03:20 Waiting for src bucket item count to get to: 200000 curr count: 153524
2021/12/24 22:03:25 Waiting for src bucket item count to get to: 200000 curr count: 169981
2021/12/24 22:03:30 Waiting for src bucket item count to get to: 200000 curr count: 169981
2021/12/24 22:03:35 Waiting for src bucket item count to get to: 200000 curr count: 186544
2021/12/24 22:03:40 Waiting for src bucket item count to get to: 200000 curr count: 186544
2021/12/24 22:03:50 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 22:03:55 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 22:04:00 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 22:04:05 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 22:04:11 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 22:04:16 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 22:04:21 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 22:04:26 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 22:04:31 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 22:04:36 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2021/12/24 22:04:36 Post SET ops. Expected item count: 200000 got 200001
2021/12/24 22:04:41 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/24 22:04:46 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/24 22:04:51 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/24 22:04:56 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/24 22:04:56 App: TestDuplicateWithEventingRebIn got un-deployed
2021/12/24 22:04:56 No eventing-con process running
2021/12/24 22:04:56 Function: TestDuplicateWithEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebIn deleting in background"
}
2021/12/24 22:04:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:05:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:05:07 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/24 22:05:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:05:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:05:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:05:19 Waiting for dst bucket item count to get to: 0 curr count: 200001
2021/12/24 22:05:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingRebIn (278.75s)
=== RUN   TestDuplicateWithEventingRebOut
2021/12/24 22:05:24 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 22:05:24 Removing node(s): [] from the cluster
2021/12/24 22:05:30 Rebalance progress: 100
2021/12/24 22:05:35 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/24 22:05:35 App: TestDuplicateWithEventingRebOut got un-deployed
2021/12/24 22:05:35 No eventing-con process running
2021/12/24 22:05:35 Function: TestDuplicateWithEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingRebOut not found"
}
2021/12/24 22:05:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:05:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:05:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:05:43 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:05:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:05:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:05:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:05:53 Deploying app: TestDuplicateWithEventingRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:05:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebOut stored in temp store"
}
2021/12/24 22:05:59 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/24 22:06:04 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/24 22:06:09 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/24 22:06:14 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/24 22:06:14 App: TestDuplicateWithEventingRebOut got deployed
2021/12/24 22:06:14 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 22:06:14 Starting bucket ops to source bucket
2021/12/24 22:06:19 Rebalance progress: 25
2021/12/24 22:06:24 Rebalance progress: 25
2021/12/24 22:06:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:06:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:06:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:06:29 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/24 22:06:29 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 22:06:29 Waiting for src bucket item count to get to: 200000 curr count: 8054
2021/12/24 22:06:34 Waiting for src bucket item count to get to: 200000 curr count: 24865
2021/12/24 22:06:39 Waiting for src bucket item count to get to: 200000 curr count: 24865
2021/12/24 22:06:44 Waiting for src bucket item count to get to: 200000 curr count: 41597
2021/12/24 22:06:49 Waiting for src bucket item count to get to: 200000 curr count: 41597
2021/12/24 22:06:54 Waiting for src bucket item count to get to: 200000 curr count: 58561
2021/12/24 22:06:59 Waiting for src bucket item count to get to: 200000 curr count: 58561
2021/12/24 22:07:04 Waiting for src bucket item count to get to: 200000 curr count: 58561
2021/12/24 22:07:09 Waiting for src bucket item count to get to: 200000 curr count: 75333
2021/12/24 22:07:14 Waiting for src bucket item count to get to: 200000 curr count: 75333
2021/12/24 22:07:19 Waiting for src bucket item count to get to: 200000 curr count: 91568
2021/12/24 22:07:24 Waiting for src bucket item count to get to: 200000 curr count: 91568
2021/12/24 22:07:29 Waiting for src bucket item count to get to: 200000 curr count: 108149
2021/12/24 22:07:34 Waiting for src bucket item count to get to: 200000 curr count: 125004
2021/12/24 22:07:39 Waiting for src bucket item count to get to: 200000 curr count: 125004
2021/12/24 22:07:44 Waiting for src bucket item count to get to: 200000 curr count: 142014
2021/12/24 22:07:49 Waiting for src bucket item count to get to: 200000 curr count: 142014
2021/12/24 22:07:54 Waiting for src bucket item count to get to: 200000 curr count: 159020
2021/12/24 22:07:59 Waiting for src bucket item count to get to: 200000 curr count: 159020
2021/12/24 22:08:04 Waiting for src bucket item count to get to: 200000 curr count: 175951
2021/12/24 22:08:09 Waiting for src bucket item count to get to: 200000 curr count: 175951
2021/12/24 22:08:14 Waiting for src bucket item count to get to: 200000 curr count: 192127
2021/12/24 22:08:19 Waiting for src bucket item count to get to: 200000 curr count: 192127
2021/12/24 22:08:24 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 22:08:24 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 22:08:29 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/24 22:08:34 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/24 22:08:39 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/24 22:08:44 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/24 22:08:44 App: TestDuplicateWithEventingRebOut got un-deployed
2021/12/24 22:08:45 No eventing-con process running
2021/12/24 22:08:45 Function: TestDuplicateWithEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebOut deleting in background"
}
2021/12/24 22:08:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:08:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:08:56 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/24 22:08:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:08:58 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:09:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:09:08 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/24 22:09:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingRebOut (228.79s)
=== RUN   TestDuplicateWithEventingSwapReb
2021/12/24 22:09:18 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/24 22:09:18 App: TestDuplicateWithEventingSwapReb got un-deployed
2021/12/24 22:09:18 No eventing-con process running
2021/12/24 22:09:18 Function: TestDuplicateWithEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingSwapReb not found"
}
2021/12/24 22:09:20 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:09:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:09:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:09:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:09:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:09:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:09:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:09:36 Deploying app: TestDuplicateWithEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:09:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingSwapReb stored in temp store"
}
2021/12/24 22:09:42 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/24 22:09:47 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/24 22:09:52 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/24 22:09:57 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/24 22:09:57 App: TestDuplicateWithEventingSwapReb got deployed
2021/12/24 22:09:57 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 22:09:57 Starting bucket ops to source bucket
2021/12/24 22:09:58 Removing node(s): [] from the cluster
2021/12/24 22:10:03 Rebalance progress: 25
2021/12/24 22:10:08 Rebalance progress: 25
2021/12/24 22:10:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:10:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:10:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:10:13 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/24 22:10:13 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 22:10:13 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 22:10:20 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 22:10:25 Rebalance progress: 16.66666666666667
2021/12/24 22:10:30 Rebalance progress: 16.66666666666667
2021/12/24 22:10:35 Rebalance progress: 16.66666666666667
2021/12/24 22:10:40 Rebalance progress: 22.78911564625851
2021/12/24 22:10:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:10:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:10:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:10:45 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 22:10:45 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 22:10:50 Rebalance progress: 16.66666666666667
2021/12/24 22:10:55 Rebalance progress: 16.66666666666667
2021/12/24 22:11:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:11:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:11:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:11:01 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 22:11:01 Waiting for src bucket item count to get to: 200000 curr count: 78989
2021/12/24 22:11:06 Waiting for src bucket item count to get to: 200000 curr count: 95791
2021/12/24 22:11:11 Waiting for src bucket item count to get to: 200000 curr count: 95791
2021/12/24 22:11:16 Waiting for src bucket item count to get to: 200000 curr count: 112110
2021/12/24 22:11:21 Waiting for src bucket item count to get to: 200000 curr count: 112110
2021/12/24 22:11:26 Waiting for src bucket item count to get to: 200000 curr count: 128691
2021/12/24 22:11:31 Waiting for src bucket item count to get to: 200000 curr count: 128691
2021/12/24 22:11:36 Waiting for src bucket item count to get to: 200000 curr count: 144979
2021/12/24 22:11:41 Waiting for src bucket item count to get to: 200000 curr count: 144979
2021/12/24 22:11:46 Waiting for src bucket item count to get to: 200000 curr count: 161751
2021/12/24 22:11:51 Waiting for src bucket item count to get to: 200000 curr count: 161751
2021/12/24 22:11:56 Waiting for src bucket item count to get to: 200000 curr count: 177803
2021/12/24 22:12:01 Waiting for src bucket item count to get to: 200000 curr count: 177803
2021/12/24 22:12:06 Waiting for src bucket item count to get to: 200000 curr count: 194333
2021/12/24 22:12:11 Waiting for src bucket item count to get to: 200000 curr count: 194333
2021/12/24 22:12:16 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 22:12:16 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 22:12:21 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/24 22:12:26 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/24 22:12:31 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/24 22:12:36 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/24 22:12:36 App: TestDuplicateWithEventingSwapReb got un-deployed
2021/12/24 22:12:36 No eventing-con process running
2021/12/24 22:12:36 Function: TestDuplicateWithEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingSwapReb deleting in background"
}
2021/12/24 22:12:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:12:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:12:48 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/24 22:12:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:12:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:12:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:12:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingSwapReb (226.38s)
=== RUN   TestDuplicateWithKVRebIn
2021/12/24 22:13:04 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/24 22:13:04 App: TestDuplicateWithKVRebIn got un-deployed
2021/12/24 22:13:04 No eventing-con process running
2021/12/24 22:13:04 Function: TestDuplicateWithKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVRebIn not found"
}
2021/12/24 22:13:06 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:13:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:13:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:13:13 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:13:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:13:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:13:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:13:23 Deploying app: TestDuplicateWithKVRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:13:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebIn stored in temp store"
}
2021/12/24 22:13:29 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/24 22:13:34 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/24 22:13:39 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/24 22:13:44 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/24 22:13:44 App: TestDuplicateWithKVRebIn got deployed
2021/12/24 22:13:44 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 22:13:44 Starting bucket ops to source bucket
2021/12/24 22:13:44 Removing node(s): [] from the cluster
2021/12/24 22:13:49 Rebalance progress: 16.66666666666667
2021/12/24 22:13:54 Rebalance progress: 16.66666666666667
2021/12/24 22:13:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:13:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:13:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:13:59 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 22:13:59 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 22:14:04 Rebalance progress: 16.66666666666667
2021/12/24 22:14:09 Rebalance progress: 16.66666666666667
2021/12/24 22:14:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:14:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:14:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:14:14 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 22:14:14 Waiting for src bucket item count to get to: 200000 curr count: 39821
2021/12/24 22:14:19 Waiting for src bucket item count to get to: 200000 curr count: 39821
2021/12/24 22:14:24 Waiting for src bucket item count to get to: 200000 curr count: 56233
2021/12/24 22:14:29 Waiting for src bucket item count to get to: 200000 curr count: 56233
2021/12/24 22:14:34 Waiting for src bucket item count to get to: 200000 curr count: 72929
2021/12/24 22:14:39 Waiting for src bucket item count to get to: 200000 curr count: 72929
2021/12/24 22:14:44 Waiting for src bucket item count to get to: 200000 curr count: 88491
2021/12/24 22:14:49 Waiting for src bucket item count to get to: 200000 curr count: 88491
2021/12/24 22:14:54 Waiting for src bucket item count to get to: 200000 curr count: 105107
2021/12/24 22:15:00 Waiting for src bucket item count to get to: 200000 curr count: 105107
2021/12/24 22:15:05 Waiting for src bucket item count to get to: 200000 curr count: 105107
2021/12/24 22:15:10 Waiting for src bucket item count to get to: 200000 curr count: 121785
2021/12/24 22:15:15 Waiting for src bucket item count to get to: 200000 curr count: 138543
2021/12/24 22:15:20 Waiting for src bucket item count to get to: 200000 curr count: 138543
2021/12/24 22:15:25 Waiting for src bucket item count to get to: 200000 curr count: 155241
2021/12/24 22:15:30 Waiting for src bucket item count to get to: 200000 curr count: 155241
2021/12/24 22:15:35 Waiting for src bucket item count to get to: 200000 curr count: 171921
2021/12/24 22:15:40 Waiting for src bucket item count to get to: 200000 curr count: 171921
2021/12/24 22:15:45 Waiting for src bucket item count to get to: 200000 curr count: 187700
2021/12/24 22:15:50 Waiting for src bucket item count to get to: 200000 curr count: 187700
2021/12/24 22:15:55 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 22:15:55 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 22:16:00 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/24 22:16:05 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/24 22:16:10 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/24 22:16:15 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/24 22:16:15 App: TestDuplicateWithKVRebIn got un-deployed
2021/12/24 22:16:15 No eventing-con process running
2021/12/24 22:16:15 Function: TestDuplicateWithKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebIn deleting in background"
}
2021/12/24 22:16:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:16:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:16:27 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/24 22:16:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:16:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:16:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:16:38 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/24 22:16:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVRebIn (223.89s)
=== RUN   TestDuplicateWithKVRebOut
2021/12/24 22:16:43 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 22:16:44 Removing node(s): [] from the cluster
2021/12/24 22:16:49 Rebalance progress: 100
2021/12/24 22:16:54 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/24 22:16:54 App: TestDuplicateWithKVRebOut got un-deployed
2021/12/24 22:16:54 No eventing-con process running
2021/12/24 22:16:54 Function: TestDuplicateWithKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVRebOut not found"
}
2021/12/24 22:16:56 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:17:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:17:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:17:02 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:17:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:17:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:17:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:17:12 Deploying app: TestDuplicateWithKVRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:17:13 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebOut stored in temp store"
}
2021/12/24 22:17:18 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/24 22:17:23 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/24 22:17:28 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/24 22:17:33 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/24 22:17:33 App: TestDuplicateWithKVRebOut got deployed
2021/12/24 22:17:33 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 22:17:33 Starting bucket ops to source bucket
2021/12/24 22:17:39 Rebalance progress: 16.66666666666667
2021/12/24 22:17:44 Rebalance progress: 16.66666666666667
2021/12/24 22:17:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:17:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:17:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:17:49 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 22:17:49 Waiting for src bucket item count to get to: 200000 curr count: 8925
2021/12/24 22:17:54 Waiting for src bucket item count to get to: 200000 curr count: 25184
2021/12/24 22:17:59 Waiting for src bucket item count to get to: 200000 curr count: 25184
2021/12/24 22:18:04 Waiting for src bucket item count to get to: 200000 curr count: 41142
2021/12/24 22:18:09 Waiting for src bucket item count to get to: 200000 curr count: 41142
2021/12/24 22:18:14 Waiting for src bucket item count to get to: 200000 curr count: 57841
2021/12/24 22:18:19 Waiting for src bucket item count to get to: 200000 curr count: 57841
2021/12/24 22:18:24 Waiting for src bucket item count to get to: 200000 curr count: 57841
2021/12/24 22:18:29 Waiting for src bucket item count to get to: 200000 curr count: 74039
2021/12/24 22:18:34 Waiting for src bucket item count to get to: 200000 curr count: 74039
2021/12/24 22:18:39 Waiting for src bucket item count to get to: 200000 curr count: 89587
2021/12/24 22:18:44 Waiting for src bucket item count to get to: 200000 curr count: 89587
2021/12/24 22:18:49 Waiting for src bucket item count to get to: 200000 curr count: 105855
2021/12/24 22:18:54 Waiting for src bucket item count to get to: 200000 curr count: 105855
2021/12/24 22:18:59 Waiting for src bucket item count to get to: 200000 curr count: 122493
2021/12/24 22:19:04 Waiting for src bucket item count to get to: 200000 curr count: 122493
2021/12/24 22:19:09 Waiting for src bucket item count to get to: 200000 curr count: 139289
2021/12/24 22:19:14 Waiting for src bucket item count to get to: 200000 curr count: 139289
2021/12/24 22:19:19 Waiting for src bucket item count to get to: 200000 curr count: 156015
2021/12/24 22:19:24 Waiting for src bucket item count to get to: 200000 curr count: 156015
2021/12/24 22:19:29 Waiting for src bucket item count to get to: 200000 curr count: 172551
2021/12/24 22:19:34 Waiting for src bucket item count to get to: 200000 curr count: 188268
2021/12/24 22:19:39 Waiting for src bucket item count to get to: 200000 curr count: 188268
2021/12/24 22:19:44 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 22:19:44 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 22:19:49 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/24 22:19:54 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/24 22:19:59 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/24 22:20:04 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/24 22:20:04 App: TestDuplicateWithKVRebOut got un-deployed
2021/12/24 22:20:04 No eventing-con process running
2021/12/24 22:20:04 Function: TestDuplicateWithKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebOut deleting in background"
}
2021/12/24 22:20:06 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:20:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:20:16 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/24 22:20:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:20:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:20:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:20:27 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/24 22:20:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVRebOut (229.19s)
=== RUN   TestDuplicateWithKVSwapReb
2021/12/24 22:20:37 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/24 22:20:37 App: TestDuplicateWithKVSwapReb got un-deployed
2021/12/24 22:20:37 No eventing-con process running
2021/12/24 22:20:37 Function: TestDuplicateWithKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVSwapReb not found"
}
2021/12/24 22:20:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:20:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:20:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:20:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:20:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:20:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:20:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:20:56 Deploying app: TestDuplicateWithKVSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:20:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVSwapReb stored in temp store"
}
2021/12/24 22:21:02 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/24 22:21:07 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/24 22:21:12 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/24 22:21:17 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/24 22:21:17 App: TestDuplicateWithKVSwapReb got deployed
2021/12/24 22:21:17 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 22:21:17 Starting bucket ops to source bucket
2021/12/24 22:21:17 Removing node(s): [] from the cluster
2021/12/24 22:21:22 Rebalance progress: 16.66666666666667
2021/12/24 22:21:27 Rebalance progress: 16.66666666666667
2021/12/24 22:21:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:21:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:21:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:21:32 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 22:21:32 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 22:21:33 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 22:21:38 Rebalance progress: 16.66666666666667
2021/12/24 22:21:43 Rebalance progress: 16.66666666666667
2021/12/24 22:21:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:21:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:21:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:21:48 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 22:21:48 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 22:21:53 Rebalance progress: 16.66666666666667
2021/12/24 22:21:58 Rebalance progress: 16.66666666666667
2021/12/24 22:22:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:22:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:22:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:22:03 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 22:22:03 Waiting for src bucket item count to get to: 200000 curr count: 66704
2021/12/24 22:22:08 Waiting for src bucket item count to get to: 200000 curr count: 66704
2021/12/24 22:22:13 Waiting for src bucket item count to get to: 200000 curr count: 82162
2021/12/24 22:22:18 Waiting for src bucket item count to get to: 200000 curr count: 82162
2021/12/24 22:22:23 Waiting for src bucket item count to get to: 200000 curr count: 98365
2021/12/24 22:22:28 Waiting for src bucket item count to get to: 200000 curr count: 98365
2021/12/24 22:22:33 Waiting for src bucket item count to get to: 200000 curr count: 114681
2021/12/24 22:22:38 Waiting for src bucket item count to get to: 200000 curr count: 114681
2021/12/24 22:22:43 Waiting for src bucket item count to get to: 200000 curr count: 131267
2021/12/24 22:22:48 Waiting for src bucket item count to get to: 200000 curr count: 131267
2021/12/24 22:22:53 Waiting for src bucket item count to get to: 200000 curr count: 147877
2021/12/24 22:22:58 Waiting for src bucket item count to get to: 200000 curr count: 147877
2021/12/24 22:23:03 Waiting for src bucket item count to get to: 200000 curr count: 147877
2021/12/24 22:23:08 Waiting for src bucket item count to get to: 200000 curr count: 164693
2021/12/24 22:23:13 Waiting for src bucket item count to get to: 200000 curr count: 164693
2021/12/24 22:23:18 Waiting for src bucket item count to get to: 200000 curr count: 180438
2021/12/24 22:23:23 Waiting for src bucket item count to get to: 200000 curr count: 180438
2021/12/24 22:23:28 Waiting for src bucket item count to get to: 200000 curr count: 196761
2021/12/24 22:23:33 Waiting for src bucket item count to get to: 200000 curr count: 196761
2021/12/24 22:23:38 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 22:23:38 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 22:23:43 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/24 22:23:48 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/24 22:23:53 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/24 22:23:58 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/24 22:23:58 App: TestDuplicateWithKVSwapReb got un-deployed
2021/12/24 22:23:58 No eventing-con process running
2021/12/24 22:23:58 Function: TestDuplicateWithKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVSwapReb deleting in background"
}
2021/12/24 22:24:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:24:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:24:10 Waiting for dst bucket item count to get to: 0 curr count: 56392
2021/12/24 22:24:15 Waiting for dst bucket item count to get to: 0 curr count: 56392
2021/12/24 22:24:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:24:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:24:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:24:27 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/24 22:24:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVSwapReb (239.53s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpOneByOne
2021/12/24 22:24:37 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 22:24:37 App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/24 22:24:37 No eventing-con process running
2021/12/24 22:24:37 Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne not found"
}
2021/12/24 22:24:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:24:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:24:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:24:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:24:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:24:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:24:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:24:55 Deploying app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:24:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2021/12/24 22:25:02 Starting bucket ops to source bucket
2021/12/24 22:25:07 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/24 22:25:12 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/24 22:25:17 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/24 22:25:17 App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:25:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:25:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:25:17 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 22:25:17 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 22:25:17 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:25:22 Rebalance progress: 16.66666666666667
2021/12/24 22:25:27 Rebalance progress: 16.66666666666667
2021/12/24 22:25:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:25:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:25:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:25:32 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 22:25:32 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 22:25:33 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:25:38 Rebalance progress: 16.66666666666667
2021/12/24 22:25:43 Rebalance progress: 16.66666666666667
2021/12/24 22:25:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:25:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:25:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:25:48 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/24 22:25:48 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 22:25:53 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:25:58 Rebalance progress: 12.5
2021/12/24 22:26:03 Rebalance progress: 12.5
2021/12/24 22:26:08 Rebalance progress: 12.5
2021/12/24 22:26:13 Rebalance progress: 64.43089430894308
2021/12/24 22:26:18 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:26:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:26:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:26:18 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 22:26:23 Rebalance progress: 12.5
2021/12/24 22:26:28 Rebalance progress: 12.5
2021/12/24 22:26:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:26:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:26:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:26:33 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 22:26:38 Rebalance progress: 12.5
2021/12/24 22:26:43 Rebalance progress: 12.5
2021/12/24 22:26:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:26:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:26:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:26:48 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/24 22:26:53 Rebalance progress: 12.5
2021/12/24 22:26:58 Rebalance progress: 12.5
2021/12/24 22:27:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:27:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:27:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:27:09 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 22:27:14 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 22:27:19 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 22:27:24 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 22:27:24 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/24 22:27:24 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:27:24 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2021/12/24 22:27:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:27:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:27:36 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12184
2021/12/24 22:27:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:27:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:27:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:27:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12184
2021/12/24 22:27:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpOneByOne (200.29s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce
2021/12/24 22:27:57 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/24 22:27:57 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got un-deployed
2021/12/24 22:27:57 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:27:57 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce not found"
}
2021/12/24 22:27:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:28:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:28:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:28:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:28:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:28:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:28:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:28:16 eventingSetup.go:125: Deploying app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:28:17 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce stored in temp store"
}
2021/12/24 22:28:22 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 22:28:27 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2021/12/24 22:28:32 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2021/12/24 22:28:37 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2021/12/24 22:28:37 clusterSetup.go:354: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:28:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:28:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:28:37 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 22:28:38 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 22:28:38 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 22:28:38 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:28:43 Rebalance progress: 12.5
2021/12/24 22:28:48 Rebalance progress: 12.5
2021/12/24 22:28:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:28:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:28:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:28:53 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/24 22:28:58 Rebalance progress: 12.5
2021/12/24 22:29:03 Rebalance progress: 12.5
2021/12/24 22:29:08 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:29:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:29:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:29:14 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/24 22:29:19 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/24 22:29:24 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/24 22:29:29 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/24 22:29:29 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got un-deployed
2021/12/24 22:29:29 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:29:29 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce deleting in background"
}
2021/12/24 22:29:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:29:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:29:40 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2679
2021/12/24 22:29:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2679
2021/12/24 22:29:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:29:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:29:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:29:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4642
2021/12/24 22:29:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce (130.03s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings
2021/12/24 22:30:07 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 22:30:07 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/24 22:30:07 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:30:07 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings not found"
}
2021/12/24 22:30:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:30:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:30:14 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:30:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:30:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:30:21 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:30:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:30:26 eventingSetup.go:125: Deploying app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:30:27 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings stored in temp store"
}
2021/12/24 22:30:32 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 22:30:37 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2021/12/24 22:30:42 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2021/12/24 22:30:47 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2021/12/24 22:30:47 clusterSetup.go:354: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:30:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:30:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:30:47 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 22:30:47 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:30:52 Rebalance progress: 12.5
2021/12/24 22:30:57 Rebalance progress: 12.5
2021/12/24 22:31:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:31:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:31:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:31:02 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 22:31:03 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:31:08 Rebalance progress: 12.5
2021/12/24 22:31:13 Rebalance progress: 12.5
2021/12/24 22:31:18 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:31:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:31:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:31:18 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 22:31:18 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:31:23 Rebalance progress: 12.5
2021/12/24 22:31:28 Rebalance progress: 12.5
2021/12/24 22:31:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:31:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:31:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:31:34 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 22:31:39 Rebalance progress: 12.5
2021/12/24 22:31:44 Rebalance progress: 12.5
2021/12/24 22:31:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:31:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:31:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:31:49 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 22:31:54 Rebalance progress: 12.5
2021/12/24 22:31:59 Rebalance progress: 12.5
2021/12/24 22:32:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:32:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:32:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:32:04 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/24 22:32:09 Rebalance progress: 12.5
2021/12/24 22:32:14 Rebalance progress: 12.5
2021/12/24 22:32:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:32:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:32:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:32:24 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 22:32:29 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 22:32:34 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 22:32:39 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/24 22:32:39 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/24 22:32:39 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:32:39 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings deleting in background"
}
2021/12/24 22:32:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:32:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:32:51 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10049
2021/12/24 22:32:56 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10049
2021/12/24 22:32:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:32:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:33:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:33:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10672
2021/12/24 22:33:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings (190.39s)
=== RUN   TestEventingSwapRebOnUpdateBucketOp
2021/12/24 22:33:18 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/24 22:33:18 clusterSetup.go:405: App: TestEventingSwapRebOnUpdateBucketOp got un-deployed
2021/12/24 22:33:18 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:33:18 eventingSetup.go:418: Function: TestEventingSwapRebOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebOnUpdateBucketOp not found"
}
2021/12/24 22:33:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:33:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:33:24 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:33:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:33:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:33:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:33:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:33:31 eventingSetup.go:125: Deploying app: TestEventingSwapRebOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:33:32 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebOnUpdateBucketOp stored in temp store"
}
2021/12/24 22:33:37 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 22:33:42 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2021/12/24 22:33:47 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2021/12/24 22:33:52 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2021/12/24 22:33:52 clusterSetup.go:354: App: TestEventingSwapRebOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:33:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:33:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:33:52 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 22:33:53 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:33:58 Rebalance progress: 12.5
2021/12/24 22:34:03 Rebalance progress: 12.5
2021/12/24 22:34:08 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:34:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:34:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:34:08 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 22:34:09 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 22:34:14 Rebalance progress: 12.5
2021/12/24 22:34:19 Rebalance progress: 12.5
2021/12/24 22:34:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:34:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:34:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:34:24 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 22:34:29 Rebalance progress: 12.5
2021/12/24 22:34:34 Rebalance progress: 12.5
2021/12/24 22:34:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:34:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:34:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:34:44 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/24 22:34:49 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/24 22:34:54 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/24 22:34:59 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/24 22:34:59 clusterSetup.go:405: App: TestEventingSwapRebOnUpdateBucketOp got un-deployed
2021/12/24 22:34:59 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:34:59 eventingSetup.go:418: Function: TestEventingSwapRebOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebOnUpdateBucketOp deleting in background"
}
2021/12/24 22:35:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:35:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:35:11 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5392
2021/12/24 22:35:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5392
2021/12/24 22:35:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:35:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:35:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:35:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6137
2021/12/24 22:35:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebOnUpdateBucketOp (139.87s)
=== RUN   TestMetaRollbackWithEventingReb
2021/12/24 22:35:33 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 22:35:33 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:35:38 Rebalance progress: 100
2021/12/24 22:35:43 Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/24 22:35:43 App: TestMetaRollbackWithEventingReb got un-deployed
2021/12/24 22:35:43 No eventing-con process running
2021/12/24 22:35:43 Function: TestMetaRollbackWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaRollbackWithEventingReb not found"
}
2021/12/24 22:35:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:35:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:35:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:35:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:35:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:35:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:35:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:35:56 Deploying app: TestMetaRollbackWithEventingReb. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:35:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaRollbackWithEventingReb stored in temp store"
}
2021/12/24 22:36:02 Starting bucket ops to source bucket
2021/12/24 22:36:07 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2021/12/24 22:36:13 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2021/12/24 22:36:18 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2021/12/24 22:36:18 App: TestMetaRollbackWithEventingReb got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:36:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:36:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:36:18 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 22:36:18 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:36:23 Rebalance progress: 12.5
2021/12/24 22:36:28 Rebalance progress: 12.5
2021/12/24 22:36:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:36:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:36:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:36:33 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2021/12/24 22:36:33 bucketOps.go:134: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2021/12/24 22:36:38 Rebalance progress: 12.5
2021/12/24 22:36:43 Rebalance progress: 12.5
2021/12/24 22:36:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:36:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:36:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:36:53 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/24 22:36:58 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/24 22:37:03 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/24 22:37:08 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/24 22:37:08 clusterSetup.go:405: App: TestMetaRollbackWithEventingReb got un-deployed
2021/12/24 22:37:08 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:37:08 eventingSetup.go:418: Function: TestMetaRollbackWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaRollbackWithEventingReb deleting in background"
}
2021/12/24 22:37:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:37:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:37:20 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1025
2021/12/24 22:37:25 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1025
2021/12/24 22:37:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:37:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:37:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:37:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4557
2021/12/24 22:37:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaRollbackWithEventingReb (129.35s)
=== RUN   TestMetaPartialRollbackWithEventingReb
2021/12/24 22:37:42 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 22:37:42 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:37:47 Rebalance progress: 100
2021/12/24 22:37:52 Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/24 22:37:52 App: TestMetaPartialRollbackWithEventingReb got un-deployed
2021/12/24 22:37:52 No eventing-con process running
2021/12/24 22:37:52 Function: TestMetaPartialRollbackWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaPartialRollbackWithEventingReb not found"
}
2021/12/24 22:37:54 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:37:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:37:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:38:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:38:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:38:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:38:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:38:06 Deploying app: TestMetaPartialRollbackWithEventingReb. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:38:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaPartialRollbackWithEventingReb stored in temp store"
}
2021/12/24 22:38:12 Starting bucket ops to source bucket
2021/12/24 22:38:17 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2021/12/24 22:38:22 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2021/12/24 22:38:27 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2021/12/24 22:38:27 App: TestMetaPartialRollbackWithEventingReb got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:38:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:38:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:38:27 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 22:38:27 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:38:33 Rebalance progress: 12.5
2021/12/24 22:38:38 Rebalance progress: 12.5
2021/12/24 22:38:43 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:38:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:38:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:38:43 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2021/12/24 22:38:43 bucketOps.go:65: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaPartialRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2021/12/24 22:38:48 Rebalance progress: 12.5
2021/12/24 22:38:53 Rebalance progress: 12.5
2021/12/24 22:38:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:38:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:38:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:38:58 bucketOps.go:65: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaPartialRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2021/12/24 22:39:03 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/24 22:39:08 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/24 22:39:13 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/24 22:39:18 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/24 22:39:18 clusterSetup.go:405: App: TestMetaPartialRollbackWithEventingReb got un-deployed
2021/12/24 22:39:18 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:39:18 eventingSetup.go:418: Function: TestMetaPartialRollbackWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaPartialRollbackWithEventingReb deleting in background"
}
2021/12/24 22:39:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:39:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:39:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:39:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:39:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:39:36 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 38345
2021/12/24 22:39:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaPartialRollbackWithEventingReb (119.48s)
=== RUN   TestEventingRebMultipleHandlersOneByOne
2021/12/24 22:39:46 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/24 22:39:46 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got un-deployed
2021/12/24 22:39:46 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:39:46 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op not found"
}
2021/12/24 22:39:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:39:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:39:53 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:39:55 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:40:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:40:00 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:40:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:40:05 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:40:06 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:40:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:40:06 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:40:07 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update stored in temp store"
}
2021/12/24 22:40:12 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 22:40:17 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2021/12/24 22:40:22 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2021/12/24 22:40:27 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2021/12/24 22:40:27 clusterSetup.go:354: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got deployed
2021/12/24 22:40:32 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2021/12/24 22:40:37 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2021/12/24 22:40:42 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2021/12/24 22:40:42 clusterSetup.go:354: App: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:40:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:40:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:40:42 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 22:40:43 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:40:48 Rebalance progress: 12.5
2021/12/24 22:40:53 Rebalance progress: 12.5
2021/12/24 22:40:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:40:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:40:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:40:58 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 22:40:58 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:41:03 Rebalance progress: 12.5
2021/12/24 22:41:08 Rebalance progress: 12.5
2021/12/24 22:41:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:41:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:41:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:41:13 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 22:41:14 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:41:19 Rebalance progress: 12.5
2021/12/24 22:41:24 Rebalance progress: 12.5
2021/12/24 22:41:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:41:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:41:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:41:29 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 22:41:34 Rebalance progress: 12.5
2021/12/24 22:41:39 Rebalance progress: 12.5
2021/12/24 22:41:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:41:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:41:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:41:44 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 22:41:49 Rebalance progress: 12.5
2021/12/24 22:41:54 Rebalance progress: 12.5
2021/12/24 22:41:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:41:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:41:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:41:59 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/24 22:42:04 Rebalance progress: 12.5
2021/12/24 22:42:09 Rebalance progress: 12.5
2021/12/24 22:42:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:42:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:42:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:42:20 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/24 22:42:25 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/24 22:42:30 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/24 22:42:35 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/24 22:42:35 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got un-deployed
2021/12/24 22:42:35 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:42:35 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op deleting in background"
}
2021/12/24 22:42:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:42:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:42:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12222
2021/12/24 22:42:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:42:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:42:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:43:00 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5359
2021/12/24 22:43:05 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5359
2021/12/24 22:43:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:43:10 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/24 22:43:16 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/24 22:43:21 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/24 22:43:26 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/24 22:43:26 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update got un-deployed
2021/12/24 22:43:26 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:43:26 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update deleting in background"
}
2021/12/24 22:43:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:43:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:43:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:43:34 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:43:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:43:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultipleHandlersOneByOne (242.84s)
=== RUN   TestEventingRebMultipleHandlersAllAtOnce
2021/12/24 22:43:49 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/24 22:43:49 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got un-deployed
2021/12/24 22:43:49 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:43:49 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op not found"
}
2021/12/24 22:43:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:43:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:43:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:43:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:44:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:44:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:44:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:44:08 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:44:09 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:44:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:44:09 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:44:10 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update stored in temp store"
}
2021/12/24 22:44:15 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 22:44:20 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2021/12/24 22:44:25 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2021/12/24 22:44:30 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2021/12/24 22:44:30 clusterSetup.go:354: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got deployed
2021/12/24 22:44:35 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2021/12/24 22:44:40 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2021/12/24 22:44:45 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2021/12/24 22:44:45 clusterSetup.go:354: App: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:44:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:44:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:44:45 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 22:44:46 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 22:44:46 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/24 22:44:46 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:44:52 Rebalance progress: 12.5
2021/12/24 22:44:57 Rebalance progress: 12.5
2021/12/24 22:45:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:45:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:45:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:45:02 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/24 22:45:07 Rebalance progress: 12.5
2021/12/24 22:45:12 Rebalance progress: 12.5
2021/12/24 22:45:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:45:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:45:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:45:22 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/24 22:45:27 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/24 22:45:32 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/24 22:45:37 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/24 22:45:37 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got un-deployed
2021/12/24 22:45:37 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:45:37 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op deleting in background"
}
2021/12/24 22:45:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:45:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:45:50 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 43
2021/12/24 22:45:55 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 43
2021/12/24 22:45:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:45:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:46:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:46:07 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6157
2021/12/24 22:46:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:46:12 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2021/12/24 22:46:17 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2021/12/24 22:46:22 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2021/12/24 22:46:27 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2021/12/24 22:46:27 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update got un-deployed
2021/12/24 22:46:27 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:46:27 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update deleting in background"
}
2021/12/24 22:46:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:46:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:46:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:46:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:46:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:46:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultipleHandlersAllAtOnce (181.27s)
=== RUN   TestEventingSwapRebMultipleHandlers
2021/12/24 22:46:50 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/24 22:46:50 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got un-deployed
2021/12/24 22:46:50 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:46:51 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update not found"
}
2021/12/24 22:46:52 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:46:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:46:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:46:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:47:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:47:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:47:09 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/24 22:47:09 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got un-deployed
2021/12/24 22:47:09 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:47:09 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op not found"
}
2021/12/24 22:47:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:47:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:47:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:47:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:47:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:47:23 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:47:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:47:23 eventingSetup.go:125: Deploying app: TestEventingSwapRebMultipleHandlersbucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:47:24 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:47:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:47:24 eventingSetup.go:125: Deploying app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:47:25 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op stored in temp store"
}
2021/12/24 22:47:30 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 22:47:35 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2021/12/24 22:47:40 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2021/12/24 22:47:45 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2021/12/24 22:47:45 clusterSetup.go:354: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got deployed
2021/12/24 22:47:50 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2021/12/24 22:47:55 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2021/12/24 22:48:00 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2021/12/24 22:48:00 clusterSetup.go:354: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:48:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:48:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:48:00 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 22:48:00 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:48:05 Rebalance progress: 12.5
2021/12/24 22:48:10 Rebalance progress: 12.5
2021/12/24 22:48:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:48:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:48:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:48:15 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 22:48:16 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 22:48:21 Rebalance progress: 12.5
2021/12/24 22:48:26 Rebalance progress: 12.5
2021/12/24 22:48:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:48:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:48:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:48:31 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 22:48:36 Rebalance progress: 12.5
2021/12/24 22:48:41 Rebalance progress: 12.5
2021/12/24 22:48:46 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:48:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:48:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:48:51 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/24 22:48:56 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/24 22:49:01 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/24 22:49:06 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/24 22:49:06 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got un-deployed
2021/12/24 22:49:06 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:49:06 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update deleting in background"
}
2021/12/24 22:49:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:49:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:49:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:49:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:49:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:49:26 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7610
2021/12/24 22:49:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:49:32 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/24 22:49:37 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/24 22:49:42 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/24 22:49:47 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/24 22:49:47 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got un-deployed
2021/12/24 22:49:47 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:49:47 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op deleting in background"
}
2021/12/24 22:49:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:49:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:49:53 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:49:55 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:50:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:50:00 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebMultipleHandlers (199.76s)
=== RUN   TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne
2021/12/24 22:50:10 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 22:50:10 clusterSetup.go:405: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/24 22:50:10 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:50:10 eventingSetup.go:418: Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne not found"
}
2021/12/24 22:50:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:50:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:50:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:50:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:50:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:50:24 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:50:29 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:50:29 eventingSetup.go:125: Deploying app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:50:30 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2021/12/24 22:50:35 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 22:50:40 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/24 22:50:45 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/24 22:50:50 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/24 22:50:50 clusterSetup.go:354: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:50:50 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:50:50 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:50:50 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 22:50:51 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:51:11 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:51:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:51:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:51:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:51:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:51:41 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:51:46 Rebalance progress: 12.5
2021/12/24 22:51:51 Rebalance progress: 12.5
2021/12/24 22:51:56 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:51:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:51:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:51:56 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 22:51:57 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 22:52:02 Rebalance progress: 12.5
2021/12/24 22:52:07 Rebalance progress: 12.5
2021/12/24 22:52:12 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:52:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:52:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:52:12 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 22:52:17 Rebalance progress: 12.5
2021/12/24 22:52:22 Rebalance progress: 12.5
2021/12/24 22:52:27 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:52:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:52:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:52:32 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 22:52:37 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 22:52:42 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 22:52:47 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 22:52:47 clusterSetup.go:405: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/24 22:52:47 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:52:47 eventingSetup.go:418: Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2021/12/24 22:52:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:52:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:52:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11191
2021/12/24 22:52:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:53:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:53:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:53:11 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8872
2021/12/24 22:53:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8872
2021/12/24 22:53:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne (195.52s)
=== RUN   TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne
2021/12/24 22:53:26 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 22:53:26 clusterSetup.go:405: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/24 22:53:26 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:53:26 eventingSetup.go:418: Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne not found"
}
2021/12/24 22:53:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:53:33 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:53:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:53:34 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:53:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:53:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:53:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:53:44 eventingSetup.go:125: Deploying app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:53:45 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2021/12/24 22:53:50 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 22:53:55 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/24 22:54:00 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/24 22:54:05 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/24 22:54:05 clusterSetup.go:354: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:54:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:54:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:54:05 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 22:54:06 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:54:26 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:54:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:54:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:54:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:54:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:54:36 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 22:54:37 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:54:57 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:54:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:54:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:55:07 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:55:07 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:55:07 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 22:55:07 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:55:28 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:55:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:55:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:55:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:55:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:55:38 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 22:55:38 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:55:58 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:55:59 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:55:59 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:56:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:56:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:56:09 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 22:56:09 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:56:29 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:56:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:56:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:56:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:56:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:56:40 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:56:45 Rebalance progress: 12.5
2021/12/24 22:56:50 Rebalance progress: 12.5
2021/12/24 22:56:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:56:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:56:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:56:55 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 22:56:55 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 22:57:00 Rebalance progress: 12.5
2021/12/24 22:57:05 Rebalance progress: 12.5
2021/12/24 22:57:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:57:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:57:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:57:11 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 22:57:16 Rebalance progress: 12.5
2021/12/24 22:57:21 Rebalance progress: 12.5
2021/12/24 22:57:26 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:57:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:57:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:57:31 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 22:57:36 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 22:57:41 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 22:57:46 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/24 22:57:46 clusterSetup.go:405: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/24 22:57:46 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:57:46 eventingSetup.go:418: Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2021/12/24 22:57:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:57:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:57:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 21518
2021/12/24 22:57:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:57:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:58:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:58:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne (288.67s)
=== RUN   TestEventingFailoverOnUpdateBucketOp
2021/12/24 22:58:14 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/24 22:58:14 clusterSetup.go:405: App: TestEventingFailoverOnUpdateBucketOp got un-deployed
2021/12/24 22:58:14 eventingSetup.go:46: No eventing-con process running
2021/12/24 22:58:14 eventingSetup.go:418: Function: TestEventingFailoverOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingFailoverOnUpdateBucketOp not found"
}
2021/12/24 22:58:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:58:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:58:21 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 22:58:23 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:58:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:58:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:58:33 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 22:58:33 eventingSetup.go:125: Deploying app: TestEventingFailoverOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/24 22:58:34 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingFailoverOnUpdateBucketOp stored in temp store"
}
2021/12/24 22:58:39 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 22:58:44 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2021/12/24 22:58:49 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2021/12/24 22:58:54 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2021/12/24 22:58:54 clusterSetup.go:354: App: TestEventingFailoverOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:58:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:58:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:58:54 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 22:58:54 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:58:59 Rebalance progress: 12.5
2021/12/24 22:59:04 Rebalance progress: 12.5
2021/12/24 22:59:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:59:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:59:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:59:09 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:59:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:59:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:59:20 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 22:59:25 Rebalance progress: 12.5
2021/12/24 22:59:30 Rebalance progress: 12.5
2021/12/24 22:59:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:59:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:59:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:59:35 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 22:59:35 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 22:59:40 Rebalance progress: 12.5
2021/12/24 22:59:45 Rebalance progress: 12.5
2021/12/24 22:59:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:59:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 22:59:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 22:59:50 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 22:59:55 Rebalance progress: 12.5
2021/12/24 23:00:00 Rebalance progress: 12.5
2021/12/24 23:00:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:00:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:00:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:00:10 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/24 23:00:16 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/24 23:00:21 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/24 23:00:26 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/24 23:00:26 clusterSetup.go:405: App: TestEventingFailoverOnUpdateBucketOp got un-deployed
2021/12/24 23:00:26 eventingSetup.go:46: No eventing-con process running
2021/12/24 23:00:26 eventingSetup.go:418: Function: TestEventingFailoverOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingFailoverOnUpdateBucketOp deleting in background"
}
2021/12/24 23:00:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:00:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:00:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8617
2021/12/24 23:00:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:00:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:00:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:00:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8617
2021/12/24 23:00:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingFailoverOnUpdateBucketOp (164.67s)
=== RUN   TestEventingKVRebalanceOnUpdateBucketOp
2021/12/24 23:00:59 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/24 23:00:59 clusterSetup.go:405: App: TestEventingKVRebalanceOnUpdateBucketOp got un-deployed
2021/12/24 23:00:59 eventingSetup.go:46: No eventing-con process running
2021/12/24 23:00:59 eventingSetup.go:418: Function: TestEventingKVRebalanceOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingKVRebalanceOnUpdateBucketOp not found"
}
2021/12/24 23:01:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:01:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:01:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:01:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:01:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:01:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:01:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:01:18 eventingSetup.go:125: Deploying app: TestEventingKVRebalanceOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/24 23:01:19 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingKVRebalanceOnUpdateBucketOp stored in temp store"
}
2021/12/24 23:01:24 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 23:01:29 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2021/12/24 23:01:34 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2021/12/24 23:01:39 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2021/12/24 23:01:39 clusterSetup.go:354: App: TestEventingKVRebalanceOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:01:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:01:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:01:39 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing,kv to the cluster
2021/12/24 23:01:39 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 23:01:45 Rebalance progress: 12.5
2021/12/24 23:01:50 Rebalance progress: 12.5
2021/12/24 23:01:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:01:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:01:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:01:55 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing,kv to the cluster
2021/12/24 23:01:55 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 23:02:00 Rebalance progress: 12.5
2021/12/24 23:02:05 Rebalance progress: 12.5
2021/12/24 23:02:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:02:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:02:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:02:10 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 23:02:15 Rebalance progress: 12.5
2021/12/24 23:02:20 Rebalance progress: 12.5
2021/12/24 23:02:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:02:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:02:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:02:30 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/24 23:02:35 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/24 23:02:40 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/24 23:02:45 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/24 23:02:45 clusterSetup.go:405: App: TestEventingKVRebalanceOnUpdateBucketOp got un-deployed
2021/12/24 23:02:45 eventingSetup.go:46: No eventing-con process running
2021/12/24 23:02:45 eventingSetup.go:418: Function: TestEventingKVRebalanceOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingKVRebalanceOnUpdateBucketOp deleting in background"
}
2021/12/24 23:02:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:02:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:02:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6113
2021/12/24 23:02:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:02:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:03:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:03:09 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6113
2021/12/24 23:03:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingKVRebalanceOnUpdateBucketOp (139.73s)
=== RUN   TestEventingRebInWithOps
2021/12/24 23:03:19 clusterSetup.go:397: Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/24 23:03:19 clusterSetup.go:405: App: TestEventingRebInWithOps got un-deployed
2021/12/24 23:03:19 eventingSetup.go:46: No eventing-con process running
2021/12/24 23:03:19 eventingSetup.go:418: Function: TestEventingRebInWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebInWithOps not found"
}
2021/12/24 23:03:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:03:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:03:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:03:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:03:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:03:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:03:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:03:37 eventingSetup.go:125: Deploying app: TestEventingRebInWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 23:03:38 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithOps stored in temp store"
}
2021/12/24 23:03:43 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/24 23:03:48 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/24 23:03:54 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/24 23:03:59 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/24 23:03:59 clusterSetup.go:354: App: TestEventingRebInWithOps got deployed
2021/12/24 23:03:59 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 23:03:59 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 23:03:59 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 23:04:04 Rebalance progress: 12.5
2021/12/24 23:04:09 Rebalance progress: 12.5
2021/12/24 23:04:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:04:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:04:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:04:14 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 23:04:19 Rebalance progress: 12.5
2021/12/24 23:04:24 Rebalance progress: 12.5
2021/12/24 23:04:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:04:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:04:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:04:29 Waiting for src bucket item count to get to: 200000 curr count: 31654
2021/12/24 23:04:34 Waiting for src bucket item count to get to: 200000 curr count: 47611
2021/12/24 23:04:39 Waiting for src bucket item count to get to: 200000 curr count: 47611
2021/12/24 23:04:44 Waiting for src bucket item count to get to: 200000 curr count: 63917
2021/12/24 23:04:49 Waiting for src bucket item count to get to: 200000 curr count: 63917
2021/12/24 23:04:54 Waiting for src bucket item count to get to: 200000 curr count: 79426
2021/12/24 23:04:59 Waiting for src bucket item count to get to: 200000 curr count: 79426
2021/12/24 23:05:04 Waiting for src bucket item count to get to: 200000 curr count: 95542
2021/12/24 23:05:09 Waiting for src bucket item count to get to: 200000 curr count: 95542
2021/12/24 23:05:14 Waiting for src bucket item count to get to: 200000 curr count: 112222
2021/12/24 23:05:19 Waiting for src bucket item count to get to: 200000 curr count: 112222
2021/12/24 23:05:24 Waiting for src bucket item count to get to: 200000 curr count: 112222
2021/12/24 23:05:29 Waiting for src bucket item count to get to: 200000 curr count: 128901
2021/12/24 23:05:34 Waiting for src bucket item count to get to: 200000 curr count: 128901
2021/12/24 23:05:39 Waiting for src bucket item count to get to: 200000 curr count: 145268
2021/12/24 23:05:44 Waiting for src bucket item count to get to: 200000 curr count: 145268
2021/12/24 23:05:49 Waiting for src bucket item count to get to: 200000 curr count: 161825
2021/12/24 23:05:54 Waiting for src bucket item count to get to: 200000 curr count: 177367
2021/12/24 23:05:59 Waiting for src bucket item count to get to: 200000 curr count: 177367
2021/12/24 23:06:04 Waiting for src bucket item count to get to: 200000 curr count: 193431
2021/12/24 23:06:09 Waiting for src bucket item count to get to: 200000 curr count: 193431
2021/12/24 23:06:14 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 23:06:14 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 23:06:14 Starting bucket ops to source bucket
2021/12/24 23:09:59 Waiting for dst bucket item count to get to: 0 curr count: 9319
2021/12/24 23:10:04 Waiting for dst bucket item count to get to: 0 curr count: 9319
2021/12/24 23:10:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:10:04 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 23:10:10 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/24 23:10:15 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/24 23:10:20 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/24 23:10:25 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/24 23:10:25 App: TestEventingRebInWithOps got un-deployed
2021/12/24 23:10:25 No eventing-con process running
2021/12/24 23:10:25 Function: TestEventingRebInWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithOps deleting in background"
}
2021/12/24 23:10:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:10:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:10:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:10:33 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:10:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:10:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebInWithOps (449.39s)
=== RUN   TestEventingRebOutWithOps
2021/12/24 23:10:43 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 23:10:44 Removing node(s): [] from the cluster
2021/12/24 23:10:49 Rebalance progress: 100
2021/12/24 23:10:54 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/24 23:10:54 App: TestEventingRebOutWithOps got un-deployed
2021/12/24 23:10:54 No eventing-con process running
2021/12/24 23:10:54 Function: TestEventingRebOutWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebOutWithOps not found"
}
2021/12/24 23:10:55 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:11:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:11:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:11:02 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:11:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:11:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:11:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:11:12 Deploying app: TestEventingRebOutWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 23:11:13 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithOps stored in temp store"
}
2021/12/24 23:11:18 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/24 23:11:23 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/24 23:11:28 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/24 23:11:33 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/24 23:11:33 App: TestEventingRebOutWithOps got deployed
2021/12/24 23:11:33 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 23:11:33 Starting bucket ops to source bucket
2021/12/24 23:11:38 Rebalance progress: 12.5
2021/12/24 23:11:43 Rebalance progress: 12.5
2021/12/24 23:11:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:11:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:11:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:11:48 Waiting for src bucket item count to get to: 200000 curr count: 8979
2021/12/24 23:11:53 Waiting for src bucket item count to get to: 200000 curr count: 25005
2021/12/24 23:11:58 Waiting for src bucket item count to get to: 200000 curr count: 25005
2021/12/24 23:12:03 Waiting for src bucket item count to get to: 200000 curr count: 41326
2021/12/24 23:12:08 Waiting for src bucket item count to get to: 200000 curr count: 41326
2021/12/24 23:12:13 Waiting for src bucket item count to get to: 200000 curr count: 57525
2021/12/24 23:12:18 Waiting for src bucket item count to get to: 200000 curr count: 57525
2021/12/24 23:12:23 Waiting for src bucket item count to get to: 200000 curr count: 57525
2021/12/24 23:12:28 Waiting for src bucket item count to get to: 200000 curr count: 73202
2021/12/24 23:12:33 Waiting for src bucket item count to get to: 200000 curr count: 73202
2021/12/24 23:12:38 Waiting for src bucket item count to get to: 200000 curr count: 88959
2021/12/24 23:12:43 Waiting for src bucket item count to get to: 200000 curr count: 88959
2021/12/24 23:12:48 Waiting for src bucket item count to get to: 200000 curr count: 105365
2021/12/24 23:12:53 Waiting for src bucket item count to get to: 200000 curr count: 105365
2021/12/24 23:12:58 Waiting for src bucket item count to get to: 200000 curr count: 121584
2021/12/24 23:13:03 Waiting for src bucket item count to get to: 200000 curr count: 121584
2021/12/24 23:13:08 Waiting for src bucket item count to get to: 200000 curr count: 137977
2021/12/24 23:13:13 Waiting for src bucket item count to get to: 200000 curr count: 137977
2021/12/24 23:13:18 Waiting for src bucket item count to get to: 200000 curr count: 154389
2021/12/24 23:13:23 Waiting for src bucket item count to get to: 200000 curr count: 154389
2021/12/24 23:13:28 Waiting for src bucket item count to get to: 200000 curr count: 170293
2021/12/24 23:13:33 Waiting for src bucket item count to get to: 200000 curr count: 170293
2021/12/24 23:13:38 Waiting for src bucket item count to get to: 200000 curr count: 185685
2021/12/24 23:13:44 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 23:13:44 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 23:13:44 Starting bucket ops to source bucket
2021/12/24 23:17:29 Waiting for dst bucket item count to get to: 0 curr count: 8725
2021/12/24 23:17:34 Waiting for dst bucket item count to get to: 0 curr count: 8725
2021/12/24 23:17:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:17:34 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 23:17:39 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/24 23:17:44 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/24 23:17:49 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/24 23:17:54 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/24 23:17:54 App: TestEventingRebOutWithOps got un-deployed
2021/12/24 23:17:55 No eventing-con process running
2021/12/24 23:17:55 Function: TestEventingRebOutWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithOps deleting in background"
}
2021/12/24 23:17:56 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:18:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:18:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:18:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:18:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:18:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebOutWithOps (449.84s)
=== RUN   TestEventingSwapRebWithOps
2021/12/24 23:18:18 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/24 23:18:18 App: TestEventingSwapRebWithOps got un-deployed
2021/12/24 23:18:18 No eventing-con process running
2021/12/24 23:18:18 Function: TestEventingSwapRebWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebWithOps not found"
}
2021/12/24 23:18:20 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:18:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:18:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:18:27 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:18:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:18:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:18:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:18:37 Deploying app: TestEventingSwapRebWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 23:18:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithOps stored in temp store"
}
2021/12/24 23:18:43 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/24 23:18:48 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/24 23:18:53 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/24 23:18:58 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/24 23:18:58 App: TestEventingSwapRebWithOps got deployed
2021/12/24 23:18:58 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 23:18:58 Starting bucket ops to source bucket
2021/12/24 23:18:58 Removing node(s): [] from the cluster
2021/12/24 23:19:03 Rebalance progress: 12.5
2021/12/24 23:19:08 Rebalance progress: 12.5
2021/12/24 23:19:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:19:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:19:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:19:13 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 23:19:13 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 23:19:18 Rebalance progress: 12.5
2021/12/24 23:19:23 Rebalance progress: 12.5
2021/12/24 23:19:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:19:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:19:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:19:28 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 23:19:34 Rebalance progress: 12.5
2021/12/24 23:19:39 Rebalance progress: 12.5
2021/12/24 23:19:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:19:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:19:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:19:44 Waiting for src bucket item count to get to: 200000 curr count: 64745
2021/12/24 23:19:49 Waiting for src bucket item count to get to: 200000 curr count: 64745
2021/12/24 23:19:54 Waiting for src bucket item count to get to: 200000 curr count: 79802
2021/12/24 23:19:59 Waiting for src bucket item count to get to: 200000 curr count: 79802
2021/12/24 23:20:04 Waiting for src bucket item count to get to: 200000 curr count: 96083
2021/12/24 23:20:09 Waiting for src bucket item count to get to: 200000 curr count: 96083
2021/12/24 23:20:14 Waiting for src bucket item count to get to: 200000 curr count: 112249
2021/12/24 23:20:19 Waiting for src bucket item count to get to: 200000 curr count: 112249
2021/12/24 23:20:24 Waiting for src bucket item count to get to: 200000 curr count: 128419
2021/12/24 23:20:29 Waiting for src bucket item count to get to: 200000 curr count: 128419
2021/12/24 23:20:34 Waiting for src bucket item count to get to: 200000 curr count: 128419
2021/12/24 23:20:39 Waiting for src bucket item count to get to: 200000 curr count: 144468
2021/12/24 23:20:44 Waiting for src bucket item count to get to: 200000 curr count: 144468
2021/12/24 23:20:49 Waiting for src bucket item count to get to: 200000 curr count: 160549
2021/12/24 23:20:54 Waiting for src bucket item count to get to: 200000 curr count: 160549
2021/12/24 23:20:59 Waiting for src bucket item count to get to: 200000 curr count: 175655
2021/12/24 23:21:04 Waiting for src bucket item count to get to: 200000 curr count: 175655
2021/12/24 23:21:09 Waiting for src bucket item count to get to: 200000 curr count: 191634
2021/12/24 23:21:14 Waiting for src bucket item count to get to: 200000 curr count: 191634
2021/12/24 23:21:19 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 23:21:19 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 23:21:19 Starting bucket ops to source bucket
2021/12/24 23:25:05 Waiting for dst bucket item count to get to: 0 curr count: 19797
2021/12/24 23:25:10 Waiting for dst bucket item count to get to: 0 curr count: 1289
2021/12/24 23:25:15 Waiting for dst bucket item count to get to: 0 curr count: 1289
2021/12/24 23:25:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:25:15 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 23:25:20 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/24 23:25:25 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/24 23:25:30 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/24 23:25:35 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/24 23:25:35 App: TestEventingSwapRebWithOps got un-deployed
2021/12/24 23:25:35 No eventing-con process running
2021/12/24 23:25:35 Function: TestEventingSwapRebWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithOps deleting in background"
}
2021/12/24 23:25:37 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:25:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:25:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:25:44 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:25:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:25:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebWithOps (460.74s)
=== RUN   TestKVRebInWithOps
2021/12/24 23:25:59 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/24 23:25:59 App: TestKVRebInWithOps got un-deployed
2021/12/24 23:25:59 No eventing-con process running
2021/12/24 23:25:59 Function: TestKVRebInWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebInWithOps not found"
}
2021/12/24 23:26:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:26:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:26:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:26:07 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:26:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:26:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:26:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:26:17 Deploying app: TestKVRebInWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 23:26:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithOps stored in temp store"
}
2021/12/24 23:26:23 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/24 23:26:28 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/24 23:26:33 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/24 23:26:38 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/24 23:26:38 App: TestKVRebInWithOps got deployed
2021/12/24 23:26:38 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 23:26:38 Starting bucket ops to source bucket
2021/12/24 23:26:40 Removing node(s): [] from the cluster
2021/12/24 23:26:45 Rebalance progress: 12.5
2021/12/24 23:26:50 Rebalance progress: 12.5
2021/12/24 23:26:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:26:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:26:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:26:55 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 23:27:00 Rebalance progress: 12.5
2021/12/24 23:27:05 Rebalance progress: 12.5
2021/12/24 23:27:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:27:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:27:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:27:10 Waiting for src bucket item count to get to: 200000 curr count: 31415
2021/12/24 23:27:15 Waiting for src bucket item count to get to: 200000 curr count: 47654
2021/12/24 23:27:20 Waiting for src bucket item count to get to: 200000 curr count: 47654
2021/12/24 23:27:25 Waiting for src bucket item count to get to: 200000 curr count: 63671
2021/12/24 23:27:30 Waiting for src bucket item count to get to: 200000 curr count: 63671
2021/12/24 23:27:35 Waiting for src bucket item count to get to: 200000 curr count: 78796
2021/12/24 23:27:40 Waiting for src bucket item count to get to: 200000 curr count: 78796
2021/12/24 23:27:45 Waiting for src bucket item count to get to: 200000 curr count: 94697
2021/12/24 23:27:50 Waiting for src bucket item count to get to: 200000 curr count: 94697
2021/12/24 23:27:55 Waiting for src bucket item count to get to: 200000 curr count: 111071
2021/12/24 23:28:00 Waiting for src bucket item count to get to: 200000 curr count: 111071
2021/12/24 23:28:05 Waiting for src bucket item count to get to: 200000 curr count: 127041
2021/12/24 23:28:10 Waiting for src bucket item count to get to: 200000 curr count: 127041
2021/12/24 23:28:15 Waiting for src bucket item count to get to: 200000 curr count: 143280
2021/12/24 23:28:20 Waiting for src bucket item count to get to: 200000 curr count: 143280
2021/12/24 23:28:25 Waiting for src bucket item count to get to: 200000 curr count: 159655
2021/12/24 23:28:30 Waiting for src bucket item count to get to: 200000 curr count: 174677
2021/12/24 23:28:35 Waiting for src bucket item count to get to: 200000 curr count: 174677
2021/12/24 23:28:40 Waiting for src bucket item count to get to: 200000 curr count: 190920
2021/12/24 23:28:45 Waiting for src bucket item count to get to: 200000 curr count: 190920
2021/12/24 23:28:50 Waiting for src bucket item count to get to: 200000 curr count: 190920
2021/12/24 23:28:55 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 23:28:55 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 23:28:55 Starting bucket ops to source bucket
2021/12/24 23:32:41 Waiting for dst bucket item count to get to: 0 curr count: 11956
2021/12/24 23:32:46 Waiting for dst bucket item count to get to: 0 curr count: 11956
2021/12/24 23:32:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:32:46 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 23:32:51 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/24 23:32:56 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/24 23:33:01 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/24 23:33:06 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/24 23:33:06 App: TestKVRebInWithOps got un-deployed
2021/12/24 23:33:06 No eventing-con process running
2021/12/24 23:33:06 Function: TestKVRebInWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithOps deleting in background"
}
2021/12/24 23:33:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:33:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:33:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:33:14 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:33:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:33:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebInWithOps (450.70s)
=== RUN   TestKVRebOutWithOps
2021/12/24 23:33:24 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 23:33:25 Removing node(s): [] from the cluster
2021/12/24 23:33:30 Rebalance progress: 100
2021/12/24 23:33:35 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/24 23:33:35 App: TestKVRebOutWithOps got un-deployed
2021/12/24 23:33:35 No eventing-con process running
2021/12/24 23:33:35 Function: TestKVRebOutWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebOutWithOps not found"
}
2021/12/24 23:33:37 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:33:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:33:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:33:44 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:33:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:33:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:33:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:33:54 Deploying app: TestKVRebOutWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 23:33:55 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithOps stored in temp store"
}
2021/12/24 23:34:00 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/24 23:34:05 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/24 23:34:10 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/24 23:34:15 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/24 23:34:15 App: TestKVRebOutWithOps got deployed
2021/12/24 23:34:15 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 23:34:15 Starting bucket ops to source bucket
2021/12/24 23:34:20 Rebalance progress: 12.5
2021/12/24 23:34:25 Rebalance progress: 12.5
2021/12/24 23:34:30 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:34:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:34:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:34:30 Waiting for src bucket item count to get to: 200000 curr count: 6330
2021/12/24 23:34:35 Waiting for src bucket item count to get to: 200000 curr count: 22753
2021/12/24 23:34:40 Waiting for src bucket item count to get to: 200000 curr count: 22753
2021/12/24 23:34:45 Waiting for src bucket item count to get to: 200000 curr count: 38857
2021/12/24 23:34:50 Waiting for src bucket item count to get to: 200000 curr count: 55280
2021/12/24 23:34:55 Waiting for src bucket item count to get to: 200000 curr count: 55280
2021/12/24 23:35:00 Waiting for src bucket item count to get to: 200000 curr count: 71689
2021/12/24 23:35:05 Waiting for src bucket item count to get to: 200000 curr count: 71689
2021/12/24 23:35:10 Waiting for src bucket item count to get to: 200000 curr count: 71689
2021/12/24 23:35:15 Waiting for src bucket item count to get to: 200000 curr count: 86951
2021/12/24 23:35:20 Waiting for src bucket item count to get to: 200000 curr count: 86951
2021/12/24 23:35:25 Waiting for src bucket item count to get to: 200000 curr count: 103341
2021/12/24 23:35:30 Waiting for src bucket item count to get to: 200000 curr count: 103341
2021/12/24 23:35:35 Waiting for src bucket item count to get to: 200000 curr count: 119461
2021/12/24 23:35:40 Waiting for src bucket item count to get to: 200000 curr count: 119461
2021/12/24 23:35:45 Waiting for src bucket item count to get to: 200000 curr count: 135847
2021/12/24 23:35:50 Waiting for src bucket item count to get to: 200000 curr count: 135847
2021/12/24 23:35:55 Waiting for src bucket item count to get to: 200000 curr count: 152255
2021/12/24 23:36:00 Waiting for src bucket item count to get to: 200000 curr count: 152255
2021/12/24 23:36:05 Waiting for src bucket item count to get to: 200000 curr count: 168513
2021/12/24 23:36:10 Waiting for src bucket item count to get to: 200000 curr count: 168513
2021/12/24 23:36:15 Waiting for src bucket item count to get to: 200000 curr count: 183479
2021/12/24 23:36:20 Waiting for src bucket item count to get to: 200000 curr count: 183479
2021/12/24 23:36:25 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 23:36:25 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 23:36:25 Starting bucket ops to source bucket
2021/12/24 23:40:11 Waiting for dst bucket item count to get to: 0 curr count: 11334
2021/12/24 23:40:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:40:11 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 23:40:16 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/24 23:40:21 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/24 23:40:26 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/24 23:40:31 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/24 23:40:31 App: TestKVRebOutWithOps got un-deployed
2021/12/24 23:40:31 No eventing-con process running
2021/12/24 23:40:31 Function: TestKVRebOutWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithOps deleting in background"
}
2021/12/24 23:40:33 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:40:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:40:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:40:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:40:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:40:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOutWithOps (445.13s)
=== RUN   TestKVSwapRebWithOps
2021/12/24 23:40:55 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/24 23:40:55 App: TestKVSwapRebWithOps got un-deployed
2021/12/24 23:40:55 No eventing-con process running
2021/12/24 23:40:55 Function: TestKVSwapRebWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVSwapRebWithOps not found"
}
2021/12/24 23:40:56 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:41:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:41:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:41:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:41:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:41:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:41:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:41:13 Deploying app: TestKVSwapRebWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 23:41:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithOps stored in temp store"
}
2021/12/24 23:41:19 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/24 23:41:24 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/24 23:41:29 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/24 23:41:34 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/24 23:41:34 App: TestKVSwapRebWithOps got deployed
2021/12/24 23:41:34 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 23:41:34 Starting bucket ops to source bucket
2021/12/24 23:41:35 Removing node(s): [] from the cluster
2021/12/24 23:41:40 Rebalance progress: 12.5
2021/12/24 23:41:45 Rebalance progress: 12.5
2021/12/24 23:41:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:41:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:41:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:41:50 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 23:41:51 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 23:41:56 Rebalance progress: 12.5
2021/12/24 23:42:01 Rebalance progress: 12.5
2021/12/24 23:42:06 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:42:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:42:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:42:06 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 23:42:11 Rebalance progress: 12.5
2021/12/24 23:42:16 Rebalance progress: 12.5
2021/12/24 23:42:21 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:42:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:42:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:42:21 Waiting for src bucket item count to get to: 200000 curr count: 53525
2021/12/24 23:42:26 Waiting for src bucket item count to get to: 200000 curr count: 69874
2021/12/24 23:42:31 Waiting for src bucket item count to get to: 200000 curr count: 69874
2021/12/24 23:42:36 Waiting for src bucket item count to get to: 200000 curr count: 84849
2021/12/24 23:42:41 Waiting for src bucket item count to get to: 200000 curr count: 101287
2021/12/24 23:42:46 Waiting for src bucket item count to get to: 200000 curr count: 101287
2021/12/24 23:42:51 Waiting for src bucket item count to get to: 200000 curr count: 117629
2021/12/24 23:42:56 Waiting for src bucket item count to get to: 200000 curr count: 117629
2021/12/24 23:43:01 Waiting for src bucket item count to get to: 200000 curr count: 134229
2021/12/24 23:43:06 Waiting for src bucket item count to get to: 200000 curr count: 134229
2021/12/24 23:43:11 Waiting for src bucket item count to get to: 200000 curr count: 150488
2021/12/24 23:43:16 Waiting for src bucket item count to get to: 200000 curr count: 150488
2021/12/24 23:43:21 Waiting for src bucket item count to get to: 200000 curr count: 166899
2021/12/24 23:43:26 Waiting for src bucket item count to get to: 200000 curr count: 166899
2021/12/24 23:43:31 Waiting for src bucket item count to get to: 200000 curr count: 181990
2021/12/24 23:43:36 Waiting for src bucket item count to get to: 200000 curr count: 181990
2021/12/24 23:43:41 Waiting for src bucket item count to get to: 200000 curr count: 198449
2021/12/24 23:43:46 Waiting for src bucket item count to get to: 200000 curr count: 198449
2021/12/24 23:43:51 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 23:43:51 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 23:43:51 Starting bucket ops to source bucket
2021/12/24 23:47:37 Waiting for dst bucket item count to get to: 0 curr count: 22883
2021/12/24 23:47:42 Waiting for dst bucket item count to get to: 0 curr count: 5164
2021/12/24 23:47:47 Waiting for dst bucket item count to get to: 0 curr count: 5164
2021/12/24 23:47:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:47:47 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 23:47:52 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/24 23:47:57 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/24 23:48:02 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/24 23:48:07 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/24 23:48:07 App: TestKVSwapRebWithOps got un-deployed
2021/12/24 23:48:07 No eventing-con process running
2021/12/24 23:48:07 Function: TestKVSwapRebWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithOps deleting in background"
}
2021/12/24 23:48:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:48:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:48:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:48:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:48:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:48:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebWithOps (456.22s)
=== RUN   TestEventingRebInWithTimers
2021/12/24 23:48:31 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/24 23:48:31 App: TestEventingRebInWithTimers got un-deployed
2021/12/24 23:48:31 No eventing-con process running
2021/12/24 23:48:31 Function: TestEventingRebInWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebInWithTimers not found"
}
2021/12/24 23:48:33 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:48:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:48:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:48:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:48:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:48:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:48:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:48:49 Deploying app: TestEventingRebInWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/24 23:48:50 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithTimers stored in temp store"
}
2021/12/24 23:48:55 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/24 23:49:01 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/24 23:49:06 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/24 23:49:11 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/24 23:49:11 App: TestEventingRebInWithTimers got deployed
2021/12/24 23:49:11 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 23:49:11 Starting bucket ops to source bucket
2021/12/24 23:49:11 Removing node(s): [] from the cluster
2021/12/24 23:49:16 Rebalance progress: 12.5
2021/12/24 23:49:21 Rebalance progress: 12.5
2021/12/24 23:49:26 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:49:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:49:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:49:26 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 23:49:31 Rebalance progress: 12.5
2021/12/24 23:49:36 Rebalance progress: 12.5
2021/12/24 23:49:41 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:49:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:49:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:49:41 Waiting for src bucket item count to get to: 50000 curr count: 34436
2021/12/24 23:49:46 Waiting for src bucket item count to get to: 50000 curr count: 34436
2021/12/24 23:49:51 Waiting for src bucket item count to get to: 50000 curr count: 45641
2021/12/24 23:49:56 Waiting for src bucket item count to get to: 50000 curr count: 45641
2021/12/24 23:50:06 Waiting for dst bucket item count to get to: 50000 curr count: 41261
2021/12/24 23:50:11 Waiting for dst bucket item count to get to: 50000 curr count: 41261
2021/12/24 23:50:11 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 23:50:11 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 23:50:11 Starting bucket ops to source bucket
2021/12/24 23:51:20 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 23:51:25 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 23:51:30 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 23:51:35 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 23:51:40 Waiting for dst bucket item count to get to: 0 curr count: 43072
2021/12/24 23:51:45 Waiting for dst bucket item count to get to: 0 curr count: 43072
2021/12/24 23:51:50 Waiting for dst bucket item count to get to: 0 curr count: 20471
2021/12/24 23:51:55 Waiting for dst bucket item count to get to: 0 curr count: 20471
2021/12/24 23:52:00 Waiting for dst bucket item count to get to: 0 curr count: 4563
2021/12/24 23:52:05 Waiting for dst bucket item count to get to: 0 curr count: 4563
2021/12/24 23:52:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:52:05 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 23:52:10 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/24 23:52:15 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/24 23:52:20 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/24 23:52:25 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/24 23:52:25 App: TestEventingRebInWithTimers got un-deployed
2021/12/24 23:52:25 No eventing-con process running
2021/12/24 23:52:26 Function: TestEventingRebInWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithTimers deleting in background"
}
2021/12/24 23:52:27 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:52:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:52:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:52:34 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:52:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:52:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebInWithTimers (258.14s)
=== RUN   TestEventingRebOutWithTimers
2021/12/24 23:52:44 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 23:52:44 Removing node(s): [] from the cluster
2021/12/24 23:52:49 Rebalance progress: 100
2021/12/24 23:52:54 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/24 23:52:54 App: TestEventingRebOutWithTimers got un-deployed
2021/12/24 23:52:54 No eventing-con process running
2021/12/24 23:52:54 Function: TestEventingRebOutWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebOutWithTimers not found"
}
2021/12/24 23:52:56 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:53:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:53:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:53:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:53:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:53:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:53:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:53:13 Deploying app: TestEventingRebOutWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/24 23:53:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithTimers stored in temp store"
}
2021/12/24 23:53:19 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/24 23:53:24 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/24 23:53:29 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/24 23:53:34 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/24 23:53:34 App: TestEventingRebOutWithTimers got deployed
2021/12/24 23:53:34 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 23:53:34 Starting bucket ops to source bucket
2021/12/24 23:53:39 Rebalance progress: 12.5
2021/12/24 23:53:44 Rebalance progress: 12.5
2021/12/24 23:53:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:53:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:53:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:53:49 Waiting for src bucket item count to get to: 50000 curr count: 6646
2021/12/24 23:53:54 Waiting for src bucket item count to get to: 50000 curr count: 20924
2021/12/24 23:53:59 Waiting for src bucket item count to get to: 50000 curr count: 20924
2021/12/24 23:54:04 Waiting for src bucket item count to get to: 50000 curr count: 32645
2021/12/24 23:54:09 Waiting for src bucket item count to get to: 50000 curr count: 32645
2021/12/24 23:54:14 Waiting for src bucket item count to get to: 50000 curr count: 43975
2021/12/24 23:54:19 Waiting for src bucket item count to get to: 50000 curr count: 43975
2021/12/24 23:54:29 Waiting for dst bucket item count to get to: 50000 curr count: 37530
2021/12/24 23:54:34 Waiting for dst bucket item count to get to: 50000 curr count: 37530
2021/12/24 23:54:39 Waiting for dst bucket item count to get to: 50000 curr count: 37530
2021/12/24 23:54:44 Waiting for dst bucket item count to get to: 50000 curr count: 45020
2021/12/24 23:54:49 Waiting for dst bucket item count to get to: 50000 curr count: 45020
2021/12/24 23:54:49 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 23:54:49 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 23:54:49 Starting bucket ops to source bucket
2021/12/24 23:55:59 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 23:56:04 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 23:56:09 Waiting for dst bucket item count to get to: 0 curr count: 49196
2021/12/24 23:56:14 Waiting for dst bucket item count to get to: 0 curr count: 49196
2021/12/24 23:56:19 Waiting for dst bucket item count to get to: 0 curr count: 36370
2021/12/24 23:56:24 Waiting for dst bucket item count to get to: 0 curr count: 36370
2021/12/24 23:56:29 Waiting for dst bucket item count to get to: 0 curr count: 22970
2021/12/24 23:56:34 Waiting for dst bucket item count to get to: 0 curr count: 22970
2021/12/24 23:56:39 Waiting for dst bucket item count to get to: 0 curr count: 7500
2021/12/24 23:56:44 Waiting for dst bucket item count to get to: 0 curr count: 7500
2021/12/24 23:56:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:56:44 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 23:56:49 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/24 23:56:54 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/24 23:56:59 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/24 23:57:04 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/24 23:57:04 App: TestEventingRebOutWithTimers got un-deployed
2021/12/24 23:57:04 No eventing-con process running
2021/12/24 23:57:04 Function: TestEventingRebOutWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithTimers deleting in background"
}
2021/12/24 23:57:06 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:57:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:57:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:57:12 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:57:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:57:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebOutWithTimers (278.40s)
=== RUN   TestEventingSwapRebWithTimers
2021/12/24 23:57:27 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/24 23:57:27 App: TestEventingSwapRebWithTimers got un-deployed
2021/12/24 23:57:27 No eventing-con process running
2021/12/24 23:57:27 Function: TestEventingSwapRebWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebWithTimers not found"
}
2021/12/24 23:57:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:57:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:57:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 23:57:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:57:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:57:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:57:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 23:57:46 Deploying app: TestEventingSwapRebWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/24 23:57:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithTimers stored in temp store"
}
2021/12/24 23:57:52 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/24 23:57:57 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/24 23:58:02 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/24 23:58:07 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/24 23:58:07 App: TestEventingSwapRebWithTimers got deployed
2021/12/24 23:58:07 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 23:58:07 Starting bucket ops to source bucket
2021/12/24 23:58:08 Removing node(s): [] from the cluster
2021/12/24 23:58:13 Rebalance progress: 12.5
2021/12/24 23:58:18 Rebalance progress: 12.5
2021/12/24 23:58:23 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:58:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:58:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:58:23 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 23:58:23 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 23:58:28 Rebalance progress: 12.5
2021/12/24 23:58:33 Rebalance progress: 12.5
2021/12/24 23:58:38 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:58:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:58:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:58:38 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 23:58:43 Rebalance progress: 12.5
2021/12/24 23:58:48 Rebalance progress: 12.5
2021/12/24 23:58:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:58:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 23:58:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 23:58:58 Waiting for dst bucket item count to get to: 50000 curr count: 33537
2021/12/24 23:59:03 Waiting for dst bucket item count to get to: 50000 curr count: 33537
2021/12/24 23:59:08 Waiting for dst bucket item count to get to: 50000 curr count: 44410
2021/12/24 23:59:13 Waiting for dst bucket item count to get to: 50000 curr count: 44410
2021/12/24 23:59:18 Waiting for dst bucket item count to get to: 50000 curr count: 49998
2021/12/24 23:59:23 Waiting for dst bucket item count to get to: 50000 curr count: 49998
2021/12/24 23:59:23 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 23:59:23 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 23:59:23 Starting bucket ops to source bucket
2021/12/25 00:00:33 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:00:38 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:00:43 Waiting for dst bucket item count to get to: 0 curr count: 49721
2021/12/25 00:00:48 Waiting for dst bucket item count to get to: 0 curr count: 49721
2021/12/25 00:00:53 Waiting for dst bucket item count to get to: 0 curr count: 45743
2021/12/25 00:00:58 Waiting for dst bucket item count to get to: 0 curr count: 45743
2021/12/25 00:01:03 Waiting for dst bucket item count to get to: 0 curr count: 27396
2021/12/25 00:01:08 Waiting for dst bucket item count to get to: 0 curr count: 27396
2021/12/25 00:01:13 Waiting for dst bucket item count to get to: 0 curr count: 12716
2021/12/25 00:01:18 Waiting for dst bucket item count to get to: 0 curr count: 12716
2021/12/25 00:01:23 Waiting for dst bucket item count to get to: 0 curr count: 16
2021/12/25 00:01:28 Waiting for dst bucket item count to get to: 0 curr count: 16
2021/12/25 00:01:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:01:28 Post DELETE ops. Expected item count: 0 got 0
2021/12/25 00:01:33 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/25 00:01:38 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/25 00:01:43 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/25 00:01:48 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/25 00:01:48 App: TestEventingSwapRebWithTimers got un-deployed
2021/12/25 00:01:48 No eventing-con process running
2021/12/25 00:01:48 Function: TestEventingSwapRebWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithTimers deleting in background"
}
2021/12/25 00:01:50 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:01:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:01:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:01:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:02:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:02:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebWithTimers (284.68s)
=== RUN   TestKVRebInWithTimers
2021/12/25 00:02:12 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/25 00:02:12 App: TestKVRebInWithTimers got un-deployed
2021/12/25 00:02:12 No eventing-con process running
2021/12/25 00:02:12 Function: TestKVRebInWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebInWithTimers not found"
}
2021/12/25 00:02:14 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:02:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:02:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:02:21 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:02:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:02:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:02:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:02:31 Deploying app: TestKVRebInWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/25 00:02:32 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithTimers stored in temp store"
}
2021/12/25 00:02:37 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/25 00:02:42 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/25 00:02:47 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/25 00:02:52 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/25 00:02:52 App: TestKVRebInWithTimers got deployed
2021/12/25 00:02:52 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 00:02:52 Starting bucket ops to source bucket
2021/12/25 00:02:52 Removing node(s): [] from the cluster
2021/12/25 00:02:57 Rebalance progress: 12.5
2021/12/25 00:03:02 Rebalance progress: 12.5
2021/12/25 00:03:07 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:03:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:03:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:03:07 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 00:03:12 Rebalance progress: 12.5
2021/12/25 00:03:17 Rebalance progress: 12.5
2021/12/25 00:03:22 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:03:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:03:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:03:22 Waiting for src bucket item count to get to: 50000 curr count: 35070
2021/12/25 00:03:27 Waiting for src bucket item count to get to: 50000 curr count: 35070
2021/12/25 00:03:32 Waiting for src bucket item count to get to: 50000 curr count: 45675
2021/12/25 00:03:37 Waiting for src bucket item count to get to: 50000 curr count: 45675
2021/12/25 00:03:47 Waiting for dst bucket item count to get to: 50000 curr count: 36273
2021/12/25 00:03:52 Waiting for dst bucket item count to get to: 50000 curr count: 36273
2021/12/25 00:03:52 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 00:03:52 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 00:03:52 Starting bucket ops to source bucket
2021/12/25 00:05:03 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:05:08 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:05:13 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:05:18 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:05:23 Waiting for dst bucket item count to get to: 0 curr count: 43640
2021/12/25 00:05:28 Waiting for dst bucket item count to get to: 0 curr count: 43640
2021/12/25 00:05:33 Waiting for dst bucket item count to get to: 0 curr count: 28229
2021/12/25 00:05:38 Waiting for dst bucket item count to get to: 0 curr count: 28229
2021/12/25 00:05:43 Waiting for dst bucket item count to get to: 0 curr count: 10505
2021/12/25 00:05:48 Waiting for dst bucket item count to get to: 0 curr count: 10505
2021/12/25 00:05:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:05:48 Post DELETE ops. Expected item count: 0 got 0
2021/12/25 00:05:53 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/25 00:05:58 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/25 00:06:03 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/25 00:06:08 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/25 00:06:08 App: TestKVRebInWithTimers got un-deployed
2021/12/25 00:06:08 No eventing-con process running
2021/12/25 00:06:08 Function: TestKVRebInWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithTimers deleting in background"
}
2021/12/25 00:06:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:06:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:06:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:06:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:06:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:06:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebInWithTimers (259.51s)
=== RUN   TestKVRebOutWithTimers
2021/12/25 00:06:27 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 00:06:27 Removing node(s): [] from the cluster
2021/12/25 00:06:32 Rebalance progress: 100
2021/12/25 00:06:37 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/25 00:06:37 App: TestKVRebOutWithTimers got un-deployed
2021/12/25 00:06:37 No eventing-con process running
2021/12/25 00:06:37 Function: TestKVRebOutWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebOutWithTimers not found"
}
2021/12/25 00:06:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:06:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:06:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:06:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:06:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:06:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:06:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:06:55 Deploying app: TestKVRebOutWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/25 00:06:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithTimers stored in temp store"
}
2021/12/25 00:07:02 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/25 00:07:07 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/25 00:07:12 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/25 00:07:17 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/25 00:07:17 App: TestKVRebOutWithTimers got deployed
2021/12/25 00:07:17 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 00:07:17 Starting bucket ops to source bucket
2021/12/25 00:07:22 Rebalance progress: 12.5
2021/12/25 00:07:27 Rebalance progress: 12.5
2021/12/25 00:07:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:07:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:07:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:07:32 Waiting for src bucket item count to get to: 50000 curr count: 17849
2021/12/25 00:07:37 Waiting for src bucket item count to get to: 50000 curr count: 17849
2021/12/25 00:07:42 Waiting for src bucket item count to get to: 50000 curr count: 29043
2021/12/25 00:07:47 Waiting for src bucket item count to get to: 50000 curr count: 29043
2021/12/25 00:07:52 Waiting for src bucket item count to get to: 50000 curr count: 39725
2021/12/25 00:07:57 Waiting for src bucket item count to get to: 50000 curr count: 39725
2021/12/25 00:08:07 Waiting for dst bucket item count to get to: 50000 curr count: 36470
2021/12/25 00:08:12 Waiting for dst bucket item count to get to: 50000 curr count: 36470
2021/12/25 00:08:17 Waiting for dst bucket item count to get to: 50000 curr count: 36470
2021/12/25 00:08:22 Waiting for dst bucket item count to get to: 50000 curr count: 46582
2021/12/25 00:08:27 Waiting for dst bucket item count to get to: 50000 curr count: 46582
2021/12/25 00:08:27 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 00:08:27 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 00:08:27 Starting bucket ops to source bucket
2021/12/25 00:09:36 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:09:41 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:09:46 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:09:51 Waiting for dst bucket item count to get to: 0 curr count: 46555
2021/12/25 00:09:56 Waiting for dst bucket item count to get to: 0 curr count: 46555
2021/12/25 00:10:01 Waiting for dst bucket item count to get to: 0 curr count: 37167
2021/12/25 00:10:06 Waiting for dst bucket item count to get to: 0 curr count: 37167
2021/12/25 00:10:11 Waiting for dst bucket item count to get to: 0 curr count: 14352
2021/12/25 00:10:16 Waiting for dst bucket item count to get to: 0 curr count: 14352
2021/12/25 00:10:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:10:16 Post DELETE ops. Expected item count: 0 got 0
2021/12/25 00:10:21 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/25 00:10:26 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/25 00:10:32 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/25 00:10:37 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/25 00:10:37 App: TestKVRebOutWithTimers got un-deployed
2021/12/25 00:10:37 No eventing-con process running
2021/12/25 00:10:37 Function: TestKVRebOutWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithTimers deleting in background"
}
2021/12/25 00:10:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:10:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:10:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:10:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:10:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:10:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOutWithTimers (268.51s)
=== RUN   TestKVSwapRebWithTimers
2021/12/25 00:11:00 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/25 00:11:00 App: TestKVSwapRebWithTimers got un-deployed
2021/12/25 00:11:00 No eventing-con process running
2021/12/25 00:11:00 Function: TestKVSwapRebWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVSwapRebWithTimers not found"
}
2021/12/25 00:11:02 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:11:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:11:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:11:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:11:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:11:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:11:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:11:19 Deploying app: TestKVSwapRebWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/25 00:11:20 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithTimers stored in temp store"
}
2021/12/25 00:11:25 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/25 00:11:30 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/25 00:11:35 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/25 00:11:40 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/25 00:11:40 App: TestKVSwapRebWithTimers got deployed
2021/12/25 00:11:40 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 00:11:40 Starting bucket ops to source bucket
2021/12/25 00:11:40 Removing node(s): [] from the cluster
2021/12/25 00:11:45 Rebalance progress: 12.5
2021/12/25 00:11:50 Rebalance progress: 12.5
2021/12/25 00:11:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:11:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:11:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:11:55 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 00:11:56 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 00:12:01 Rebalance progress: 12.5
2021/12/25 00:12:06 Rebalance progress: 12.5
2021/12/25 00:12:11 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:12:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:12:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:12:11 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 00:12:16 Rebalance progress: 12.5
2021/12/25 00:12:21 Rebalance progress: 12.5
2021/12/25 00:12:26 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:12:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:12:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:12:26 Waiting for src bucket item count to get to: 50000 curr count: 45589
2021/12/25 00:12:36 Waiting for dst bucket item count to get to: 50000 curr count: 45157
2021/12/25 00:12:41 Waiting for dst bucket item count to get to: 50000 curr count: 45157
2021/12/25 00:12:41 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 00:12:41 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 00:12:41 Starting bucket ops to source bucket
2021/12/25 00:13:50 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:13:55 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:14:00 Waiting for dst bucket item count to get to: 0 curr count: 47650
2021/12/25 00:14:05 Waiting for dst bucket item count to get to: 0 curr count: 47650
2021/12/25 00:14:10 Waiting for dst bucket item count to get to: 0 curr count: 36189
2021/12/25 00:14:15 Waiting for dst bucket item count to get to: 0 curr count: 36189
2021/12/25 00:14:20 Waiting for dst bucket item count to get to: 0 curr count: 15013
2021/12/25 00:14:25 Waiting for dst bucket item count to get to: 0 curr count: 15013
2021/12/25 00:14:30 Waiting for dst bucket item count to get to: 0 curr count: 2765
2021/12/25 00:14:35 Waiting for dst bucket item count to get to: 0 curr count: 2765
2021/12/25 00:14:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:14:35 Post DELETE ops. Expected item count: 0 got 0
2021/12/25 00:14:40 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/25 00:14:45 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/25 00:14:50 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/25 00:14:55 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/25 00:15:00 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/25 00:15:05 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/25 00:15:06 App: TestKVSwapRebWithTimers got un-deployed
2021/12/25 00:15:06 No eventing-con process running
2021/12/25 00:15:06 Function: TestKVSwapRebWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithTimers deleting in background"
}
2021/12/25 00:15:07 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:15:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:15:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:15:14 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:15:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:15:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebWithTimers (268.92s)
=== RUN   TestDuplicateTimerCreationEventingRebIn
2021/12/25 00:15:29 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/25 00:15:29 App: TestDuplicateTimerCreationEventingRebIn got un-deployed
2021/12/25 00:15:29 No eventing-con process running
2021/12/25 00:15:29 Function: TestDuplicateTimerCreationEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingRebIn not found"
}
2021/12/25 00:15:31 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:15:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:15:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:15:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:15:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:15:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:15:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:15:48 Deploying app: TestDuplicateTimerCreationEventingRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/25 00:15:49 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebIn stored in temp store"
}
2021/12/25 00:15:54 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/25 00:15:59 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/25 00:16:04 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/25 00:16:09 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/25 00:16:09 App: TestDuplicateTimerCreationEventingRebIn got deployed
2021/12/25 00:16:09 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 00:16:09 Starting bucket ops to source bucket
2021/12/25 00:16:09 Removing node(s): [] from the cluster
2021/12/25 00:16:14 Rebalance progress: 12.5
2021/12/25 00:16:19 Rebalance progress: 12.5
2021/12/25 00:16:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:16:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:16:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:16:24 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 00:16:29 Rebalance progress: 12.5
2021/12/25 00:16:34 Rebalance progress: 12.5
2021/12/25 00:16:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:16:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:16:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:16:39 Waiting for src bucket item count to get to: 50000 curr count: 27349
2021/12/25 00:16:44 Waiting for src bucket item count to get to: 50000 curr count: 38708
2021/12/25 00:16:49 Waiting for src bucket item count to get to: 50000 curr count: 38708
2021/12/25 00:16:54 Waiting for src bucket item count to get to: 50000 curr count: 49483
2021/12/25 00:16:59 Waiting for src bucket item count to get to: 50000 curr count: 49483
2021/12/25 00:17:09 Waiting for dst bucket item count to get to: 50000 curr count: 36676
2021/12/25 00:17:14 Waiting for dst bucket item count to get to: 50000 curr count: 36676
2021/12/25 00:17:19 Waiting for dst bucket item count to get to: 50000 curr count: 45044
2021/12/25 00:17:24 Waiting for dst bucket item count to get to: 50000 curr count: 45044
2021/12/25 00:17:24 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 00:17:24 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 00:17:29 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/25 00:17:35 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/25 00:17:40 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/25 00:17:45 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/25 00:17:50 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/25 00:17:50 App: TestDuplicateTimerCreationEventingRebIn got un-deployed
2021/12/25 00:17:50 No eventing-con process running
2021/12/25 00:17:50 Function: TestDuplicateTimerCreationEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebIn deleting in background"
}
2021/12/25 00:17:52 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:17:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:18:02 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:18:07 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:18:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:18:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:18:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:18:18 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:18:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingRebIn (179.31s)
=== RUN   TestDuplicateTimerCreationEventingRebOut
2021/12/25 00:18:23 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 00:18:24 Removing node(s): [] from the cluster
2021/12/25 00:18:29 Rebalance progress: 100
2021/12/25 00:18:34 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/25 00:18:34 App: TestDuplicateTimerCreationEventingRebOut got un-deployed
2021/12/25 00:18:34 No eventing-con process running
2021/12/25 00:18:34 Function: TestDuplicateTimerCreationEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingRebOut not found"
}
2021/12/25 00:18:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:18:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:18:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:18:42 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:18:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:18:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:18:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:18:52 Deploying app: TestDuplicateTimerCreationEventingRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/25 00:18:53 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebOut stored in temp store"
}
2021/12/25 00:18:59 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2021/12/25 00:19:04 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2021/12/25 00:19:09 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2021/12/25 00:19:14 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2021/12/25 00:19:14 App: TestDuplicateTimerCreationEventingRebOut got deployed
2021/12/25 00:19:14 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 00:19:14 Starting bucket ops to source bucket
2021/12/25 00:19:19 Rebalance progress: 12.5
2021/12/25 00:19:24 Rebalance progress: 12.5
2021/12/25 00:19:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:19:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:19:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:19:29 Waiting for src bucket item count to get to: 50000 curr count: 6977
2021/12/25 00:19:34 Waiting for src bucket item count to get to: 50000 curr count: 20982
2021/12/25 00:19:39 Waiting for src bucket item count to get to: 50000 curr count: 20982
2021/12/25 00:19:44 Waiting for src bucket item count to get to: 50000 curr count: 35397
2021/12/25 00:19:49 Waiting for src bucket item count to get to: 50000 curr count: 35397
2021/12/25 00:19:54 Waiting for src bucket item count to get to: 50000 curr count: 46133
2021/12/25 00:19:59 Waiting for src bucket item count to get to: 50000 curr count: 46133
2021/12/25 00:20:04 Waiting for src bucket item count to get to: 50000 curr count: 46133
2021/12/25 00:20:14 Waiting for dst bucket item count to get to: 50000 curr count: 28494
2021/12/25 00:20:19 Waiting for dst bucket item count to get to: 50000 curr count: 28494
2021/12/25 00:20:24 Waiting for dst bucket item count to get to: 50000 curr count: 39467
2021/12/25 00:20:29 Waiting for dst bucket item count to get to: 50000 curr count: 39467
2021/12/25 00:20:29 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 00:20:29 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 00:20:34 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/25 00:20:39 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/25 00:20:44 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/25 00:20:49 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/25 00:20:54 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/25 00:20:54 App: TestDuplicateTimerCreationEventingRebOut got un-deployed
2021/12/25 00:20:54 No eventing-con process running
2021/12/25 00:20:54 Function: TestDuplicateTimerCreationEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebOut deleting in background"
}
2021/12/25 00:20:56 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:21:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:21:06 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:21:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:21:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:21:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:21:18 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:21:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingRebOut (179.64s)
=== RUN   TestDuplicateTimerCreationEventingSwapReb
2021/12/25 00:21:28 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/25 00:21:28 App: TestDuplicateTimerCreationEventingSwapReb got un-deployed
2021/12/25 00:21:28 No eventing-con process running
2021/12/25 00:21:28 Function: TestDuplicateTimerCreationEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingSwapReb not found"
}
2021/12/25 00:21:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:21:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:21:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:21:37 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:21:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:21:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:21:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:21:47 Deploying app: TestDuplicateTimerCreationEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/25 00:21:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingSwapReb stored in temp store"
}
2021/12/25 00:21:53 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/25 00:21:58 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/25 00:22:03 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/25 00:22:08 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/25 00:22:08 App: TestDuplicateTimerCreationEventingSwapReb got deployed
2021/12/25 00:22:08 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 00:22:08 Starting bucket ops to source bucket
2021/12/25 00:22:09 Removing node(s): [] from the cluster
2021/12/25 00:22:14 Rebalance progress: 12.5
2021/12/25 00:22:19 Rebalance progress: 12.5
2021/12/25 00:22:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:22:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:22:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:22:24 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 00:22:25 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 00:22:30 Rebalance progress: 12.5
2021/12/25 00:22:35 Rebalance progress: 12.5
2021/12/25 00:22:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:22:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:22:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:22:40 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 00:22:45 Rebalance progress: 12.5
2021/12/25 00:22:50 Rebalance progress: 12.5
2021/12/25 00:22:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:22:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:22:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:22:55 Waiting for src bucket item count to get to: 50000 curr count: 49283
2021/12/25 00:23:00 Waiting for src bucket item count to get to: 50000 curr count: 49283
2021/12/25 00:23:10 Waiting for dst bucket item count to get to: 50000 curr count: 35388
2021/12/25 00:23:15 Waiting for dst bucket item count to get to: 50000 curr count: 35388
2021/12/25 00:23:20 Waiting for dst bucket item count to get to: 50000 curr count: 42042
2021/12/25 00:23:25 Waiting for dst bucket item count to get to: 50000 curr count: 42042
2021/12/25 00:23:25 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 00:23:25 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 00:23:30 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/25 00:23:35 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/25 00:23:41 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/25 00:23:46 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/25 00:23:51 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/25 00:23:51 App: TestDuplicateTimerCreationEventingSwapReb got un-deployed
2021/12/25 00:23:51 No eventing-con process running
2021/12/25 00:23:51 Function: TestDuplicateTimerCreationEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingSwapReb deleting in background"
}
2021/12/25 00:23:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:23:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:24:03 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:24:08 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:24:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:24:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:24:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:24:19 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:24:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingSwapReb (181.35s)
=== RUN   TestDuplicateTimerCreationKVRebIn
2021/12/25 00:24:29 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/25 00:24:29 App: TestDuplicateTimerCreationKVRebIn got un-deployed
2021/12/25 00:24:29 No eventing-con process running
2021/12/25 00:24:29 Function: TestDuplicateTimerCreationKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVRebIn not found"
}
2021/12/25 00:24:31 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:24:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:24:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:24:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:24:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:24:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:24:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:24:48 Deploying app: TestDuplicateTimerCreationKVRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/25 00:24:49 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebIn stored in temp store"
}
2021/12/25 00:24:54 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/25 00:24:59 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/25 00:25:04 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/25 00:25:09 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/25 00:25:09 App: TestDuplicateTimerCreationKVRebIn got deployed
2021/12/25 00:25:09 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 00:25:09 Starting bucket ops to source bucket
2021/12/25 00:25:09 Removing node(s): [] from the cluster
2021/12/25 00:25:14 Rebalance progress: 12.5
2021/12/25 00:25:19 Rebalance progress: 12.5
2021/12/25 00:25:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:25:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:25:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:25:24 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 00:25:30 Rebalance progress: 12.5
2021/12/25 00:25:35 Rebalance progress: 12.5
2021/12/25 00:25:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:25:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:25:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:25:40 Waiting for src bucket item count to get to: 50000 curr count: 25792
2021/12/25 00:25:45 Waiting for src bucket item count to get to: 50000 curr count: 36706
2021/12/25 00:25:50 Waiting for src bucket item count to get to: 50000 curr count: 36706
2021/12/25 00:25:55 Waiting for src bucket item count to get to: 50000 curr count: 47157
2021/12/25 00:26:00 Waiting for src bucket item count to get to: 50000 curr count: 47157
2021/12/25 00:26:10 Waiting for dst bucket item count to get to: 50000 curr count: 34824
2021/12/25 00:26:15 Waiting for dst bucket item count to get to: 50000 curr count: 34824
2021/12/25 00:26:20 Waiting for dst bucket item count to get to: 50000 curr count: 41503
2021/12/25 00:26:25 Waiting for dst bucket item count to get to: 50000 curr count: 41503
2021/12/25 00:26:25 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 00:26:25 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 00:26:30 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/25 00:26:35 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/25 00:26:40 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/25 00:26:45 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/25 00:26:50 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/25 00:26:50 App: TestDuplicateTimerCreationKVRebIn got un-deployed
2021/12/25 00:26:50 No eventing-con process running
2021/12/25 00:26:50 Function: TestDuplicateTimerCreationKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebIn deleting in background"
}
2021/12/25 00:26:52 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:26:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:27:02 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:27:07 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:27:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:27:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:27:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:27:19 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:27:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVRebIn (179.62s)
=== RUN   TestDuplicateTimerCreationKVRebOut
2021/12/25 00:27:24 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 00:27:24 Removing node(s): [] from the cluster
2021/12/25 00:27:29 Rebalance progress: 100
2021/12/25 00:27:34 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/25 00:27:34 App: TestDuplicateTimerCreationKVRebOut got un-deployed
2021/12/25 00:27:34 No eventing-con process running
2021/12/25 00:27:34 Function: TestDuplicateTimerCreationKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVRebOut not found"
}
2021/12/25 00:27:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:27:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:27:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:27:43 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:27:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:27:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:27:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:27:53 Deploying app: TestDuplicateTimerCreationKVRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/25 00:27:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebOut stored in temp store"
}
2021/12/25 00:27:59 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/25 00:28:04 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/25 00:28:09 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/25 00:28:14 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/25 00:28:14 App: TestDuplicateTimerCreationKVRebOut got deployed
2021/12/25 00:28:14 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 00:28:14 Starting bucket ops to source bucket
2021/12/25 00:28:19 Rebalance progress: 12.5
2021/12/25 00:28:24 Rebalance progress: 12.5
2021/12/25 00:28:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:28:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:28:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:28:29 Waiting for src bucket item count to get to: 50000 curr count: 6423
2021/12/25 00:28:34 Waiting for src bucket item count to get to: 50000 curr count: 20536
2021/12/25 00:28:39 Waiting for src bucket item count to get to: 50000 curr count: 20536
2021/12/25 00:28:44 Waiting for src bucket item count to get to: 50000 curr count: 32820
2021/12/25 00:28:49 Waiting for src bucket item count to get to: 50000 curr count: 32820
2021/12/25 00:28:54 Waiting for src bucket item count to get to: 50000 curr count: 43390
2021/12/25 00:28:59 Waiting for src bucket item count to get to: 50000 curr count: 43390
2021/12/25 00:29:04 Waiting for src bucket item count to get to: 50000 curr count: 43390
2021/12/25 00:29:14 Waiting for dst bucket item count to get to: 50000 curr count: 34495
2021/12/25 00:29:19 Waiting for dst bucket item count to get to: 50000 curr count: 34495
2021/12/25 00:29:24 Waiting for dst bucket item count to get to: 50000 curr count: 41917
2021/12/25 00:29:29 Waiting for dst bucket item count to get to: 50000 curr count: 41917
2021/12/25 00:29:29 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 00:29:29 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 00:29:34 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/25 00:29:39 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/25 00:29:45 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/25 00:29:50 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/25 00:29:55 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/25 00:29:55 App: TestDuplicateTimerCreationKVRebOut got un-deployed
2021/12/25 00:29:55 No eventing-con process running
2021/12/25 00:29:55 Function: TestDuplicateTimerCreationKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebOut deleting in background"
}
2021/12/25 00:29:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:30:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:30:07 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:30:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:30:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:30:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:30:18 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:30:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVRebOut (179.33s)
=== RUN   TestDuplicateTimerCreationKVSwapReb
2021/12/25 00:30:28 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/25 00:30:28 App: TestDuplicateTimerCreationKVSwapReb got un-deployed
2021/12/25 00:30:28 No eventing-con process running
2021/12/25 00:30:28 Function: TestDuplicateTimerCreationKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVSwapReb not found"
}
2021/12/25 00:30:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:30:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:30:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:30:37 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:30:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:30:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:30:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:30:47 Deploying app: TestDuplicateTimerCreationKVSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/25 00:30:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVSwapReb stored in temp store"
}
2021/12/25 00:30:53 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/25 00:30:58 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/25 00:31:03 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/25 00:31:08 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/25 00:31:08 App: TestDuplicateTimerCreationKVSwapReb got deployed
2021/12/25 00:31:08 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 00:31:08 Starting bucket ops to source bucket
2021/12/25 00:31:09 Removing node(s): [] from the cluster
2021/12/25 00:31:14 Rebalance progress: 12.5
2021/12/25 00:31:19 Rebalance progress: 12.5
2021/12/25 00:31:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:31:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:31:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:31:24 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 00:31:24 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 00:31:29 Rebalance progress: 12.5
2021/12/25 00:31:34 Rebalance progress: 12.5
2021/12/25 00:31:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:31:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:31:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:31:39 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 00:31:44 Rebalance progress: 12.5
2021/12/25 00:31:49 Rebalance progress: 12.5
2021/12/25 00:31:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:31:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:31:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:31:54 Waiting for src bucket item count to get to: 50000 curr count: 49615
2021/12/25 00:31:59 Waiting for src bucket item count to get to: 50000 curr count: 49615
2021/12/25 00:32:09 Waiting for dst bucket item count to get to: 50000 curr count: 37677
2021/12/25 00:32:14 Waiting for dst bucket item count to get to: 50000 curr count: 37677
2021/12/25 00:32:19 Waiting for dst bucket item count to get to: 50000 curr count: 44226
2021/12/25 00:32:24 Waiting for dst bucket item count to get to: 50000 curr count: 44226
2021/12/25 00:32:24 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 00:32:24 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 00:32:29 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/25 00:32:35 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/25 00:32:40 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/25 00:32:45 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/25 00:32:50 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/25 00:32:55 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/25 00:32:55 App: TestDuplicateTimerCreationKVSwapReb got un-deployed
2021/12/25 00:32:55 No eventing-con process running
2021/12/25 00:32:55 Function: TestDuplicateTimerCreationKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVSwapReb deleting in background"
}
2021/12/25 00:32:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:33:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:33:07 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:33:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:33:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:33:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:33:18 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:33:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVSwapReb (180.22s)
=== RUN   TestDuplicateTimerFiringEventingRebIn
2021/12/25 00:33:28 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/25 00:33:29 App: TestDuplicateTimerFiringEventingRebIn got un-deployed
2021/12/25 00:33:29 No eventing-con process running
2021/12/25 00:33:29 Function: TestDuplicateTimerFiringEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingRebIn not found"
}
2021/12/25 00:33:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:33:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:33:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:33:37 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:33:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:33:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:33:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:33:47 Deploying app: TestDuplicateTimerFiringEventingRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/25 00:33:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebIn stored in temp store"
}
2021/12/25 00:33:53 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/25 00:33:58 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/25 00:34:03 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/25 00:34:08 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/25 00:34:08 App: TestDuplicateTimerFiringEventingRebIn got deployed
2021/12/25 00:34:08 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 00:34:08 Starting bucket ops to source bucket
2021/12/25 00:34:09 Removing node(s): [] from the cluster
2021/12/25 00:34:14 Rebalance progress: 12.5
2021/12/25 00:34:19 Rebalance progress: 12.5
2021/12/25 00:34:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:34:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:34:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:34:24 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 00:34:29 Rebalance progress: 12.5
2021/12/25 00:34:34 Rebalance progress: 12.5
2021/12/25 00:34:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:34:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:34:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:34:39 Waiting for src bucket item count to get to: 50000 curr count: 26883
2021/12/25 00:34:44 Waiting for src bucket item count to get to: 50000 curr count: 36365
2021/12/25 00:34:49 Waiting for src bucket item count to get to: 50000 curr count: 36365
2021/12/25 00:34:54 Waiting for src bucket item count to get to: 50000 curr count: 49365
2021/12/25 00:34:59 Waiting for src bucket item count to get to: 50000 curr count: 49365
2021/12/25 00:35:09 Waiting for dst bucket item count to get to: 50000 curr count: 43825
2021/12/25 00:35:14 Waiting for dst bucket item count to get to: 50000 curr count: 43825
2021/12/25 00:35:14 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 00:35:14 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 00:35:19 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/25 00:35:24 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/25 00:35:29 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/25 00:35:35 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/25 00:35:40 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/25 00:35:40 App: TestDuplicateTimerFiringEventingRebIn got un-deployed
2021/12/25 00:35:40 No eventing-con process running
2021/12/25 00:35:40 Function: TestDuplicateTimerFiringEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebIn deleting in background"
}
2021/12/25 00:35:41 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:35:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:35:51 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:35:56 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:35:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:35:58 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:36:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:36:08 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:36:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingRebIn (169.64s)
=== RUN   TestDuplicateTimerFiringEventingRebOut
2021/12/25 00:36:13 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 00:36:14 Removing node(s): [] from the cluster
2021/12/25 00:36:19 Rebalance progress: 100
2021/12/25 00:36:24 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/25 00:36:24 App: TestDuplicateTimerFiringEventingRebOut got un-deployed
2021/12/25 00:36:24 No eventing-con process running
2021/12/25 00:36:24 Function: TestDuplicateTimerFiringEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingRebOut not found"
}
2021/12/25 00:36:25 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:36:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:36:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:36:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:36:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:36:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:36:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:36:42 Deploying app: TestDuplicateTimerFiringEventingRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/25 00:36:43 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebOut stored in temp store"
}
2021/12/25 00:36:48 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/25 00:36:53 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/25 00:36:58 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/25 00:37:03 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/25 00:37:03 App: TestDuplicateTimerFiringEventingRebOut got deployed
2021/12/25 00:37:03 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 00:37:03 Starting bucket ops to source bucket
2021/12/25 00:37:08 Rebalance progress: 12.5
2021/12/25 00:37:13 Rebalance progress: 12.5
2021/12/25 00:37:18 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:37:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:37:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:37:18 Waiting for src bucket item count to get to: 50000 curr count: 7529
2021/12/25 00:37:23 Waiting for src bucket item count to get to: 50000 curr count: 21231
2021/12/25 00:37:28 Waiting for src bucket item count to get to: 50000 curr count: 21231
2021/12/25 00:37:33 Waiting for src bucket item count to get to: 50000 curr count: 32956
2021/12/25 00:37:39 Waiting for src bucket item count to get to: 50000 curr count: 32956
2021/12/25 00:37:44 Waiting for src bucket item count to get to: 50000 curr count: 43877
2021/12/25 00:37:49 Waiting for src bucket item count to get to: 50000 curr count: 43877
2021/12/25 00:37:54 Waiting for src bucket item count to get to: 50000 curr count: 43877
2021/12/25 00:38:04 Waiting for dst bucket item count to get to: 50000 curr count: 35090
2021/12/25 00:38:09 Waiting for dst bucket item count to get to: 50000 curr count: 35090
2021/12/25 00:38:14 Waiting for dst bucket item count to get to: 50000 curr count: 47433
2021/12/25 00:38:19 Waiting for dst bucket item count to get to: 50000 curr count: 47433
2021/12/25 00:38:19 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 00:38:19 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 00:38:24 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/25 00:38:29 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/25 00:38:34 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/25 00:38:39 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/25 00:38:44 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/25 00:38:44 App: TestDuplicateTimerFiringEventingRebOut got un-deployed
2021/12/25 00:38:44 No eventing-con process running
2021/12/25 00:38:44 Function: TestDuplicateTimerFiringEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebOut deleting in background"
}
2021/12/25 00:38:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:38:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:38:56 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:38:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:38:58 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:39:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:39:08 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:39:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingRebOut (179.67s)
=== RUN   TestDuplicateTimerFiringEventingSwapReb
2021/12/25 00:39:18 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/25 00:39:18 App: TestDuplicateTimerFiringEventingSwapReb got un-deployed
2021/12/25 00:39:18 No eventing-con process running
2021/12/25 00:39:18 Function: TestDuplicateTimerFiringEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingSwapReb not found"
}
2021/12/25 00:39:20 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:39:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:39:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:39:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:39:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:39:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:39:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:39:36 Deploying app: TestDuplicateTimerFiringEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/25 00:39:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingSwapReb stored in temp store"
}
2021/12/25 00:39:43 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/25 00:39:48 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/25 00:39:53 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/25 00:39:58 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/25 00:39:58 App: TestDuplicateTimerFiringEventingSwapReb got deployed
2021/12/25 00:39:58 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/25 00:39:58 Starting bucket ops to source bucket
2021/12/25 00:39:58 Removing node(s): [] from the cluster
2021/12/25 00:40:03 Rebalance progress: 12.5
2021/12/25 00:40:08 Rebalance progress: 12.5
2021/12/25 00:40:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:40:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:40:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:40:13 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 00:40:14 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 00:40:19 Rebalance progress: 12.5
2021/12/25 00:40:24 Rebalance progress: 12.5
2021/12/25 00:40:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:40:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:40:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:40:29 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 00:40:34 Rebalance progress: 12.5
2021/12/25 00:40:39 Rebalance progress: 12.5
2021/12/25 00:40:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:40:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:40:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:40:44 Waiting for src bucket item count to get to: 50000 curr count: 49265
2021/12/25 00:40:49 Waiting for src bucket item count to get to: 50000 curr count: 49265
2021/12/25 00:40:59 Waiting for dst bucket item count to get to: 50000 curr count: 43781
2021/12/25 00:41:04 Waiting for dst bucket item count to get to: 50000 curr count: 43781
2021/12/25 00:41:04 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 00:41:04 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 00:41:09 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/25 00:41:14 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/25 00:41:19 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/25 00:41:24 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/25 00:41:30 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/25 00:41:30 App: TestDuplicateTimerFiringEventingSwapReb got un-deployed
2021/12/25 00:41:30 No eventing-con process running
2021/12/25 00:41:30 Function: TestDuplicateTimerFiringEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingSwapReb deleting in background"
}
2021/12/25 00:41:31 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:41:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:41:41 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:41:46 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:41:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:41:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:41:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:41:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:41:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingSwapReb (170.28s)
=== RUN   TestDuplicateTimerFiringKVRebIn
2021/12/25 00:42:08 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/25 00:42:08 App: TestDuplicateTimerFiringKVRebIn got un-deployed
2021/12/25 00:42:08 No eventing-con process running
2021/12/25 00:42:08 Function: TestDuplicateTimerFiringKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVRebIn not found"
}
2021/12/25 00:42:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:42:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:42:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:42:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:42:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:42:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:42:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:42:27 Deploying app: TestDuplicateTimerFiringKVRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/25 00:42:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebIn stored in temp store"
}
2021/12/25 00:42:33 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/25 00:42:38 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/25 00:42:43 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/25 00:42:48 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/25 00:42:48 App: TestDuplicateTimerFiringKVRebIn got deployed
2021/12/25 00:42:48 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 00:42:48 Starting bucket ops to source bucket
2021/12/25 00:42:49 Removing node(s): [] from the cluster
2021/12/25 00:42:54 Rebalance progress: 12.5
2021/12/25 00:42:59 Rebalance progress: 12.5
2021/12/25 00:43:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:43:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:43:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:43:04 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 00:43:09 Rebalance progress: 12.5
2021/12/25 00:43:14 Rebalance progress: 12.5
2021/12/25 00:43:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:43:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:43:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:43:19 Waiting for src bucket item count to get to: 50000 curr count: 26750
2021/12/25 00:43:24 Waiting for src bucket item count to get to: 50000 curr count: 35989
2021/12/25 00:43:29 Waiting for src bucket item count to get to: 50000 curr count: 35989
2021/12/25 00:43:34 Waiting for src bucket item count to get to: 50000 curr count: 48204
2021/12/25 00:43:39 Waiting for src bucket item count to get to: 50000 curr count: 48204
2021/12/25 00:43:49 Waiting for dst bucket item count to get to: 50000 curr count: 39904
2021/12/25 00:43:54 Waiting for dst bucket item count to get to: 50000 curr count: 39904
2021/12/25 00:43:59 Waiting for dst bucket item count to get to: 50000 curr count: 48003
2021/12/25 00:44:04 Waiting for dst bucket item count to get to: 50000 curr count: 48003
2021/12/25 00:44:04 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 00:44:04 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 00:44:09 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/25 00:44:14 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/25 00:44:19 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/25 00:44:24 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/25 00:44:30 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/25 00:44:30 App: TestDuplicateTimerFiringKVRebIn got un-deployed
2021/12/25 00:44:30 No eventing-con process running
2021/12/25 00:44:30 Function: TestDuplicateTimerFiringKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebIn deleting in background"
}
2021/12/25 00:44:31 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:44:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:44:41 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:44:46 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:44:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:44:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:44:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:44:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:44:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVRebIn (180.00s)
=== RUN   TestDuplicateTimerFiringKVRebOut
2021/12/25 00:45:03 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 00:45:03 Removing node(s): [] from the cluster
2021/12/25 00:45:08 Rebalance progress: 100
2021/12/25 00:45:13 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/25 00:45:14 App: TestDuplicateTimerFiringKVRebOut got un-deployed
2021/12/25 00:45:14 No eventing-con process running
2021/12/25 00:45:14 Function: TestDuplicateTimerFiringKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVRebOut not found"
}
2021/12/25 00:45:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:45:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:45:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:45:22 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:45:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:45:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:45:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:45:32 Deploying app: TestDuplicateTimerFiringKVRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/25 00:45:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebOut stored in temp store"
}
2021/12/25 00:45:38 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/25 00:45:43 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/25 00:45:48 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/25 00:45:53 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/25 00:45:53 App: TestDuplicateTimerFiringKVRebOut got deployed
2021/12/25 00:45:53 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 00:45:53 Starting bucket ops to source bucket
2021/12/25 00:45:58 Rebalance progress: 12.5
2021/12/25 00:46:03 Rebalance progress: 12.5
2021/12/25 00:46:08 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:46:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:46:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:46:08 Waiting for src bucket item count to get to: 50000 curr count: 7875
2021/12/25 00:46:13 Waiting for src bucket item count to get to: 50000 curr count: 19951
2021/12/25 00:46:18 Waiting for src bucket item count to get to: 50000 curr count: 19951
2021/12/25 00:46:23 Waiting for src bucket item count to get to: 50000 curr count: 31421
2021/12/25 00:46:28 Waiting for src bucket item count to get to: 50000 curr count: 31421
2021/12/25 00:46:33 Waiting for src bucket item count to get to: 50000 curr count: 31421
2021/12/25 00:46:38 Waiting for src bucket item count to get to: 50000 curr count: 42220
2021/12/25 00:46:43 Waiting for src bucket item count to get to: 50000 curr count: 42220
2021/12/25 00:46:53 Waiting for dst bucket item count to get to: 50000 curr count: 38094
2021/12/25 00:46:58 Waiting for dst bucket item count to get to: 50000 curr count: 38094
2021/12/25 00:47:03 Waiting for dst bucket item count to get to: 50000 curr count: 49484
2021/12/25 00:47:08 Waiting for dst bucket item count to get to: 50000 curr count: 49484
2021/12/25 00:47:08 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 00:47:08 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 00:47:13 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/25 00:47:19 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/25 00:47:24 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/25 00:47:29 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/25 00:47:34 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/25 00:47:34 App: TestDuplicateTimerFiringKVRebOut got un-deployed
2021/12/25 00:47:34 No eventing-con process running
2021/12/25 00:47:34 Function: TestDuplicateTimerFiringKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebOut deleting in background"
}
2021/12/25 00:47:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:47:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:47:46 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:47:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:47:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:47:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:47:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:47:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVRebOut (179.56s)
=== RUN   TestDuplicateTimerFiringKVSwapReb
2021/12/25 00:48:08 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/25 00:48:08 App: TestDuplicateTimerFiringKVSwapReb got un-deployed
2021/12/25 00:48:08 No eventing-con process running
2021/12/25 00:48:08 Function: TestDuplicateTimerFiringKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVSwapReb not found"
}
2021/12/25 00:48:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:48:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:48:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:48:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:48:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:48:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:48:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:48:26 Deploying app: TestDuplicateTimerFiringKVSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/25 00:48:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVSwapReb stored in temp store"
}
2021/12/25 00:48:32 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/25 00:48:37 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/25 00:48:42 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/25 00:48:47 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/25 00:48:47 App: TestDuplicateTimerFiringKVSwapReb got deployed
2021/12/25 00:48:47 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 00:48:47 Starting bucket ops to source bucket
2021/12/25 00:48:48 Removing node(s): [] from the cluster
2021/12/25 00:48:53 Rebalance progress: 12.5
2021/12/25 00:48:58 Rebalance progress: 12.5
2021/12/25 00:49:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:49:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:49:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:49:03 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 00:49:03 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 00:49:08 Rebalance progress: 12.5
2021/12/25 00:49:13 Rebalance progress: 12.5
2021/12/25 00:49:18 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:49:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:49:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:49:18 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 00:49:23 Rebalance progress: 12.5
2021/12/25 00:49:28 Rebalance progress: 12.5
2021/12/25 00:49:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:49:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:49:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:49:33 Waiting for src bucket item count to get to: 50000 curr count: 48401
2021/12/25 00:49:38 Waiting for src bucket item count to get to: 50000 curr count: 48401
2021/12/25 00:49:48 Waiting for dst bucket item count to get to: 50000 curr count: 46221
2021/12/25 00:49:53 Waiting for dst bucket item count to get to: 50000 curr count: 46221
2021/12/25 00:49:53 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/25 00:49:53 Post SET ops. Expected item count: 50000 got 50000
2021/12/25 00:49:58 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/25 00:50:04 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/25 00:50:09 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/25 00:50:14 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/25 00:50:19 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/25 00:50:19 App: TestDuplicateTimerFiringKVSwapReb got un-deployed
2021/12/25 00:50:19 No eventing-con process running
2021/12/25 00:50:19 Function: TestDuplicateTimerFiringKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVSwapReb deleting in background"
}
2021/12/25 00:50:21 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:50:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:50:31 Waiting for dst bucket item count to get to: 0 curr count: 38503
2021/12/25 00:50:36 Waiting for dst bucket item count to get to: 0 curr count: 38503
2021/12/25 00:50:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:50:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:50:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:50:48 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/25 00:50:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVSwapReb (169.89s)
=== RUN   TestKVRebOnUpdateBucketOpOneByOne
2021/12/25 00:50:58 Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 00:50:58 App: bucket_op_on_update got un-deployed
2021/12/25 00:50:58 No eventing-con process running
2021/12/25 00:50:58 Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 00:50:59 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:51:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:51:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:51:06 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:51:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:51:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:51:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:51:16 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 00:51:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/25 00:51:22 Starting bucket ops to source bucket
2021/12/25 00:51:27 Waiting for app: bucket_op_on_update to get deployed
2021/12/25 00:51:32 Waiting for app: bucket_op_on_update to get deployed
2021/12/25 00:51:37 Waiting for app: bucket_op_on_update to get deployed
2021/12/25 00:51:37 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:51:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:51:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:51:37 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 00:51:38 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 00:51:43 Rebalance progress: 12.5
2021/12/25 00:51:48 Rebalance progress: 12.5
2021/12/25 00:51:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:51:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:51:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:51:53 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 00:51:53 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 00:51:58 Rebalance progress: 12.5
2021/12/25 00:52:03 Rebalance progress: 12.5
2021/12/25 00:52:08 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:52:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:52:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:52:08 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/25 00:52:09 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 00:52:14 Rebalance progress: 12.5
2021/12/25 00:52:19 Rebalance progress: 12.5
2021/12/25 00:52:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:52:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:52:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:52:24 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 00:52:29 Rebalance progress: 12.5
2021/12/25 00:52:34 Rebalance progress: 12.5
2021/12/25 00:52:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:52:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:52:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:52:39 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 00:52:44 Rebalance progress: 12.5
2021/12/25 00:52:49 Rebalance progress: 12.5
2021/12/25 00:52:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:52:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:52:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:52:54 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/25 00:52:59 Rebalance progress: 12.5
2021/12/25 00:53:04 Rebalance progress: 12.5
2021/12/25 00:53:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:53:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:53:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:53:14 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 00:53:19 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 00:53:24 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 00:53:29 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 00:53:35 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 00:53:35 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 00:53:35 eventingSetup.go:46: No eventing-con process running
2021/12/25 00:53:35 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 00:53:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:53:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:53:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10658
2021/12/25 00:53:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:53:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:53:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:53:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10658
2021/12/25 00:53:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOnUpdateBucketOpOneByOne (190.65s)
=== RUN   TestKVForceFailover
2021/12/25 00:54:13 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 00:54:13 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 00:54:13 eventingSetup.go:46: No eventing-con process running
2021/12/25 00:54:13 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 00:54:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:54:20 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:54:20 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:54:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:54:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:54:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:54:27 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 00:54:27 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 00:54:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:54:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:54:32 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 00:54:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/25 00:54:33 Starting bucket ops to source bucket
2021/12/25 00:54:38 Waiting for app: bucket_op_on_update to get deployed
2021/12/25 00:54:43 Waiting for app: bucket_op_on_update to get deployed
2021/12/25 00:54:48 Waiting for app: bucket_op_on_update to get deployed
2021/12/25 00:54:53 Waiting for app: bucket_op_on_update to get deployed
2021/12/25 00:54:53 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:54:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:54:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:54:54 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
2021/12/25 00:55:14 clusterSetup.go:237: Kicking off failover recovery, type: full
2021/12/25 00:55:14 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/25 00:55:19 Rebalance progress: 12.5
2021/12/25 00:55:24 Rebalance progress: 12.5
2021/12/25 00:55:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:55:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:55:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:55:29 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2021/12/25 00:55:34 Rebalance progress: 12.5
2021/12/25 00:55:39 Rebalance progress: 12.5
2021/12/25 00:55:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:55:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:55:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:55:49 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 00:55:54 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 00:56:00 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 00:56:05 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 00:56:10 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 00:56:10 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 00:56:10 eventingSetup.go:46: No eventing-con process running
2021/12/25 00:56:10 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 00:56:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:56:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:56:22 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7070
2021/12/25 00:56:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7070
2021/12/25 00:56:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:56:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:56:33 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:56:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7070
2021/12/25 00:56:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVForceFailover (160.32s)
=== RUN   TestKVHardFailoverRecovery
2021/12/25 00:56:48 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 00:56:49 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 00:56:49 eventingSetup.go:46: No eventing-con process running
2021/12/25 00:56:49 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 00:56:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:56:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:56:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:56:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:57:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:57:02 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:57:07 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:57:07 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 00:57:08 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/25 00:57:13 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 00:57:18 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 00:57:23 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 00:57:28 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 00:57:28 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:57:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:57:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:57:28 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 00:57:28 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 00:57:33 Rebalance progress: 12.5
2021/12/25 00:57:38 Rebalance progress: 12.5
2021/12/25 00:57:43 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:57:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:57:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:57:43 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
2021/12/25 00:58:44 clusterSetup.go:237: Kicking off failover recovery, type: full
2021/12/25 00:58:49 Rebalance progress: 12.5
2021/12/25 00:58:54 Rebalance progress: 12.5
2021/12/25 00:58:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:58:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:58:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:58:59 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 00:59:04 Rebalance progress: 12.5
2021/12/25 00:59:09 Rebalance progress: 12.5
2021/12/25 00:59:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:59:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:59:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 00:59:19 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 00:59:24 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 00:59:29 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 00:59:34 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 00:59:39 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 00:59:39 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 00:59:39 eventingSetup.go:46: No eventing-con process running
2021/12/25 00:59:39 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 00:59:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 00:59:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 00:59:51 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12030
2021/12/25 00:59:56 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12030
2021/12/25 00:59:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 00:59:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:00:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:00:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12030
2021/12/25 01:00:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVHardFailoverRecovery (209.54s)
=== RUN   TestKVRebOnUpdateBucketOpAllAtOnce
2021/12/25 01:00:18 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:00:18 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 01:00:18 eventingSetup.go:46: No eventing-con process running
2021/12/25 01:00:18 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 01:00:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:00:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:00:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:00:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:00:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:00:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:00:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:00:37 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 01:00:38 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/25 01:00:43 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 01:00:48 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:00:53 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:00:58 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:00:58 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:00:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:00:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:00:58 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 01:00:58 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 01:00:59 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/25 01:00:59 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 01:01:04 Rebalance progress: 12.5
2021/12/25 01:01:09 Rebalance progress: 12.5
2021/12/25 01:01:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:01:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:01:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:01:14 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/25 01:01:19 Rebalance progress: 12.5
2021/12/25 01:01:24 Rebalance progress: 12.5
2021/12/25 01:01:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:01:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:01:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:01:34 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:01:40 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:01:45 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:01:50 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:01:55 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:01:55 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 01:01:55 eventingSetup.go:46: No eventing-con process running
2021/12/25 01:01:55 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 01:01:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:02:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:02:07 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4629
2021/12/25 01:02:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:02:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:02:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:02:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4629
2021/12/25 01:02:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOnUpdateBucketOpAllAtOnce (130.44s)
=== RUN   TestKVSwapRebOnUpdateBucketOp
2021/12/25 01:02:28 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:02:28 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 01:02:29 eventingSetup.go:46: No eventing-con process running
2021/12/25 01:02:29 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 01:02:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:02:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:02:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:02:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:02:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:02:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:02:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:02:42 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 01:02:43 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/25 01:02:48 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 01:02:53 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:02:58 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:03:03 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:03:03 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:03:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:03:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:03:03 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 01:03:03 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 01:03:09 Rebalance progress: 12.5
2021/12/25 01:03:14 Rebalance progress: 12.5
2021/12/25 01:03:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:03:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:03:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:03:19 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 01:03:20 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 01:03:25 Rebalance progress: 12.5
2021/12/25 01:03:30 Rebalance progress: 12.5
2021/12/25 01:03:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:03:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:03:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:03:35 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 01:03:40 Rebalance progress: 12.5
2021/12/25 01:03:45 Rebalance progress: 12.5
2021/12/25 01:03:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:03:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:03:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:03:55 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:04:00 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:04:05 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:04:10 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:04:16 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:04:16 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 01:04:16 eventingSetup.go:46: No eventing-con process running
2021/12/25 01:04:16 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 01:04:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:04:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:04:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6169
2021/12/25 01:04:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:04:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:04:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:04:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6169
2021/12/25 01:04:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:04:44 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:04:44 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 01:04:44 eventingSetup.go:46: No eventing-con process running
2021/12/25 01:04:44 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 01:04:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:04:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:04:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:04:53 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:04:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:04:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebOnUpdateBucketOp (159.13s)
=== RUN   TestKVRebalanceWithMultipleHandlers
2021/12/25 01:05:08 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:05:08 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 01:05:08 eventingSetup.go:46: No eventing-con process running
2021/12/25 01:05:08 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 01:05:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:05:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:05:14 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:05:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:05:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:05:21 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:05:26 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 01:05:26 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/25 01:05:26 eventingSetup.go:46: No eventing-con process running
2021/12/25 01:05:26 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: sys_test_bucket_op not found"
}
2021/12/25 01:05:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:05:33 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:05:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:05:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:05:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:05:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:05:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:05:40 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 01:05:41 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:05:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:05:41 eventingSetup.go:125: Deploying app: sys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/25 01:05:42 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op stored in temp store"
}
2021/12/25 01:05:47 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 01:05:52 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:05:57 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:06:02 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:06:02 clusterSetup.go:354: App: bucket_op_on_update got deployed
2021/12/25 01:06:07 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/25 01:06:12 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/25 01:06:17 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/25 01:06:17 clusterSetup.go:354: App: sys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:06:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:06:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:06:17 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 01:06:17 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 01:06:22 Rebalance progress: 12.5
2021/12/25 01:06:27 Rebalance progress: 12.5
2021/12/25 01:06:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:06:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:06:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:06:33 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 01:06:33 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 01:06:38 Rebalance progress: 12.5
2021/12/25 01:06:43 Rebalance progress: 12.5
2021/12/25 01:06:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:06:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:06:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:06:48 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/25 01:06:48 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 01:06:53 Rebalance progress: 12.5
2021/12/25 01:06:58 Rebalance progress: 12.5
2021/12/25 01:07:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:07:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:07:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:07:03 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 01:07:08 Rebalance progress: 12.5
2021/12/25 01:07:13 Rebalance progress: 12.5
2021/12/25 01:07:18 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:07:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:07:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:07:18 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 01:07:24 Rebalance progress: 12.5
2021/12/25 01:07:29 Rebalance progress: 12.5
2021/12/25 01:07:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:07:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:07:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:07:34 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/25 01:07:39 Rebalance progress: 12.5
2021/12/25 01:07:44 Rebalance progress: 12.5
2021/12/25 01:07:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:07:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:07:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:07:54 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:07:59 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:08:04 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:08:09 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:08:14 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:08:19 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:08:25 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:08:25 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 01:08:25 eventingSetup.go:46: No eventing-con process running
2021/12/25 01:08:25 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 01:08:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:08:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:08:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12166
2021/12/25 01:08:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:08:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:08:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:08:50 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4931
2021/12/25 01:08:55 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4931
2021/12/25 01:08:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:09:00 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 01:09:06 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 01:09:11 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 01:09:16 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 01:09:21 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 01:09:21 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/25 01:09:21 eventingSetup.go:46: No eventing-con process running
2021/12/25 01:09:21 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op deleting in background"
}
2021/12/25 01:09:23 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:09:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:09:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:09:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:09:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:09:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebalanceWithMultipleHandlers (276.90s)
=== RUN   TestKVSwapRebalanceWithMultipleHandlers
2021/12/25 01:09:45 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:09:45 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 01:09:45 eventingSetup.go:46: No eventing-con process running
2021/12/25 01:09:45 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 01:09:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:09:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:09:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:09:53 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:09:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:09:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:10:03 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 01:10:03 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/25 01:10:03 eventingSetup.go:46: No eventing-con process running
2021/12/25 01:10:03 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: sys_test_bucket_op not found"
}
2021/12/25 01:10:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:10:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:10:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:10:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:10:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:10:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:10:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:10:17 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 01:10:18 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:10:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:10:18 eventingSetup.go:125: Deploying app: sys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/25 01:10:19 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op stored in temp store"
}
2021/12/25 01:10:24 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 01:10:29 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:10:34 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:10:39 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:10:39 clusterSetup.go:354: App: bucket_op_on_update got deployed
2021/12/25 01:10:44 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/25 01:10:49 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/25 01:10:54 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/25 01:10:54 clusterSetup.go:354: App: sys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:10:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:10:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:10:54 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 01:10:55 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 01:11:00 Rebalance progress: 12.5
2021/12/25 01:11:05 Rebalance progress: 12.5
2021/12/25 01:11:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:11:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:11:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:11:10 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 01:11:10 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 01:11:15 Rebalance progress: 12.5
2021/12/25 01:11:20 Rebalance progress: 12.5
2021/12/25 01:11:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:11:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:11:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:11:25 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 01:11:30 Rebalance progress: 12.5
2021/12/25 01:11:35 Rebalance progress: 12.5
2021/12/25 01:11:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:11:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:11:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:11:45 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:11:50 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:11:56 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:12:01 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:12:06 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:12:06 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 01:12:06 eventingSetup.go:46: No eventing-con process running
2021/12/25 01:12:06 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 01:12:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:12:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:12:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:12:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:12:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:12:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7619
2021/12/25 01:12:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:12:33 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 01:12:38 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 01:12:43 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 01:12:48 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 01:12:53 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/25 01:12:53 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/25 01:12:53 eventingSetup.go:46: No eventing-con process running
2021/12/25 01:12:53 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op deleting in background"
}
2021/12/25 01:12:55 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:13:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:13:00 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:13:02 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:13:07 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:13:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebalanceWithMultipleHandlers (212.21s)
=== RUN   TestKVRebStopStartKVOpsOnUpdateBucketOpOneByOne
2021/12/25 01:13:17 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:13:17 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 01:13:17 eventingSetup.go:46: No eventing-con process running
2021/12/25 01:13:17 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 01:13:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:13:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:13:24 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:13:25 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:13:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:13:30 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:13:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:13:35 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 01:13:36 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/25 01:13:41 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 01:13:46 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:13:51 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:13:56 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:13:56 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:13:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:13:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:13:56 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 01:13:57 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 01:14:17 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:14:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:14:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:14:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:14:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:14:28 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 01:14:33 Rebalance progress: 12.5
2021/12/25 01:14:38 Rebalance progress: 12.5
2021/12/25 01:14:43 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:14:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:14:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:14:43 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 01:14:43 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 01:14:48 Rebalance progress: 12.5
2021/12/25 01:14:53 Rebalance progress: 12.5
2021/12/25 01:14:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:14:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:14:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:14:58 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 01:15:03 Rebalance progress: 12.5
2021/12/25 01:15:08 Rebalance progress: 12.5
2021/12/25 01:15:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:15:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:15:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:15:18 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:15:23 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:15:29 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:15:34 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:15:39 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:15:39 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 01:15:39 eventingSetup.go:46: No eventing-con process running
2021/12/25 01:15:39 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 01:15:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:15:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:15:51 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5658
2021/12/25 01:15:56 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5658
2021/12/25 01:15:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:15:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:16:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:16:07 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9168
2021/12/25 01:16:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebStopStartKVOpsOnUpdateBucketOpOneByOne (180.56s)
=== RUN   TestKVFailoverOnUpdateBucketOp
2021/12/25 01:16:17 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:16:17 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 01:16:17 eventingSetup.go:46: No eventing-con process running
2021/12/25 01:16:17 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/25 01:16:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:16:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:16:24 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:16:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:16:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:16:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:16:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:16:36 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 01:16:37 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/25 01:16:42 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/25 01:16:47 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:16:52 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:16:57 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:16:57 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:16:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:16:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:16:57 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 01:16:57 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 01:17:02 Rebalance progress: 12.5
2021/12/25 01:17:07 Rebalance progress: 12.5
2021/12/25 01:17:12 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:17:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:17:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:17:12 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:17:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:17:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:17:22 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 01:17:28 Rebalance progress: 12.5
2021/12/25 01:17:33 Rebalance progress: 12.5
2021/12/25 01:17:38 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:17:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:17:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:17:38 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/25 01:17:38 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/25 01:17:43 Rebalance progress: 12.5
2021/12/25 01:17:48 Rebalance progress: 12.5
2021/12/25 01:17:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:17:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:17:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:17:53 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/25 01:17:58 Rebalance progress: 12.5
2021/12/25 01:18:03 Rebalance progress: 12.5
2021/12/25 01:18:08 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:18:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:18:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:18:13 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:18:18 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:18:23 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:18:28 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:18:33 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:18:33 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 01:18:33 eventingSetup.go:46: No eventing-con process running
2021/12/25 01:18:33 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 01:18:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:18:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:18:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8582
2021/12/25 01:18:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:18:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:18:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:18:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8582
2021/12/25 01:18:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVFailoverOnUpdateBucketOp (169.63s)
=== RUN   TestBootstrapAfterKVHardFailover
2021/12/25 01:19:02 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/25 01:19:02 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/25 01:19:07 Rebalance progress: 100
2021/12/25 01:19:07 Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:19:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:19:37 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/25 01:19:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/25 01:19:43 Removing node(s): [] from the cluster
2021/12/25 01:19:43 Starting bucket ops to source bucket
2021/12/25 01:19:48 Rebalance failed. See logs for detailed reason. You can try again.
2021/12/25 01:19:53 Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:19:58 Waiting for app: bucket_op_on_update to get deployed
2021/12/25 01:19:58 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:19:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:19:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/25 01:20:04 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:20:09 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:20:14 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:20:19 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:20:24 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/25 01:20:24 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/25 01:20:24 eventingSetup.go:46: No eventing-con process running
2021/12/25 01:20:24 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/25 01:20:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:20:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:20:36 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1509
2021/12/25 01:20:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/25 01:20:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/25 01:20:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/25 01:20:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1509
2021/12/25 01:20:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBootstrapAfterKVHardFailover (110.68s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	12013.815s

Rebalance tests took 3 hours, 20 minutes and 16 seconds.

Testing Succeeded


Version: versions-24.12.2021-17.35.cfg
Build Log: make-24.12.2021-17.35.log
Server Log: logs-24.12.2021-17.35.tar.gz

Finished