Building

Started building at 2021/12/23 18:11:10
Calculating base
Updating mirror
Basing run on 7.1.0-1975 11ca02dd8
Updating tree for run 23.12.2021-18.11
gocb is at 635fa6c, changes since last good build: none
libcouchbase is at f6822fc, changes since last good build: none
indexing is at 8d3522b, changes since last good build: none
kv_engine is at cda4d73, changes since last good build: none
ns_server is at 8590527, changes since last good build: none
couchstore is at 0bf3a4b, changes since last good build: none
couchdb is at fca2e6b, changes since last good build: none
testrunner is at a23e488, changes since last good build: 
 a23e4885f Fix test failures in eventing due to cluster not being reset after each test
Switching eventing to unstable
eventing is at d9c8767, changes since last good build: none
Switching eventing-ee to unstable
eventing-ee is at 8fcd80e, changes since last good build: 
 8fcd80e MB-50200 : Attempt to transpile n1ql only when the keywords are not part of a user defined name
Pulling in uncommitted change 160397 at refs/changes/97/160397/3
Total 23 (delta 15), reused 17 (delta 15)
[unstable b694b922] MB-100 : Do not fail n1ql timeout test if we are catching timeout exceptions successfully
 Author: abhijpes 
 Date: Mon Aug 30 08:24:38 2021 +0530
 1 file changed, 2 insertions(+), 2 deletions(-)
Pulling in uncommitted change 163449 at refs/changes/49/163449/1
Total 48 (delta 27), reused 39 (delta 27)
[unstable 835fd14c] MB-100: collect data when test fails
 Author: AnkitPrabhu 
 Date: Tue Oct 12 14:02:31 2021 +0530
 1 file changed, 2 insertions(+)
Pulling in uncommitted change 165806 at refs/changes/06/165806/45
Total 34 (delta 25), reused 34 (delta 25)
[unstable e6103b7f] MB-48538: Audit log refactor
 Author: AnkitPrabhu 
 Date: Mon Dec 13 10:30:25 2021 +0530
 18 files changed, 3165 insertions(+), 2213 deletions(-)
 create mode 100644 service_manager/response/defs.go
 create mode 100644 service_manager/response/response.go
Pulling in uncommitted change 165976 at refs/changes/76/165976/19
[unstable b1d5a2ec] MB-48538: Add new audit ids for different events
 Author: AnkitPrabhu 
 Date: Tue Nov 23 14:29:10 2021 +0530
 1 file changed, 337 insertions(+), 61 deletions(-)
Pulling in uncommitted change 166698 at refs/changes/98/166698/3
Total 4 (delta 3), reused 4 (delta 3)
[unstable fdaf816e] MB-48334 : Fail rebalance unless all functions deployed on current encryption level
 Author: abhijpes 
 Date: Wed Dec 1 14:51:29 2021 +0530
 1 file changed, 9 insertions(+)
Pulling in uncommitted change 167982 at refs/changes/82/167982/3
Total 42 (delta 32), reused 41 (delta 32)
[unstable 36330cac] MB-50179: Use vbucket forward map for master node calculation during vbucket movement
 Author: AnkitPrabhu 
 Date: Tue Dec 21 13:32:56 2021 +0530
 3 files changed, 31 insertions(+), 27 deletions(-)
Building cmakefiles and deps
Building main product

Testing

Started testing at 2021/12/23 18:26:59
Testing mode: rebalance,n1ql,functional
Starting server
Starting server: attempt 1

Functional tests

2021/12/23 18:28:30 Started functional
2021/12/23 18:28:38 Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2021/12/23 18:28:45 Error in adding nodes : , response: {"otpNode":"n_1@127.0.0.1"}
2021/12/23 18:28:45 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 18:28:51 Removing node(s): [] from the cluster
2021/12/23 18:28:56 Rebalance progress: 0
2021/12/23 18:29:01 Rebalance progress: 0.415943287037037
2021/12/23 18:29:06 Rebalance progress: 5.208333333333333
2021/12/23 18:29:11 Rebalance progress: 9.25925925925926
2021/12/23 18:29:16 Rebalance progress: 13.40060763888889
2021/12/23 18:29:21 Rebalance progress: 18.10257523148148
2021/12/23 18:29:26 Rebalance progress: 21.46629050925926
2021/12/23 18:29:31 Rebalance progress: 26.07783564814815
2021/12/23 18:29:36 Rebalance progress: 100
2021/12/23 18:29:38 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/23 18:29:53 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/23 18:30:08 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/23 18:30:23 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/23 18:30:38 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/23 18:30:53 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/23 18:31:08 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/23 18:31:23 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/23 18:31:38 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/23 18:31:53 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/23 18:32:08 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/23 18:32:23 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/23 18:32:38 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/23 18:32:53 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/23 18:33:08 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/23 18:33:23 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/23 18:33:38 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2021/12/23 18:33:53 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
=== RUN   TestAdvancedGetOps
2021/12/23 18:34:11 Deploying app: TestAdvancedGetOps. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:34:12 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedGetOps stored in temp store"
}
2021/12/23 18:34:17 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/23 18:34:22 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/23 18:34:27 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/23 18:34:32 Waiting for app: TestAdvancedGetOps to get deployed
2021/12/23 18:34:32 App: TestAdvancedGetOps got deployed
2021/12/23 18:34:32 Starting bucket ops to source bucket
2021/12/23 18:34:38 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/23 18:34:43 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/23 18:34:48 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/23 18:34:48 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/23 18:34:48 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:34:48 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:34:53 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/23 18:34:58 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/23 18:35:03 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/23 18:35:08 Waiting for app: TestAdvancedGetOps to get un-deployed
2021/12/23 18:35:08 App: TestAdvancedGetOps got un-deployed
2021/12/23 18:35:08 No eventing-con process running
2021/12/23 18:35:08 Function: TestAdvancedGetOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedGetOps deleting in background"
}
2021/12/23 18:35:09 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:35:19 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 18:35:24 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 18:35:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:35:26 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:35:36 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 18:35:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedGetOps (85.18s)
=== RUN   TestAdvancedInsertOps
2021/12/23 18:35:36 Deploying app: TestAdvancedInsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:35:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps stored in temp store"
}
2021/12/23 18:35:42 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/23 18:35:47 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/23 18:35:52 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/23 18:35:57 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/23 18:35:57 App: TestAdvancedInsertOps got deployed
2021/12/23 18:35:57 Starting bucket ops to source bucket
2021/12/23 18:36:03 Waiting for dst bucket item count to get to: 1024 curr count: 0
2021/12/23 18:36:08 Waiting for dst bucket item count to get to: 1024 curr count: 512
2021/12/23 18:36:13 Waiting for dst bucket item count to get to: 1024 curr count: 512
2021/12/23 18:36:13 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2021/12/23 18:36:13 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:36:13 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:36:18 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/23 18:36:23 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/23 18:36:29 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/23 18:36:34 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/23 18:36:34 App: TestAdvancedInsertOps got un-deployed
2021/12/23 18:36:34 No eventing-con process running
2021/12/23 18:36:34 Function: TestAdvancedInsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps deleting in background"
}
2021/12/23 18:36:35 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:36:45 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/23 18:36:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:36:47 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:36:57 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/23 18:36:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:36:57 Testing insert operation on source bucket
2021/12/23 18:36:57 Deploying app: TestAdvancedInsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:36:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps stored in temp store"
}
2021/12/23 18:37:03 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/23 18:37:08 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/23 18:37:13 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/23 18:37:18 Waiting for app: TestAdvancedInsertOps to get deployed
2021/12/23 18:37:18 App: TestAdvancedInsertOps got deployed
2021/12/23 18:37:18 Starting bucket ops to source bucket
2021/12/23 18:37:24 Waiting for dst bucket item count to get to: 2048 curr count: 0
2021/12/23 18:37:29 Waiting for dst bucket item count to get to: 2048 curr count: 1024
2021/12/23 18:37:29 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2021/12/23 18:37:29 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:37:29 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:37:34 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/23 18:37:39 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/23 18:37:44 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/23 18:37:49 Waiting for app: TestAdvancedInsertOps to get un-deployed
2021/12/23 18:37:49 App: TestAdvancedInsertOps got un-deployed
2021/12/23 18:37:49 No eventing-con process running
2021/12/23 18:37:49 Function: TestAdvancedInsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps deleting in background"
}
2021/12/23 18:37:51 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:38:01 Waiting for dst bucket item count to get to: 0 curr count: 2048
2021/12/23 18:38:06 Waiting for dst bucket item count to get to: 0 curr count: 2048
2021/12/23 18:38:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:38:08 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:38:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedInsertOps (156.65s)
=== RUN   TestAdvancedUpsertOps
2021/12/23 18:38:13 Starting bucket ops to source bucket
2021/12/23 18:38:14 Deploying app: TestAdvancedUpsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:38:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps stored in temp store"
}
2021/12/23 18:38:20 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/23 18:38:25 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/23 18:38:30 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/23 18:38:35 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/23 18:38:35 App: TestAdvancedUpsertOps got deployed
2021/12/23 18:38:35 Starting bucket ops to source bucket
2021/12/23 18:38:41 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/23 18:38:46 Waiting for dst bucket item count to get to: 0 curr count: 512
2021/12/23 18:38:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:38:46 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:38:46 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:38:51 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/23 18:38:56 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/23 18:39:01 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/23 18:39:06 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/23 18:39:06 App: TestAdvancedUpsertOps got un-deployed
2021/12/23 18:39:06 No eventing-con process running
2021/12/23 18:39:06 Function: TestAdvancedUpsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps deleting in background"
}
2021/12/23 18:39:08 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:39:18 Waiting for dst bucket item count to get to: 0 curr count: 512
2021/12/23 18:39:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:39:19 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:39:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:39:24 Testing upsert operation on source bucket
2021/12/23 18:39:24 Deploying app: TestAdvancedUpsertOps. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:39:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps stored in temp store"
}
2021/12/23 18:39:31 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/23 18:39:36 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/23 18:39:41 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/23 18:39:46 Waiting for app: TestAdvancedUpsertOps to get deployed
2021/12/23 18:39:46 App: TestAdvancedUpsertOps got deployed
2021/12/23 18:39:46 Starting bucket ops to source bucket
2021/12/23 18:39:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:39:47 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:39:47 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:39:52 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/23 18:39:57 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/23 18:40:02 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/23 18:40:07 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2021/12/23 18:40:07 App: TestAdvancedUpsertOps got un-deployed
2021/12/23 18:40:07 No eventing-con process running
2021/12/23 18:40:07 Function: TestAdvancedUpsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps deleting in background"
}
2021/12/23 18:40:08 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:40:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:40:16 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:40:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedUpsertOps (127.89s)
=== RUN   TestAdvancedReplaceOps
2021/12/23 18:40:21 Starting bucket ops to source bucket
2021/12/23 18:40:22 Deploying app: TestAdvancedReplaceOps. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:40:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps stored in temp store"
}
2021/12/23 18:40:28 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/23 18:40:33 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/23 18:40:38 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/23 18:40:43 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/23 18:40:43 App: TestAdvancedReplaceOps got deployed
2021/12/23 18:40:43 Starting bucket ops to source bucket
2021/12/23 18:40:49 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/23 18:40:54 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/23 18:40:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:40:54 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:40:54 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:40:59 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/23 18:41:04 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/23 18:41:09 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/23 18:41:14 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/23 18:41:14 App: TestAdvancedReplaceOps got un-deployed
2021/12/23 18:41:14 No eventing-con process running
2021/12/23 18:41:14 Function: TestAdvancedReplaceOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps deleting in background"
}
2021/12/23 18:41:16 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:41:26 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/23 18:41:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:41:28 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:41:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:41:33 Testing upsert operation on source bucket
2021/12/23 18:41:33 Deploying app: TestAdvancedReplaceOps. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:41:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps stored in temp store"
}
2021/12/23 18:41:39 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/23 18:41:44 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/23 18:41:49 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/23 18:41:54 Waiting for app: TestAdvancedReplaceOps to get deployed
2021/12/23 18:41:54 App: TestAdvancedReplaceOps got deployed
2021/12/23 18:41:54 Starting bucket ops to source bucket
2021/12/23 18:41:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:41:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:41:55 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:42:00 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/23 18:42:05 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/23 18:42:10 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/23 18:42:15 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2021/12/23 18:42:15 App: TestAdvancedReplaceOps got un-deployed
2021/12/23 18:42:15 No eventing-con process running
2021/12/23 18:42:15 Function: TestAdvancedReplaceOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps deleting in background"
}
2021/12/23 18:42:17 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:42:27 Waiting for dst bucket item count to get to: 0 curr count: 307
2021/12/23 18:42:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:42:29 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:42:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedReplaceOps (132.81s)
=== RUN   TestAdvancedDeleteOps
2021/12/23 18:42:34 Starting bucket ops to source bucket
2021/12/23 18:42:34 Deploying app: TestAdvancedDeleteOps. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:42:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps stored in temp store"
}
2021/12/23 18:42:40 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/23 18:42:45 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/23 18:42:50 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/23 18:42:55 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/23 18:42:55 App: TestAdvancedDeleteOps got deployed
2021/12/23 18:42:55 Starting bucket ops to source bucket
2021/12/23 18:43:00 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 18:43:05 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 18:43:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:43:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:43:05 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:43:10 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/23 18:43:15 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/23 18:43:20 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/23 18:43:25 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/23 18:43:25 App: TestAdvancedDeleteOps got un-deployed
2021/12/23 18:43:25 No eventing-con process running
2021/12/23 18:43:25 Function: TestAdvancedDeleteOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps deleting in background"
}
2021/12/23 18:43:27 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:43:37 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 18:43:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:43:39 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:43:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:43:44 Testing delete operation on source bucket
2021/12/23 18:43:44 Deploying app: TestAdvancedDeleteOps. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:43:45 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps stored in temp store"
}
2021/12/23 18:43:50 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/23 18:43:55 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/23 18:44:00 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/23 18:44:05 Waiting for app: TestAdvancedDeleteOps to get deployed
2021/12/23 18:44:05 App: TestAdvancedDeleteOps got deployed
2021/12/23 18:44:05 Starting bucket ops to source bucket
2021/12/23 18:44:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:44:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:44:05 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:44:10 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/23 18:44:15 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/23 18:44:20 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/23 18:44:25 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2021/12/23 18:44:25 App: TestAdvancedDeleteOps got un-deployed
2021/12/23 18:44:25 No eventing-con process running
2021/12/23 18:44:25 Function: TestAdvancedDeleteOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps deleting in background"
}
2021/12/23 18:44:27 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:44:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:44:34 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:44:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedDeleteOps (125.81s)
=== RUN   TestEnoentAdvancedGet
2021/12/23 18:44:39 Deploying app: TestEnoentAdvancedGet. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:44:41 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet stored in temp store"
}
2021/12/23 18:44:46 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/23 18:44:51 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/23 18:44:56 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/23 18:45:01 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/23 18:45:01 App: TestEnoentAdvancedGet got deployed
2021/12/23 18:45:01 Starting bucket ops to source bucket
2021/12/23 18:45:06 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/23 18:45:11 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/23 18:45:11 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/23 18:45:11 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:45:11 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:45:16 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/23 18:45:21 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/23 18:45:26 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/23 18:45:26 App: TestEnoentAdvancedGet got un-deployed
2021/12/23 18:45:26 No eventing-con process running
2021/12/23 18:45:26 Function: TestEnoentAdvancedGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet deleting in background"
}
2021/12/23 18:45:28 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:45:38 Waiting for dst bucket item count to get to: 0 curr count: 53
2021/12/23 18:45:43 Waiting for dst bucket item count to get to: 0 curr count: 3
2021/12/23 18:45:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:45:44 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:45:55 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 18:45:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:45:55 Testing get enoent operation on source bucket
2021/12/23 18:45:55 Deploying app: TestEnoentAdvancedGet. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:45:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet stored in temp store"
}
2021/12/23 18:46:01 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/23 18:46:06 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/23 18:46:11 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/23 18:46:16 Waiting for app: TestEnoentAdvancedGet to get deployed
2021/12/23 18:46:16 App: TestEnoentAdvancedGet got deployed
2021/12/23 18:46:16 Starting bucket ops to source bucket
2021/12/23 18:46:21 Waiting for dst bucket item count to get to: 200 curr count: 0
2021/12/23 18:46:21 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2021/12/23 18:46:21 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:46:21 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:46:26 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/23 18:46:31 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/23 18:46:36 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/23 18:46:41 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2021/12/23 18:46:41 App: TestEnoentAdvancedGet got un-deployed
2021/12/23 18:46:41 No eventing-con process running
2021/12/23 18:46:41 Function: TestEnoentAdvancedGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet deleting in background"
}
2021/12/23 18:46:43 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:46:53 Waiting for dst bucket item count to get to: 0 curr count: 200
2021/12/23 18:46:58 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 18:46:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:47:00 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:47:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedGet (145.18s)
=== RUN   TestEnoentAdvancedReplace
2021/12/23 18:47:05 Deploying app: TestEnoentAdvancedReplace. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:47:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace stored in temp store"
}
2021/12/23 18:47:11 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/23 18:47:16 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/23 18:47:21 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/23 18:47:26 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/23 18:47:26 App: TestEnoentAdvancedReplace got deployed
2021/12/23 18:47:26 Starting bucket ops to source bucket
2021/12/23 18:47:31 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/23 18:47:31 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/23 18:47:31 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:47:31 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:47:36 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/23 18:47:41 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/23 18:47:46 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/23 18:47:51 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/23 18:47:51 App: TestEnoentAdvancedReplace got un-deployed
2021/12/23 18:47:51 No eventing-con process running
2021/12/23 18:47:51 Function: TestEnoentAdvancedReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace deleting in background"
}
2021/12/23 18:47:53 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:48:03 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 18:48:08 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 18:48:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:48:10 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:48:20 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 18:48:25 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 18:48:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:48:25 Testing get enoent operation on source bucket
2021/12/23 18:48:25 Deploying app: TestEnoentAdvancedReplace. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:48:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace stored in temp store"
}
2021/12/23 18:48:31 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/23 18:48:36 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/23 18:48:41 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/23 18:48:46 Waiting for app: TestEnoentAdvancedReplace to get deployed
2021/12/23 18:48:46 App: TestEnoentAdvancedReplace got deployed
2021/12/23 18:48:46 Starting bucket ops to source bucket
2021/12/23 18:48:51 Waiting for dst bucket item count to get to: 200 curr count: 0
2021/12/23 18:48:51 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2021/12/23 18:48:51 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:48:51 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:48:56 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/23 18:49:01 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/23 18:49:06 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/23 18:49:11 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2021/12/23 18:49:11 App: TestEnoentAdvancedReplace got un-deployed
2021/12/23 18:49:11 No eventing-con process running
2021/12/23 18:49:11 Function: TestEnoentAdvancedReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace deleting in background"
}
2021/12/23 18:49:13 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:49:23 Waiting for dst bucket item count to get to: 0 curr count: 200
2021/12/23 18:49:28 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 18:49:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:49:29 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:49:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedReplace (149.89s)
=== RUN   TestEnoentAdvancedDelete
2021/12/23 18:49:34 Deploying app: TestEnoentAdvancedDelete. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:49:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete stored in temp store"
}
2021/12/23 18:49:41 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/23 18:49:46 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/23 18:49:51 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/23 18:49:56 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/23 18:49:56 App: TestEnoentAdvancedDelete got deployed
2021/12/23 18:49:56 Starting bucket ops to source bucket
2021/12/23 18:50:01 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/23 18:50:01 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/23 18:50:01 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:50:01 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:50:06 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/23 18:50:11 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/23 18:50:16 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/23 18:50:21 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/23 18:50:21 App: TestEnoentAdvancedDelete got un-deployed
2021/12/23 18:50:21 No eventing-con process running
2021/12/23 18:50:21 Function: TestEnoentAdvancedDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete deleting in background"
}
2021/12/23 18:50:23 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:50:33 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 18:50:38 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 18:50:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:50:39 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:50:49 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 18:50:54 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 18:50:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:50:54 Testing get enoent operation on source bucket
2021/12/23 18:50:54 Deploying app: TestEnoentAdvancedDelete. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:50:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete stored in temp store"
}
2021/12/23 18:51:01 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/23 18:51:06 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/23 18:51:11 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/23 18:51:16 Waiting for app: TestEnoentAdvancedDelete to get deployed
2021/12/23 18:51:16 App: TestEnoentAdvancedDelete got deployed
2021/12/23 18:51:16 Starting bucket ops to source bucket
2021/12/23 18:51:21 Waiting for dst bucket item count to get to: 200 curr count: 0
2021/12/23 18:51:21 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2021/12/23 18:51:21 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:51:21 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:51:26 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/23 18:51:31 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/23 18:51:36 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/23 18:51:41 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2021/12/23 18:51:41 App: TestEnoentAdvancedDelete got un-deployed
2021/12/23 18:51:41 No eventing-con process running
2021/12/23 18:51:41 Function: TestEnoentAdvancedDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete deleting in background"
}
2021/12/23 18:51:43 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:51:53 Waiting for dst bucket item count to get to: 0 curr count: 200
2021/12/23 18:51:58 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 18:51:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:51:59 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:52:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedDelete (149.95s)
=== RUN   TestAdvancedInsertKeyExist
2021/12/23 18:52:04 Deploying app: TestAdvancedInsertKeyExist. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:52:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist stored in temp store"
}
2021/12/23 18:52:11 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/23 18:52:16 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/23 18:52:21 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/23 18:52:26 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/23 18:52:26 App: TestAdvancedInsertKeyExist got deployed
2021/12/23 18:52:26 Starting bucket ops to source bucket
2021/12/23 18:52:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:52:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:52:26 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:52:31 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/23 18:52:36 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/23 18:52:41 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/23 18:52:46 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/23 18:52:46 App: TestAdvancedInsertKeyExist got un-deployed
2021/12/23 18:52:46 No eventing-con process running
2021/12/23 18:52:46 Function: TestAdvancedInsertKeyExist delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist deleting in background"
}
2021/12/23 18:52:48 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:52:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:52:55 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:53:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:53:00 Pumping document in the destination bucket
2021/12/23 18:53:00 Starting bucket ops to source bucket
2021/12/23 18:53:00 Deploying app: TestAdvancedInsertKeyExist. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:53:01 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist stored in temp store"
}
2021/12/23 18:53:06 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/23 18:53:11 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/23 18:53:16 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/23 18:53:21 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2021/12/23 18:53:21 App: TestAdvancedInsertKeyExist got deployed
2021/12/23 18:53:21 Starting bucket ops to source bucket
2021/12/23 18:53:27 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 18:53:32 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 18:53:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:53:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:53:32 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:53:37 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/23 18:53:42 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/23 18:53:47 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/23 18:53:52 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2021/12/23 18:53:52 App: TestAdvancedInsertKeyExist got un-deployed
2021/12/23 18:53:52 No eventing-con process running
2021/12/23 18:53:52 Function: TestAdvancedInsertKeyExist delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist deleting in background"
}
2021/12/23 18:53:53 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:54:03 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 18:54:08 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 18:54:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:54:10 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:54:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedInsertKeyExist (130.72s)
=== RUN   TestExipryGet
2021/12/23 18:54:15 Deploying app: TestExipryGet. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:54:16 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet stored in temp store"
}
2021/12/23 18:54:21 Waiting for app: TestExipryGet to get deployed
2021/12/23 18:54:26 Waiting for app: TestExipryGet to get deployed
2021/12/23 18:54:31 Waiting for app: TestExipryGet to get deployed
2021/12/23 18:54:36 Waiting for app: TestExipryGet to get deployed
2021/12/23 18:54:36 App: TestExipryGet got deployed
2021/12/23 18:54:36 Starting bucket ops to source bucket
2021/12/23 18:55:22 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 18:55:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:55:22 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:55:22 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:55:27 Waiting for app: TestExipryGet to get un-deployed
2021/12/23 18:55:32 Waiting for app: TestExipryGet to get un-deployed
2021/12/23 18:55:37 Waiting for app: TestExipryGet to get un-deployed
2021/12/23 18:55:42 Waiting for app: TestExipryGet to get un-deployed
2021/12/23 18:55:42 App: TestExipryGet got un-deployed
2021/12/23 18:55:42 No eventing-con process running
2021/12/23 18:55:42 Function: TestExipryGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet deleting in background"
}
2021/12/23 18:55:44 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:55:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:55:51 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:55:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:55:56 Pumping document in the destination bucket for expiry get
2021/12/23 18:55:56 Starting bucket ops to source bucket
2021/12/23 18:55:56 Deploying app: TestExipryGet. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:55:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet stored in temp store"
}
2021/12/23 18:56:02 Waiting for app: TestExipryGet to get deployed
2021/12/23 18:56:07 Waiting for app: TestExipryGet to get deployed
2021/12/23 18:56:12 Waiting for app: TestExipryGet to get deployed
2021/12/23 18:56:17 Waiting for app: TestExipryGet to get deployed
2021/12/23 18:56:17 App: TestExipryGet got deployed
2021/12/23 18:56:17 Starting bucket ops to source bucket
2021/12/23 18:57:03 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 18:57:08 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 18:57:13 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 18:57:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:57:13 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:57:13 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:57:18 Waiting for app: TestExipryGet to get un-deployed
2021/12/23 18:57:23 Waiting for app: TestExipryGet to get un-deployed
2021/12/23 18:57:28 Waiting for app: TestExipryGet to get un-deployed
2021/12/23 18:57:33 Waiting for app: TestExipryGet to get un-deployed
2021/12/23 18:57:33 App: TestExipryGet got un-deployed
2021/12/23 18:57:33 No eventing-con process running
2021/12/23 18:57:33 Function: TestExipryGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet deleting in background"
}
2021/12/23 18:57:34 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:57:44 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 18:57:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:57:46 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:57:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryGet (216.02s)
=== RUN   TestExipryInsert
2021/12/23 18:57:51 Deploying app: TestExipryInsert. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:57:52 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert stored in temp store"
}
2021/12/23 18:57:57 Waiting for app: TestExipryInsert to get deployed
2021/12/23 18:58:02 Waiting for app: TestExipryInsert to get deployed
2021/12/23 18:58:07 Waiting for app: TestExipryInsert to get deployed
2021/12/23 18:58:12 Waiting for app: TestExipryInsert to get deployed
2021/12/23 18:58:12 App: TestExipryInsert got deployed
2021/12/23 18:58:12 Starting bucket ops to source bucket
2021/12/23 18:58:58 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 18:59:03 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 18:59:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:59:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 18:59:03 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 18:59:08 Waiting for app: TestExipryInsert to get un-deployed
2021/12/23 18:59:13 Waiting for app: TestExipryInsert to get un-deployed
2021/12/23 18:59:18 Waiting for app: TestExipryInsert to get un-deployed
2021/12/23 18:59:23 Waiting for app: TestExipryInsert to get un-deployed
2021/12/23 18:59:23 App: TestExipryInsert got un-deployed
2021/12/23 18:59:23 No eventing-con process running
2021/12/23 18:59:23 Function: TestExipryInsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert deleting in background"
}
2021/12/23 18:59:24 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:59:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:59:32 Context: Bucket flush, response code: 200 dump: 
2021/12/23 18:59:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 18:59:37 Testing on the destination bucket for expiry insert
2021/12/23 18:59:37 Deploying app: TestExipryInsert. Item count src bucket: 0 dst bucket: 0
2021/12/23 18:59:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert stored in temp store"
}
2021/12/23 18:59:43 Waiting for app: TestExipryInsert to get deployed
2021/12/23 18:59:48 Waiting for app: TestExipryInsert to get deployed
2021/12/23 18:59:53 Waiting for app: TestExipryInsert to get deployed
2021/12/23 18:59:58 Waiting for app: TestExipryInsert to get deployed
2021/12/23 18:59:58 App: TestExipryInsert got deployed
2021/12/23 18:59:58 Starting bucket ops to source bucket
2021/12/23 19:00:43 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:00:48 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 19:00:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:00:48 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:00:48 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 19:00:53 Waiting for app: TestExipryInsert to get un-deployed
2021/12/23 19:00:58 Waiting for app: TestExipryInsert to get un-deployed
2021/12/23 19:01:03 Waiting for app: TestExipryInsert to get un-deployed
2021/12/23 19:01:08 Waiting for app: TestExipryInsert to get un-deployed
2021/12/23 19:01:08 App: TestExipryInsert got un-deployed
2021/12/23 19:01:08 No eventing-con process running
2021/12/23 19:01:08 Function: TestExipryInsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert deleting in background"
}
2021/12/23 19:01:10 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:01:20 Waiting for dst bucket item count to get to: 0 curr count: 65
2021/12/23 19:01:25 Waiting for dst bucket item count to get to: 0 curr count: 65
2021/12/23 19:01:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:01:27 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:01:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryInsert (220.62s)
=== RUN   TestExipryReplace
2021/12/23 19:01:32 Deploying app: TestExipryReplace. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:01:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace stored in temp store"
}
2021/12/23 19:01:38 Waiting for app: TestExipryReplace to get deployed
2021/12/23 19:01:43 Waiting for app: TestExipryReplace to get deployed
2021/12/23 19:01:48 Waiting for app: TestExipryReplace to get deployed
2021/12/23 19:01:53 Waiting for app: TestExipryReplace to get deployed
2021/12/23 19:01:53 App: TestExipryReplace got deployed
2021/12/23 19:01:53 Starting bucket ops to source bucket
2021/12/23 19:02:38 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:02:43 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 19:02:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:02:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:02:43 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 19:02:48 Waiting for app: TestExipryReplace to get un-deployed
2021/12/23 19:02:53 Waiting for app: TestExipryReplace to get un-deployed
2021/12/23 19:02:58 Waiting for app: TestExipryReplace to get un-deployed
2021/12/23 19:03:03 Waiting for app: TestExipryReplace to get un-deployed
2021/12/23 19:03:03 App: TestExipryReplace got un-deployed
2021/12/23 19:03:03 No eventing-con process running
2021/12/23 19:03:03 Function: TestExipryReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace deleting in background"
}
2021/12/23 19:03:05 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:03:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:03:12 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:03:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:03:17 Testing on the destination bucket for expiry insert
2021/12/23 19:03:17 Deploying app: TestExipryReplace. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:03:19 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace stored in temp store"
}
2021/12/23 19:03:24 Waiting for app: TestExipryReplace to get deployed
2021/12/23 19:03:29 Waiting for app: TestExipryReplace to get deployed
2021/12/23 19:03:34 Waiting for app: TestExipryReplace to get deployed
2021/12/23 19:03:39 Waiting for app: TestExipryReplace to get deployed
2021/12/23 19:03:39 App: TestExipryReplace got deployed
2021/12/23 19:03:39 Starting bucket ops to source bucket
2021/12/23 19:04:24 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:04:29 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 19:04:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:04:29 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:04:29 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 19:04:34 Waiting for app: TestExipryReplace to get un-deployed
2021/12/23 19:04:39 Waiting for app: TestExipryReplace to get un-deployed
2021/12/23 19:04:44 Waiting for app: TestExipryReplace to get un-deployed
2021/12/23 19:04:49 Waiting for app: TestExipryReplace to get un-deployed
2021/12/23 19:04:49 App: TestExipryReplace got un-deployed
2021/12/23 19:04:49 No eventing-con process running
2021/12/23 19:04:49 Function: TestExipryReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace deleting in background"
}
2021/12/23 19:04:51 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:05:01 Waiting for dst bucket item count to get to: 0 curr count: 87
2021/12/23 19:05:06 Waiting for dst bucket item count to get to: 0 curr count: 87
2021/12/23 19:05:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:05:07 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:05:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryReplace (220.70s)
=== RUN   TestExipryUpsert
2021/12/23 19:05:13 Deploying app: TestExipryUpsert. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:05:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert stored in temp store"
}
2021/12/23 19:05:19 Waiting for app: TestExipryUpsert to get deployed
2021/12/23 19:05:24 Waiting for app: TestExipryUpsert to get deployed
2021/12/23 19:05:29 Waiting for app: TestExipryUpsert to get deployed
2021/12/23 19:05:34 Waiting for app: TestExipryUpsert to get deployed
2021/12/23 19:05:34 App: TestExipryUpsert got deployed
2021/12/23 19:05:34 Starting bucket ops to source bucket
2021/12/23 19:06:19 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:06:24 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 19:06:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:06:24 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:06:24 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 19:06:29 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/23 19:06:34 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/23 19:06:39 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/23 19:06:44 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/23 19:06:44 App: TestExipryUpsert got un-deployed
2021/12/23 19:06:44 No eventing-con process running
2021/12/23 19:06:44 Function: TestExipryUpsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert deleting in background"
}
2021/12/23 19:06:46 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:06:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:06:53 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:06:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:06:58 Testing on the destination bucket for expiry insert
2021/12/23 19:06:58 Deploying app: TestExipryUpsert. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:06:59 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert stored in temp store"
}
2021/12/23 19:07:04 Waiting for app: TestExipryUpsert to get deployed
2021/12/23 19:07:09 Waiting for app: TestExipryUpsert to get deployed
2021/12/23 19:07:14 Waiting for app: TestExipryUpsert to get deployed
2021/12/23 19:07:19 Waiting for app: TestExipryUpsert to get deployed
2021/12/23 19:07:19 App: TestExipryUpsert got deployed
2021/12/23 19:07:19 Starting bucket ops to source bucket
2021/12/23 19:08:05 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:08:10 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:08:15 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 19:08:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:08:15 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:08:15 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 19:08:20 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/23 19:08:25 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/23 19:08:30 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/23 19:08:35 Waiting for app: TestExipryUpsert to get un-deployed
2021/12/23 19:08:35 App: TestExipryUpsert got un-deployed
2021/12/23 19:08:35 No eventing-con process running
2021/12/23 19:08:35 Function: TestExipryUpsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert deleting in background"
}
2021/12/23 19:08:37 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:08:47 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:08:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:08:48 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:08:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryUpsert (220.79s)
=== RUN   TestCasReplace
2021/12/23 19:08:53 Deploying app: TestCasReplace. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:08:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace stored in temp store"
}
2021/12/23 19:08:59 Waiting for app: TestCasReplace to get deployed
2021/12/23 19:09:04 Waiting for app: TestCasReplace to get deployed
2021/12/23 19:09:09 Waiting for app: TestCasReplace to get deployed
2021/12/23 19:09:15 Waiting for app: TestCasReplace to get deployed
2021/12/23 19:09:15 App: TestCasReplace got deployed
2021/12/23 19:09:15 Starting bucket ops to source bucket
2021/12/23 19:09:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:09:15 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:09:15 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 19:09:20 Waiting for app: TestCasReplace to get un-deployed
2021/12/23 19:09:25 Waiting for app: TestCasReplace to get un-deployed
2021/12/23 19:09:30 Waiting for app: TestCasReplace to get un-deployed
2021/12/23 19:09:35 Waiting for app: TestCasReplace to get un-deployed
2021/12/23 19:09:35 App: TestCasReplace got un-deployed
2021/12/23 19:09:35 No eventing-con process running
2021/12/23 19:09:35 Function: TestCasReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace deleting in background"
}
2021/12/23 19:09:37 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:09:47 Waiting for dst bucket item count to get to: 0 curr count: 5
2021/12/23 19:09:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:09:48 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:09:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:09:53 Testing on the destination bucket for upsert with cas
2021/12/23 19:09:53 Starting bucket ops to source bucket
2021/12/23 19:09:54 Deploying app: TestCasReplace. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:09:55 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace stored in temp store"
}
2021/12/23 19:10:00 Waiting for app: TestCasReplace to get deployed
2021/12/23 19:10:05 Waiting for app: TestCasReplace to get deployed
2021/12/23 19:10:10 Waiting for app: TestCasReplace to get deployed
2021/12/23 19:10:15 Waiting for app: TestCasReplace to get deployed
2021/12/23 19:10:15 App: TestCasReplace got deployed
2021/12/23 19:10:15 Starting bucket ops to source bucket
2021/12/23 19:10:20 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:10:25 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 19:10:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:10:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:10:25 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 19:10:30 Waiting for app: TestCasReplace to get un-deployed
2021/12/23 19:10:35 Waiting for app: TestCasReplace to get un-deployed
2021/12/23 19:10:40 Waiting for app: TestCasReplace to get un-deployed
2021/12/23 19:10:45 Waiting for app: TestCasReplace to get un-deployed
2021/12/23 19:10:45 App: TestCasReplace got un-deployed
2021/12/23 19:10:45 No eventing-con process running
2021/12/23 19:10:45 Function: TestCasReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace deleting in background"
}
2021/12/23 19:10:47 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:10:57 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:10:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:10:58 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:11:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCasReplace (130.17s)
=== RUN   TestCasDelete
2021/12/23 19:11:03 Deploying app: TestCasDelete. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:11:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete stored in temp store"
}
2021/12/23 19:11:10 Waiting for app: TestCasDelete to get deployed
2021/12/23 19:11:15 Waiting for app: TestCasDelete to get deployed
2021/12/23 19:11:20 Waiting for app: TestCasDelete to get deployed
2021/12/23 19:11:25 Waiting for app: TestCasDelete to get deployed
2021/12/23 19:11:25 App: TestCasDelete got deployed
2021/12/23 19:11:25 Starting bucket ops to source bucket
2021/12/23 19:11:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:11:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:11:25 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 19:11:30 Waiting for app: TestCasDelete to get un-deployed
2021/12/23 19:11:35 Waiting for app: TestCasDelete to get un-deployed
2021/12/23 19:11:40 Waiting for app: TestCasDelete to get un-deployed
2021/12/23 19:11:45 Waiting for app: TestCasDelete to get un-deployed
2021/12/23 19:11:45 App: TestCasDelete got un-deployed
2021/12/23 19:11:45 No eventing-con process running
2021/12/23 19:11:45 Function: TestCasDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete deleting in background"
}
2021/12/23 19:11:47 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:11:57 Waiting for dst bucket item count to get to: 0 curr count: 7
2021/12/23 19:11:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:11:58 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:12:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:12:03 Testing on the destination bucket for delete with cas
2021/12/23 19:12:03 Starting bucket ops to source bucket
2021/12/23 19:12:04 Deploying app: TestCasDelete. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:12:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete stored in temp store"
}
2021/12/23 19:12:10 Waiting for app: TestCasDelete to get deployed
2021/12/23 19:12:15 Waiting for app: TestCasDelete to get deployed
2021/12/23 19:12:20 Waiting for app: TestCasDelete to get deployed
2021/12/23 19:12:25 Waiting for app: TestCasDelete to get deployed
2021/12/23 19:12:25 App: TestCasDelete got deployed
2021/12/23 19:12:25 Starting bucket ops to source bucket
2021/12/23 19:12:30 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:12:35 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 19:12:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:12:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:12:35 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 19:12:40 Waiting for app: TestCasDelete to get un-deployed
2021/12/23 19:12:45 Waiting for app: TestCasDelete to get un-deployed
2021/12/23 19:12:50 Waiting for app: TestCasDelete to get un-deployed
2021/12/23 19:12:55 Waiting for app: TestCasDelete to get un-deployed
2021/12/23 19:12:55 App: TestCasDelete got un-deployed
2021/12/23 19:12:55 No eventing-con process running
2021/12/23 19:12:55 Function: TestCasDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete deleting in background"
}
2021/12/23 19:12:57 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:13:07 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:13:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:13:09 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:13:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCasDelete (130.15s)
=== RUN   TestCountersIncrement
2021/12/23 19:13:14 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/23 19:13:19 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 19:13:19 Removing node(s): [] from the cluster
2021/12/23 19:13:25 Rebalance progress: 100
2021/12/23 19:13:25 Deploying app: TestCountersIncrement. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:13:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement stored in temp store"
}
2021/12/23 19:13:31 Waiting for app: TestCountersIncrement to get deployed
2021/12/23 19:13:36 Waiting for app: TestCountersIncrement to get deployed
2021/12/23 19:13:41 Waiting for app: TestCountersIncrement to get deployed
2021/12/23 19:13:46 Waiting for app: TestCountersIncrement to get deployed
2021/12/23 19:13:46 App: TestCountersIncrement got deployed
2021/12/23 19:13:46 Starting bucket ops to source bucket
2021/12/23 19:13:52 Waiting for dst bucket item count to get to: 1024 curr count: 0
2021/12/23 19:13:57 Waiting for dst bucket item count to get to: 1024 curr count: 512
2021/12/23 19:13:57 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2021/12/23 19:13:57 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:14:02 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/23 19:14:07 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/23 19:14:12 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/23 19:14:17 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/23 19:14:17 App: TestCountersIncrement got un-deployed
2021/12/23 19:14:17 No eventing-con process running
2021/12/23 19:14:17 Function: TestCountersIncrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement deleting in background"
}
2021/12/23 19:14:19 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:14:29 Waiting for dst bucket item count to get to: 0 curr count: 1025
2021/12/23 19:14:34 Waiting for dst bucket item count to get to: 0 curr count: 512
2021/12/23 19:14:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:14:36 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:14:46 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/23 19:14:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:14:46 Deploying app: TestCountersIncrement. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:14:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement stored in temp store"
}
2021/12/23 19:14:52 Waiting for app: TestCountersIncrement to get deployed
2021/12/23 19:14:57 Waiting for app: TestCountersIncrement to get deployed
2021/12/23 19:15:02 Waiting for app: TestCountersIncrement to get deployed
2021/12/23 19:15:07 Waiting for app: TestCountersIncrement to get deployed
2021/12/23 19:15:07 App: TestCountersIncrement got deployed
2021/12/23 19:15:07 Starting bucket ops to source bucket
2021/12/23 19:15:13 Waiting for dst bucket item count to get to: 2048 curr count: 0
2021/12/23 19:15:18 Waiting for dst bucket item count to get to: 2048 curr count: 1120
2021/12/23 19:15:23 Waiting for dst bucket item count to get to: 2048 curr count: 1120
2021/12/23 19:15:23 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2021/12/23 19:15:23 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:15:28 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/23 19:15:33 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/23 19:15:38 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/23 19:15:43 Waiting for app: TestCountersIncrement to get un-deployed
2021/12/23 19:15:43 App: TestCountersIncrement got un-deployed
2021/12/23 19:15:43 No eventing-con process running
2021/12/23 19:15:43 Function: TestCountersIncrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement deleting in background"
}
2021/12/23 19:15:45 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:15:55 Waiting for dst bucket item count to get to: 0 curr count: 2048
2021/12/23 19:15:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:15:57 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:16:07 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/23 19:16:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:16:07 Removing node(s): [http://127.0.0.1:19002 http://127.0.0.1:19003] from the cluster
2021/12/23 19:16:12 Rebalance progress: 100
--- PASS: TestCountersIncrement (178.42s)
=== RUN   TestCountersDecrement
2021/12/23 19:16:12 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/23 19:16:12 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 19:16:13 Removing node(s): [] from the cluster
2021/12/23 19:16:18 Rebalance progress: 100
2021/12/23 19:16:18 Deploying app: TestCountersDecrement. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:16:19 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement stored in temp store"
}
2021/12/23 19:16:24 Waiting for app: TestCountersDecrement to get deployed
2021/12/23 19:16:29 Waiting for app: TestCountersDecrement to get deployed
2021/12/23 19:16:34 Waiting for app: TestCountersDecrement to get deployed
2021/12/23 19:16:39 Waiting for app: TestCountersDecrement to get deployed
2021/12/23 19:16:39 App: TestCountersDecrement got deployed
2021/12/23 19:16:39 Starting bucket ops to source bucket
2021/12/23 19:16:45 Waiting for dst bucket item count to get to: 1024 curr count: 0
2021/12/23 19:16:50 Waiting for dst bucket item count to get to: 1024 curr count: 10
2021/12/23 19:16:55 Waiting for dst bucket item count to get to: 1024 curr count: 522
2021/12/23 19:16:55 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2021/12/23 19:16:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:17:01 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/23 19:17:06 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/23 19:17:11 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/23 19:17:16 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/23 19:17:16 App: TestCountersDecrement got un-deployed
2021/12/23 19:17:16 No eventing-con process running
2021/12/23 19:17:16 Function: TestCountersDecrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement deleting in background"
}
2021/12/23 19:17:17 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:17:27 Waiting for dst bucket item count to get to: 0 curr count: 513
2021/12/23 19:17:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:17:29 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:17:39 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/23 19:17:44 Waiting for dst bucket item count to get to: 0 curr count: 512
2021/12/23 19:17:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:17:44 Deploying app: TestCountersDecrement. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:17:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement stored in temp store"
}
2021/12/23 19:17:51 Waiting for app: TestCountersDecrement to get deployed
2021/12/23 19:17:56 Waiting for app: TestCountersDecrement to get deployed
2021/12/23 19:18:01 Waiting for app: TestCountersDecrement to get deployed
2021/12/23 19:18:06 Waiting for app: TestCountersDecrement to get deployed
2021/12/23 19:18:06 App: TestCountersDecrement got deployed
2021/12/23 19:18:06 Starting bucket ops to source bucket
2021/12/23 19:18:12 Waiting for dst bucket item count to get to: 2048 curr count: 0
2021/12/23 19:18:12 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2021/12/23 19:18:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:18:17 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/23 19:18:22 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/23 19:18:27 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/23 19:18:32 Waiting for app: TestCountersDecrement to get un-deployed
2021/12/23 19:18:32 App: TestCountersDecrement got un-deployed
2021/12/23 19:18:32 No eventing-con process running
2021/12/23 19:18:32 Function: TestCountersDecrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement deleting in background"
}
2021/12/23 19:18:34 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:18:44 Waiting for dst bucket item count to get to: 0 curr count: 2048
2021/12/23 19:18:49 Waiting for dst bucket item count to get to: 0 curr count: 1024
2021/12/23 19:18:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:18:51 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:19:01 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/23 19:19:06 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/23 19:19:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:19:06 Removing node(s): [http://127.0.0.1:19002 http://127.0.0.1:19003] from the cluster
2021/12/23 19:19:11 Rebalance progress: 100
--- PASS: TestCountersDecrement (178.68s)
=== RUN   TestCacheGet
2021/12/23 19:19:11 Deploying app: TestCacheGet. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:19:12 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheGet stored in temp store"
}
2021/12/23 19:19:17 Waiting for app: TestCacheGet to get deployed
2021/12/23 19:19:22 Waiting for app: TestCacheGet to get deployed
2021/12/23 19:19:27 Waiting for app: TestCacheGet to get deployed
2021/12/23 19:19:32 Waiting for app: TestCacheGet to get deployed
2021/12/23 19:19:32 App: TestCacheGet got deployed
2021/12/23 19:19:32 Starting bucket ops to source bucket
2021/12/23 19:19:37 Waiting for dst bucket item count to get to: 20 curr count: 0
2021/12/23 19:19:42 Waiting for dst bucket item count to get to: 20 curr count: 0
2021/12/23 19:19:47 Waiting for dst bucket item count to get to: 20 curr count: 3
2021/12/23 19:19:52 Waiting for dst bucket item count to get to: 20 curr count: 3
2021/12/23 19:19:57 Waiting for dst bucket item count to get to: 20 curr count: 17
2021/12/23 19:20:02 Waiting for dst bucket item count to get to: 20 curr count: 17
2021/12/23 19:20:02 src & dst bucket item count matched up. src bucket count: 20 dst bucket count: 20
2021/12/23 19:20:02 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:20:07 Waiting for app: TestCacheGet to get un-deployed
2021/12/23 19:20:13 Waiting for app: TestCacheGet to get un-deployed
2021/12/23 19:20:18 Waiting for app: TestCacheGet to get un-deployed
2021/12/23 19:20:23 Waiting for app: TestCacheGet to get un-deployed
2021/12/23 19:20:23 App: TestCacheGet got un-deployed
2021/12/23 19:20:23 No eventing-con process running
2021/12/23 19:20:23 Function: TestCacheGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheGet deleting in background"
}
2021/12/23 19:20:24 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:20:34 Waiting for dst bucket item count to get to: 0 curr count: 20
2021/12/23 19:20:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:20:36 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:20:46 Waiting for dst bucket item count to get to: 0 curr count: 20
2021/12/23 19:20:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheGet (95.44s)
=== RUN   TestCacheRYOW
2021/12/23 19:20:46 Deploying app: TestCacheRYOW. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:20:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheRYOW stored in temp store"
}
2021/12/23 19:20:52 Waiting for app: TestCacheRYOW to get deployed
2021/12/23 19:20:57 Waiting for app: TestCacheRYOW to get deployed
2021/12/23 19:21:02 Waiting for app: TestCacheRYOW to get deployed
2021/12/23 19:21:07 Waiting for app: TestCacheRYOW to get deployed
2021/12/23 19:21:07 App: TestCacheRYOW got deployed
2021/12/23 19:21:07 Starting bucket ops to source bucket
2021/12/23 19:21:13 Waiting for dst bucket item count to get to: 50 curr count: 0
2021/12/23 19:21:18 Waiting for dst bucket item count to get to: 50 curr count: 25
2021/12/23 19:21:23 Waiting for dst bucket item count to get to: 50 curr count: 25
2021/12/23 19:21:23 src & dst bucket item count matched up. src bucket count: 50 dst bucket count: 50
2021/12/23 19:21:23 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:21:28 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/23 19:21:33 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/23 19:21:38 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/23 19:21:43 Waiting for app: TestCacheRYOW to get un-deployed
2021/12/23 19:21:43 App: TestCacheRYOW got un-deployed
2021/12/23 19:21:43 No eventing-con process running
2021/12/23 19:21:43 Function: TestCacheRYOW delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheRYOW deleting in background"
}
2021/12/23 19:21:45 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:21:55 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 19:21:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:21:56 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:22:06 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 19:22:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheRYOW (80.30s)
=== RUN   TestCacheExpiry
2021/12/23 19:22:06 Deploying app: TestCacheExpiry. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:22:08 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiry stored in temp store"
}
2021/12/23 19:22:13 Waiting for app: TestCacheExpiry to get deployed
2021/12/23 19:22:18 Waiting for app: TestCacheExpiry to get deployed
2021/12/23 19:22:23 Waiting for app: TestCacheExpiry to get deployed
2021/12/23 19:22:28 Waiting for app: TestCacheExpiry to get deployed
2021/12/23 19:22:28 App: TestCacheExpiry got deployed
2021/12/23 19:22:28 Starting bucket ops to source bucket
2021/12/23 19:22:33 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/23 19:22:38 Waiting for dst bucket item count to get to: 100 curr count: 3
2021/12/23 19:22:43 Waiting for dst bucket item count to get to: 100 curr count: 3
2021/12/23 19:22:48 Waiting for dst bucket item count to get to: 100 curr count: 86
2021/12/23 19:22:53 Waiting for dst bucket item count to get to: 100 curr count: 86
2021/12/23 19:22:53 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/23 19:22:53 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:22:58 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/23 19:23:03 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/23 19:23:08 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/23 19:23:13 Waiting for app: TestCacheExpiry to get un-deployed
2021/12/23 19:23:13 App: TestCacheExpiry got un-deployed
2021/12/23 19:23:13 No eventing-con process running
2021/12/23 19:23:13 Function: TestCacheExpiry delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiry deleting in background"
}
2021/12/23 19:23:15 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:23:25 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 19:23:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:23:27 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:23:37 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:23:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheExpiry (90.26s)
=== RUN   TestCacheExpiryCustom
2021/12/23 19:23:37 Deploying app: TestCacheExpiryCustom. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:23:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiryCustom stored in temp store"
}
2021/12/23 19:23:43 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/23 19:23:48 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/23 19:23:53 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/23 19:23:58 Waiting for app: TestCacheExpiryCustom to get deployed
2021/12/23 19:23:58 App: TestCacheExpiryCustom got deployed
2021/12/23 19:23:58 Starting bucket ops to source bucket
2021/12/23 19:24:03 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/23 19:24:08 Waiting for dst bucket item count to get to: 100 curr count: 3
2021/12/23 19:24:13 Waiting for dst bucket item count to get to: 100 curr count: 3
2021/12/23 19:24:18 Waiting for dst bucket item count to get to: 100 curr count: 86
2021/12/23 19:24:23 Waiting for dst bucket item count to get to: 100 curr count: 97
2021/12/23 19:24:23 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/23 19:24:23 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:24:28 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/23 19:24:34 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/23 19:24:39 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/23 19:24:44 Waiting for app: TestCacheExpiryCustom to get un-deployed
2021/12/23 19:24:44 App: TestCacheExpiryCustom got un-deployed
2021/12/23 19:24:44 No eventing-con process running
2021/12/23 19:24:44 Function: TestCacheExpiryCustom delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiryCustom deleting in background"
}
2021/12/23 19:24:45 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:24:55 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 19:24:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:24:57 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:25:07 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:25:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheExpiryCustom (90.47s)
=== RUN   TestCacheOverflowCustom
2021/12/23 19:25:07 Deploying app: TestCacheOverflowCustom. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:25:09 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheOverflowCustom stored in temp store"
}
2021/12/23 19:25:14 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/23 19:25:19 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/23 19:25:24 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/23 19:25:29 Waiting for app: TestCacheOverflowCustom to get deployed
2021/12/23 19:25:29 App: TestCacheOverflowCustom got deployed
2021/12/23 19:25:29 Starting bucket ops to source bucket
2021/12/23 19:25:34 Waiting for dst bucket item count to get to: 35 curr count: 0
2021/12/23 19:25:39 Waiting for dst bucket item count to get to: 35 curr count: 1
2021/12/23 19:25:44 Waiting for dst bucket item count to get to: 35 curr count: 10
2021/12/23 19:25:49 Waiting for dst bucket item count to get to: 35 curr count: 22
2021/12/23 19:25:54 Waiting for dst bucket item count to get to: 35 curr count: 30
2021/12/23 19:25:59 Waiting for dst bucket item count to get to: 35 curr count: 34
2021/12/23 19:26:04 Waiting for dst bucket item count to get to: 35 curr count: 34
2021/12/23 19:26:04 src & dst bucket item count matched up. src bucket count: 35 dst bucket count: 35
2021/12/23 19:26:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:26:09 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/23 19:26:14 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/23 19:26:19 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/23 19:26:24 Waiting for app: TestCacheOverflowCustom to get un-deployed
2021/12/23 19:26:24 App: TestCacheOverflowCustom got un-deployed
2021/12/23 19:26:24 No eventing-con process running
2021/12/23 19:26:24 Function: TestCacheOverflowCustom delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheOverflowCustom deleting in background"
}
2021/12/23 19:26:26 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:26:36 Waiting for dst bucket item count to get to: 0 curr count: 5
2021/12/23 19:26:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:26:38 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:26:48 Waiting for dst bucket item count to get to: 0 curr count: 18
2021/12/23 19:26:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheOverflowCustom (100.40s)
=== RUN   TestStrictMode
2021/12/23 19:26:48 Deploying app: TestStrictMode. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:26:49 Context: Post to main store, response code: 422 dump: {
 "name": "ERR_HANDLER_COMPILATION",
 "code": 27,
 "description": {
  "area": "handlerCode",
  "column_number": 63,
  "compile_success": false,
  "description": "        destination[meta.id] = 00000000000000000000000000000101;\n                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nSyntaxError: Octal literals are not allowed in strict mode.\n",
  "index": 132,
  "language": "JavaScript",
  "line_number": 4
 }
}
--- PASS: TestStrictMode (1.06s)
=== RUN   TestDataTypes
2021/12/23 19:26:49 Deploying app: TestDataTypes. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:26:50 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDataTypes stored in temp store"
}
2021/12/23 19:26:55 Waiting for app: TestDataTypes to get deployed
2021/12/23 19:27:00 Waiting for app: TestDataTypes to get deployed
2021/12/23 19:27:05 Waiting for app: TestDataTypes to get deployed
2021/12/23 19:27:10 Waiting for app: TestDataTypes to get deployed
2021/12/23 19:27:10 App: TestDataTypes got deployed
2021/12/23 19:27:10 Starting bucket ops to source bucket
2021/12/23 19:27:15 Waiting for dst bucket item count to get to: 18 curr count: 0
2021/12/23 19:27:20 Waiting for dst bucket item count to get to: 18 curr count: 0
2021/12/23 19:27:25 Waiting for dst bucket item count to get to: 18 curr count: 8
2021/12/23 19:27:25 src & dst bucket item count matched up. src bucket count: 18 dst bucket count: 18
2021/12/23 19:27:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:27:30 Waiting for app: TestDataTypes to get un-deployed
2021/12/23 19:27:35 Waiting for app: TestDataTypes to get un-deployed
2021/12/23 19:27:40 Waiting for app: TestDataTypes to get un-deployed
2021/12/23 19:27:45 Waiting for app: TestDataTypes to get un-deployed
2021/12/23 19:27:45 App: TestDataTypes got un-deployed
2021/12/23 19:27:45 No eventing-con process running
2021/12/23 19:27:45 Function: TestDataTypes delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDataTypes deleting in background"
}
2021/12/23 19:27:47 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:27:57 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/23 19:27:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:27:59 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:28:09 Waiting for dst bucket item count to get to: 0 curr count: 18
2021/12/23 19:28:14 Waiting for dst bucket item count to get to: 0 curr count: 8
2021/12/23 19:28:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDataTypes (85.16s)
=== RUN   TestEnoentGet
2021/12/23 19:28:14 Deploying app: TestEnoentGet. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:28:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet stored in temp store"
}
2021/12/23 19:28:20 Waiting for app: TestEnoentGet to get deployed
2021/12/23 19:28:25 Waiting for app: TestEnoentGet to get deployed
2021/12/23 19:28:30 Waiting for app: TestEnoentGet to get deployed
2021/12/23 19:28:35 Waiting for app: TestEnoentGet to get deployed
2021/12/23 19:28:35 App: TestEnoentGet got deployed
2021/12/23 19:28:35 Starting bucket ops to source bucket
2021/12/23 19:28:40 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/23 19:28:45 Waiting for dst bucket item count to get to: 100 curr count: 50
2021/12/23 19:28:45 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/23 19:28:45 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:28:50 Waiting for app: TestEnoentGet to get un-deployed
2021/12/23 19:28:55 Waiting for app: TestEnoentGet to get un-deployed
2021/12/23 19:29:00 Waiting for app: TestEnoentGet to get un-deployed
2021/12/23 19:29:05 Waiting for app: TestEnoentGet to get un-deployed
2021/12/23 19:29:05 App: TestEnoentGet got un-deployed
2021/12/23 19:29:05 No eventing-con process running
2021/12/23 19:29:06 Function: TestEnoentGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet deleting in background"
}
2021/12/23 19:29:07 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:29:17 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:29:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:29:19 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:29:29 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:29:34 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 19:29:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:29:34 Deploying app: TestEnoentGet. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:29:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet stored in temp store"
}
2021/12/23 19:29:40 Waiting for app: TestEnoentGet to get deployed
2021/12/23 19:29:45 Waiting for app: TestEnoentGet to get deployed
2021/12/23 19:29:50 Waiting for app: TestEnoentGet to get deployed
2021/12/23 19:29:55 Waiting for app: TestEnoentGet to get deployed
2021/12/23 19:29:55 App: TestEnoentGet got deployed
2021/12/23 19:29:55 Starting bucket ops to source bucket
2021/12/23 19:30:00 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/23 19:30:00 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/23 19:30:00 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:30:06 Waiting for app: TestEnoentGet to get un-deployed
2021/12/23 19:30:11 Waiting for app: TestEnoentGet to get un-deployed
2021/12/23 19:30:16 Waiting for app: TestEnoentGet to get un-deployed
2021/12/23 19:30:21 Waiting for app: TestEnoentGet to get un-deployed
2021/12/23 19:30:21 App: TestEnoentGet got un-deployed
2021/12/23 19:30:21 No eventing-con process running
2021/12/23 19:30:21 Function: TestEnoentGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet deleting in background"
}
2021/12/23 19:30:22 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:30:32 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:30:37 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 19:30:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:30:39 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:30:49 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:30:54 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 19:30:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentGet (160.46s)
=== RUN   TestEnoentDelete
2021/12/23 19:30:54 Deploying app: TestEnoentDelete. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:30:55 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete stored in temp store"
}
2021/12/23 19:31:00 Waiting for app: TestEnoentDelete to get deployed
2021/12/23 19:31:05 Waiting for app: TestEnoentDelete to get deployed
2021/12/23 19:31:11 Waiting for app: TestEnoentDelete to get deployed
2021/12/23 19:31:16 Waiting for app: TestEnoentDelete to get deployed
2021/12/23 19:31:16 App: TestEnoentDelete got deployed
2021/12/23 19:31:16 Starting bucket ops to source bucket
2021/12/23 19:31:21 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/23 19:31:21 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/23 19:31:21 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:31:26 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/23 19:31:31 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/23 19:31:36 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/23 19:31:36 App: TestEnoentDelete got un-deployed
2021/12/23 19:31:36 No eventing-con process running
2021/12/23 19:31:36 Function: TestEnoentDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete deleting in background"
}
2021/12/23 19:31:38 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:31:48 Waiting for dst bucket item count to get to: 0 curr count: 55
2021/12/23 19:31:53 Waiting for dst bucket item count to get to: 0 curr count: 5
2021/12/23 19:31:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:31:55 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:32:05 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:32:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:32:05 Deploying app: TestEnoentDelete. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:32:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete stored in temp store"
}
2021/12/23 19:32:11 Waiting for app: TestEnoentDelete to get deployed
2021/12/23 19:32:16 Waiting for app: TestEnoentDelete to get deployed
2021/12/23 19:32:21 Waiting for app: TestEnoentDelete to get deployed
2021/12/23 19:32:26 Waiting for app: TestEnoentDelete to get deployed
2021/12/23 19:32:26 App: TestEnoentDelete got deployed
2021/12/23 19:32:26 Starting bucket ops to source bucket
2021/12/23 19:32:31 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/23 19:32:31 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/23 19:32:31 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:32:36 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/23 19:32:41 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/23 19:32:46 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/23 19:32:51 Waiting for app: TestEnoentDelete to get un-deployed
2021/12/23 19:32:51 App: TestEnoentDelete got un-deployed
2021/12/23 19:32:51 No eventing-con process running
2021/12/23 19:32:51 Function: TestEnoentDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete deleting in background"
}
2021/12/23 19:32:53 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:33:03 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:33:08 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 19:33:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:33:10 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:33:20 Waiting for dst bucket item count to get to: 0 curr count: 55
2021/12/23 19:33:25 Waiting for dst bucket item count to get to: 0 curr count: 55
2021/12/23 19:33:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentDelete (150.59s)
=== RUN   TestError
2021/12/23 19:33:35 Waiting for app: TestError to get un-deployed
2021/12/23 19:33:35 App: TestError got un-deployed
2021/12/23 19:33:35 No eventing-con process running
2021/12/23 19:33:35 Function: TestError delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestError not found"
}
2021/12/23 19:33:37 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:33:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:33:43 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:33:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:33:48 Deploying app: TestError. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:33:50 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestError stored in temp store"
}
2021/12/23 19:33:55 Waiting for app: TestError to get deployed
2021/12/23 19:34:00 Waiting for app: TestError to get deployed
2021/12/23 19:34:05 Waiting for app: TestError to get deployed
2021/12/23 19:34:10 Waiting for app: TestError to get deployed
2021/12/23 19:34:10 App: TestError got deployed
2021/12/23 19:34:10 Starting bucket ops to source bucket
2021/12/23 19:34:15 Waiting for dst bucket item count to get to: 300 curr count: 0
2021/12/23 19:34:20 Waiting for dst bucket item count to get to: 300 curr count: 0
2021/12/23 19:34:25 Waiting for dst bucket item count to get to: 300 curr count: 156
2021/12/23 19:34:25 src & dst bucket item count matched up. src bucket count: 300 dst bucket count: 300
2021/12/23 19:34:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:34:30 Waiting for app: TestError to get un-deployed
2021/12/23 19:34:35 Waiting for app: TestError to get un-deployed
2021/12/23 19:34:40 Waiting for app: TestError to get un-deployed
2021/12/23 19:34:45 Waiting for app: TestError to get un-deployed
2021/12/23 19:34:45 App: TestError got un-deployed
2021/12/23 19:34:45 No eventing-con process running
2021/12/23 19:34:45 Function: TestError delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestError deleting in background"
}
2021/12/23 19:34:47 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:34:57 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:34:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:34:59 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:35:09 Waiting for dst bucket item count to get to: 0 curr count: 272
2021/12/23 19:35:14 Waiting for dst bucket item count to get to: 0 curr count: 128
2021/12/23 19:35:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestError (108.87s)
=== RUN   TestCRLF
2021/12/23 19:35:24 Waiting for app: TestCRLF to get un-deployed
2021/12/23 19:35:24 App: TestCRLF got un-deployed
2021/12/23 19:35:24 No eventing-con process running
2021/12/23 19:35:24 Function: TestCRLF delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCRLF not found"
}
2021/12/23 19:35:26 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:35:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:35:32 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:35:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:35:37 Deploying app: TestCRLF. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:35:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCRLF stored in temp store"
}
2021/12/23 19:35:43 Waiting for app: TestCRLF to get deployed
2021/12/23 19:35:48 Waiting for app: TestCRLF to get deployed
2021/12/23 19:35:54 Waiting for app: TestCRLF to get deployed
2021/12/23 19:35:59 Waiting for app: TestCRLF to get deployed
2021/12/23 19:35:59 App: TestCRLF got deployed
2021/12/23 19:35:59 Starting bucket ops to source bucket
2021/12/23 19:36:04 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/23 19:36:09 Waiting for dst bucket item count to get to: 100 curr count: 53
2021/12/23 19:36:09 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/23 19:36:09 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:36:14 Waiting for app: TestCRLF to get un-deployed
2021/12/23 19:36:19 Waiting for app: TestCRLF to get un-deployed
2021/12/23 19:36:24 Waiting for app: TestCRLF to get un-deployed
2021/12/23 19:36:29 Waiting for app: TestCRLF to get un-deployed
2021/12/23 19:36:29 App: TestCRLF got un-deployed
2021/12/23 19:36:29 No eventing-con process running
2021/12/23 19:36:29 Function: TestCRLF delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCRLF deleting in background"
}
2021/12/23 19:36:31 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:36:41 Waiting for dst bucket item count to get to: 0 curr count: 93
2021/12/23 19:36:46 Waiting for dst bucket item count to get to: 0 curr count: 93
2021/12/23 19:36:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:36:48 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:36:58 Waiting for dst bucket item count to get to: 0 curr count: 53
2021/12/23 19:36:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCRLF (103.85s)
=== RUN   TestImportExport
2021/12/23 19:37:08 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/23 19:37:08 App: TestImportExport_n1ql_insert_on_update got un-deployed
2021/12/23 19:37:08 No eventing-con process running
2021/12/23 19:37:08 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestImportExport_n1ql_insert_on_update not found"
}
2021/12/23 19:37:09 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:37:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:37:16 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:37:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:37:26 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/23 19:37:26 App: TestImportExport_bucket_op_on_update got un-deployed
2021/12/23 19:37:26 No eventing-con process running
2021/12/23 19:37:26 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestImportExport_bucket_op_on_update not found"
}
2021/12/23 19:37:28 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:37:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:37:35 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:37:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:37:40 Deploying app: TestImportExport_n1ql_insert_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:37:41 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update stored in temp store"
}
2021/12/23 19:37:41 Deploying app: TestImportExport_bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:37:42 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update stored in temp store"
}
2021/12/23 19:37:47 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/23 19:37:52 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/23 19:37:57 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/23 19:38:02 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2021/12/23 19:38:02 App: TestImportExport_n1ql_insert_on_update got deployed
2021/12/23 19:38:07 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2021/12/23 19:38:12 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2021/12/23 19:38:17 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2021/12/23 19:38:17 App: TestImportExport_bucket_op_on_update got deployed
2021/12/23 19:38:22 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/23 19:38:28 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/23 19:38:33 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/23 19:38:38 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/23 19:38:38 App: TestImportExport_n1ql_insert_on_update got un-deployed
2021/12/23 19:38:38 No eventing-con process running
2021/12/23 19:38:38 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update deleting in background"
}
2021/12/23 19:38:43 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/23 19:38:48 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/23 19:38:53 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/23 19:38:58 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/23 19:38:58 App: TestImportExport_bucket_op_on_update got un-deployed
2021/12/23 19:38:58 No eventing-con process running
2021/12/23 19:38:58 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update deleting in background"
}
2021/12/23 19:39:15 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2021/12/23 19:39:15 App: TestImportExport_bucket_op_on_update got un-deployed
2021/12/23 19:39:15 No eventing-con process running
2021/12/23 19:39:15 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update deleting in background"
}
2021/12/23 19:39:17 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:39:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:39:24 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:39:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:39:34 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2021/12/23 19:39:34 App: TestImportExport_n1ql_insert_on_update got un-deployed
2021/12/23 19:39:34 No eventing-con process running
2021/12/23 19:39:34 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update deleting in background"
}
2021/12/23 19:39:36 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:39:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:39:42 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:39:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestImportExport (169.81s)
=== RUN   TestDeployUndeployLoopNonDefaultSettings
2021/12/23 19:39:57 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:39:57 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/23 19:39:57 No eventing-con process running
2021/12/23 19:39:57 Function: TestDeployUndeployLoopNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeployUndeployLoopNonDefaultSettings not found"
}
2021/12/23 19:39:59 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:40:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:40:06 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:40:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:40:11 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:40:12 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/23 19:40:12 Starting bucket ops to source bucket
2021/12/23 19:40:20 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:40:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:40:30 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:40:35 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:40:35 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 19:40:40 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/23 19:40:40 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/23 19:40:40 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:40:40 Undeploying app: bucket_op_on_update
2021/12/23 19:40:45 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:40:50 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:40:55 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:41:00 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:41:00 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/23 19:41:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:41:00 No eventing-con process running
2021/12/23 19:41:02 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:41:09 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:41:44 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:41:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/23 19:41:46 Starting bucket ops to source bucket
2021/12/23 19:41:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:41:58 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:42:03 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:42:08 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/23 19:42:13 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/23 19:42:13 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 19:42:18 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/23 19:42:19 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/23 19:42:19 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:42:19 Undeploying app: bucket_op_on_update
2021/12/23 19:42:24 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:42:29 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:42:34 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:42:39 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:42:39 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/23 19:42:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:42:39 No eventing-con process running
2021/12/23 19:42:40 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:42:48 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:43:23 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:43:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/23 19:43:24 Starting bucket ops to source bucket
2021/12/23 19:43:32 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:43:37 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:43:42 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:43:47 Waiting for dst bucket item count to get to: 5000 curr count: 2096
2021/12/23 19:43:52 Waiting for dst bucket item count to get to: 5000 curr count: 4596
2021/12/23 19:43:52 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 19:43:57 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/23 19:43:57 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/23 19:43:57 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:43:57 Undeploying app: bucket_op_on_update
2021/12/23 19:44:02 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:44:07 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:44:12 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:44:17 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:44:17 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/23 19:44:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:44:17 No eventing-con process running
2021/12/23 19:44:19 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:44:26 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:45:01 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:45:02 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/23 19:45:02 Starting bucket ops to source bucket
2021/12/23 19:45:10 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:45:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:45:20 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:45:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:45:25 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 19:45:30 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/23 19:45:30 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/23 19:45:30 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:45:30 Undeploying app: bucket_op_on_update
2021/12/23 19:45:35 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:45:40 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:45:45 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:45:50 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:45:50 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/23 19:45:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:45:50 No eventing-con process running
2021/12/23 19:45:52 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:45:59 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:46:35 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:46:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2021/12/23 19:46:36 Starting bucket ops to source bucket
2021/12/23 19:46:44 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:46:49 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:46:54 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:46:59 Waiting for dst bucket item count to get to: 5000 curr count: 2507
2021/12/23 19:47:04 Waiting for dst bucket item count to get to: 5000 curr count: 2507
2021/12/23 19:47:04 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 19:47:09 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2021/12/23 19:47:09 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2021/12/23 19:47:09 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:47:09 Undeploying app: bucket_op_on_update
2021/12/23 19:47:14 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:47:19 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:47:24 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:47:29 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2021/12/23 19:47:29 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2021/12/23 19:47:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:47:29 No eventing-con process running
2021/12/23 19:47:31 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:47:38 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:48:13 Function: TestDeployUndeployLoopNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings deleting in background"
}
--- PASS: TestDeployUndeployLoopNonDefaultSettings (505.55s)
=== RUN   TestOnUpdateN1QLOp
2021/12/23 19:48:23 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/23 19:48:23 App: TestOnUpdateN1QLOp got un-deployed
2021/12/23 19:48:23 No eventing-con process running
2021/12/23 19:48:23 Function: TestOnUpdateN1QLOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateN1QLOp not found"
}
2021/12/23 19:48:25 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:48:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:48:31 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:48:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:48:37 Deploying app: TestOnUpdateN1QLOp. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:48:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateN1QLOp stored in temp store"
}
2021/12/23 19:48:38 Starting bucket ops to source bucket
2021/12/23 19:48:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:48:51 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:48:56 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:49:01 Waiting for dst bucket item count to get to: 5000 curr count: 65
2021/12/23 19:49:06 Waiting for dst bucket item count to get to: 5000 curr count: 65
2021/12/23 19:49:06 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 19:49:06 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:49:11 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/23 19:49:16 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/23 19:49:21 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/23 19:49:26 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2021/12/23 19:49:26 App: TestOnUpdateN1QLOp got un-deployed
2021/12/23 19:49:26 No eventing-con process running
2021/12/23 19:49:26 Function: TestOnUpdateN1QLOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateN1QLOp deleting in background"
}
2021/12/23 19:49:28 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:49:38 Waiting for dst bucket item count to get to: 0 curr count: 2747
2021/12/23 19:49:43 Waiting for dst bucket item count to get to: 0 curr count: 247
2021/12/23 19:49:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:49:45 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:49:55 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 19:49:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateN1QLOp (101.61s)
=== RUN   TestOnUpdateBucketOpDefaultSettings
2021/12/23 19:50:05 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/23 19:50:05 App: TestOnUpdateBucketOpDefaultSettings got un-deployed
2021/12/23 19:50:05 No eventing-con process running
2021/12/23 19:50:05 Function: TestOnUpdateBucketOpDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings not found"
}
2021/12/23 19:50:06 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:50:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:50:13 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:50:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:50:18 Deploying app: TestOnUpdateBucketOpDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:50:19 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings stored in temp store"
}
2021/12/23 19:50:19 Starting bucket ops to source bucket
2021/12/23 19:50:27 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:50:32 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:50:37 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:50:42 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:50:47 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/23 19:50:47 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 19:50:47 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:50:52 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/23 19:50:57 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/23 19:51:02 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/23 19:51:07 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2021/12/23 19:51:07 App: TestOnUpdateBucketOpDefaultSettings got un-deployed
2021/12/23 19:51:07 No eventing-con process running
2021/12/23 19:51:07 Function: TestOnUpdateBucketOpDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings deleting in background"
}
2021/12/23 19:51:09 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:51:19 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/23 19:51:24 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/23 19:51:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:51:26 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:51:36 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 19:51:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings (101.52s)
=== RUN   TestOnUpdateBucketOpNonDefaultSettings
2021/12/23 19:51:46 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/23 19:51:46 App: TestOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/23 19:51:46 No eventing-con process running
2021/12/23 19:51:46 Function: TestOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpNonDefaultSettings not found"
}
2021/12/23 19:51:48 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:51:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:51:55 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:52:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:52:00 Deploying app: TestOnUpdateBucketOpNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:52:01 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpNonDefaultSettings stored in temp store"
}
2021/12/23 19:52:01 Starting bucket ops to source bucket
2021/12/23 19:52:09 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:52:14 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:52:19 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:52:24 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:52:24 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 19:52:24 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:52:29 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/23 19:52:34 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/23 19:52:39 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/23 19:52:44 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/23 19:52:44 App: TestOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/23 19:52:44 No eventing-con process running
2021/12/23 19:52:44 Function: TestOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpNonDefaultSettings deleting in background"
}
2021/12/23 19:52:46 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:52:56 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 19:52:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:52:58 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:53:08 Waiting for dst bucket item count to get to: 0 curr count: 2600
2021/12/23 19:53:13 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 19:53:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpNonDefaultSettings (96.58s)
=== RUN   TestOnUpdateBucketOpDefaultSettings10K
2021/12/23 19:53:23 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/23 19:53:23 App: TestOnUpdateBucketOpDefaultSettings10K got un-deployed
2021/12/23 19:53:23 No eventing-con process running
2021/12/23 19:53:23 Function: TestOnUpdateBucketOpDefaultSettings10K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings10K not found"
}
2021/12/23 19:53:24 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:53:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:53:31 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:53:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:53:36 Deploying app: TestOnUpdateBucketOpDefaultSettings10K. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:53:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings10K stored in temp store"
}
2021/12/23 19:53:37 Starting bucket ops to source bucket
2021/12/23 19:53:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:53:50 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:53:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:54:00 Waiting for dst bucket item count to get to: 5000 curr count: 921
2021/12/23 19:54:05 Waiting for dst bucket item count to get to: 5000 curr count: 921
2021/12/23 19:54:05 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 19:54:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:54:10 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/23 19:54:15 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/23 19:54:21 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/23 19:54:26 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2021/12/23 19:54:26 App: TestOnUpdateBucketOpDefaultSettings10K got un-deployed
2021/12/23 19:54:26 No eventing-con process running
2021/12/23 19:54:26 Function: TestOnUpdateBucketOpDefaultSettings10K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings10K deleting in background"
}
2021/12/23 19:54:27 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:54:37 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/23 19:54:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:54:39 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:54:49 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 19:54:54 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/23 19:54:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings10K (101.48s)
=== RUN   TestOnUpdateBucketOpDefaultSettings100K
2021/12/23 19:55:04 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/23 19:55:04 App: TestOnUpdateBucketOpDefaultSettings100K got un-deployed
2021/12/23 19:55:04 No eventing-con process running
2021/12/23 19:55:04 Function: TestOnUpdateBucketOpDefaultSettings100K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings100K not found"
}
2021/12/23 19:55:06 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:55:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:55:13 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:55:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:55:18 Deploying app: TestOnUpdateBucketOpDefaultSettings100K. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:55:19 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings100K stored in temp store"
}
2021/12/23 19:55:19 Starting bucket ops to source bucket
2021/12/23 19:55:27 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:55:32 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:55:37 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:55:42 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:55:47 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/23 19:55:47 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 19:55:47 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:55:52 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/23 19:55:57 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/23 19:56:03 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/23 19:56:08 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2021/12/23 19:56:08 App: TestOnUpdateBucketOpDefaultSettings100K got un-deployed
2021/12/23 19:56:08 No eventing-con process running
2021/12/23 19:56:08 Function: TestOnUpdateBucketOpDefaultSettings100K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings100K deleting in background"
}
2021/12/23 19:56:09 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:56:19 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/23 19:56:24 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/23 19:56:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:56:26 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:56:36 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 19:56:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings100K (102.02s)
=== RUN   TestOnDeleteBucketOp
2021/12/23 19:56:46 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/23 19:56:46 App: TestOnDeleteBucketOp got un-deployed
2021/12/23 19:56:46 No eventing-con process running
2021/12/23 19:56:46 Function: TestOnDeleteBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteBucketOp not found"
}
2021/12/23 19:56:48 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:56:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:56:55 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:57:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:57:00 Deploying app: TestOnDeleteBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:57:01 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp stored in temp store"
}
2021/12/23 19:57:01 Starting bucket ops to source bucket
2021/12/23 19:57:12 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:57:17 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:57:22 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:57:22 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 19:57:22 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:57:27 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/23 19:57:32 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/23 19:57:37 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/23 19:57:42 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2021/12/23 19:57:42 App: TestOnDeleteBucketOp got un-deployed
2021/12/23 19:57:42 No eventing-con process running
2021/12/23 19:57:42 Function: TestOnDeleteBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp deleting in background"
}
2021/12/23 19:57:44 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:57:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:57:51 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:58:01 Waiting for dst bucket item count to get to: 0 curr count: 4254
2021/12/23 19:58:06 Waiting for dst bucket item count to get to: 0 curr count: 4254
2021/12/23 19:58:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteBucketOp (89.81s)
=== RUN   TestOnDeleteBucketOp5K
2021/12/23 19:58:16 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/23 19:58:16 App: TestOnDeleteBucketOp5K got un-deployed
2021/12/23 19:58:16 No eventing-con process running
2021/12/23 19:58:16 Function: TestOnDeleteBucketOp5K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteBucketOp5K not found"
}
2021/12/23 19:58:18 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:58:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:58:25 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:58:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:58:30 Deploying app: TestOnDeleteBucketOp5K. Item count src bucket: 0 dst bucket: 0
2021/12/23 19:58:31 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp5K stored in temp store"
}
2021/12/23 19:58:31 Starting bucket ops to source bucket
2021/12/23 19:58:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:58:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:58:51 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 19:58:51 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 19:58:51 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 19:58:57 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/23 19:59:02 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/23 19:59:07 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/23 19:59:12 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2021/12/23 19:59:12 App: TestOnDeleteBucketOp5K got un-deployed
2021/12/23 19:59:12 No eventing-con process running
2021/12/23 19:59:12 Function: TestOnDeleteBucketOp5K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp5K deleting in background"
}
2021/12/23 19:59:13 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:59:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:59:21 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:59:31 Waiting for dst bucket item count to get to: 0 curr count: 4036
2021/12/23 19:59:36 Waiting for dst bucket item count to get to: 0 curr count: 4036
2021/12/23 19:59:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteBucketOp5K (89.79s)
=== RUN   TestTimerBucketOp
2021/12/23 19:59:46 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/23 19:59:46 App: TestTimerBucketOp got un-deployed
2021/12/23 19:59:46 No eventing-con process running
2021/12/23 19:59:46 Function: TestTimerBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerBucketOp not found"
}
2021/12/23 19:59:48 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:59:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:59:54 Context: Bucket flush, response code: 200 dump: 
2021/12/23 19:59:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 19:59:59 Deploying app: TestTimerBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:00:00 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerBucketOp stored in temp store"
}
2021/12/23 20:00:00 Starting bucket ops to source bucket
2021/12/23 20:00:08 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:00:13 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:00:18 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:00:23 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:00:28 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:00:33 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:00:38 Waiting for dst bucket item count to get to: 5000 curr count: 4080
2021/12/23 20:00:44 Waiting for dst bucket item count to get to: 5000 curr count: 4080
2021/12/23 20:00:44 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 20:00:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:00:49 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/23 20:00:54 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/23 20:00:59 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/23 20:01:04 Waiting for app: TestTimerBucketOp to get un-deployed
2021/12/23 20:01:04 App: TestTimerBucketOp got un-deployed
2021/12/23 20:01:04 No eventing-con process running
2021/12/23 20:01:04 Function: TestTimerBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerBucketOp deleting in background"
}
2021/12/23 20:01:06 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:01:16 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 20:01:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:01:17 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:01:27 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/23 20:01:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerBucketOp (111.62s)
=== RUN   TestTimerInPastBucketOp
2021/12/23 20:01:37 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/23 20:01:37 App: TestTimerInPastBucketOp got un-deployed
2021/12/23 20:01:37 No eventing-con process running
2021/12/23 20:01:37 Function: TestTimerInPastBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerInPastBucketOp not found"
}
2021/12/23 20:01:39 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:01:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:01:46 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:01:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:01:51 Deploying app: TestTimerInPastBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:01:52 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerInPastBucketOp stored in temp store"
}
2021/12/23 20:01:52 Starting bucket ops to source bucket
2021/12/23 20:02:00 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:02:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:02:10 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:02:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:02:20 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:02:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:02:30 Waiting for dst bucket item count to get to: 5000 curr count: 1980
2021/12/23 20:02:35 Waiting for dst bucket item count to get to: 5000 curr count: 1980
2021/12/23 20:02:35 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 20:02:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:02:40 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/23 20:02:45 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/23 20:02:50 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/23 20:02:55 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2021/12/23 20:02:55 App: TestTimerInPastBucketOp got un-deployed
2021/12/23 20:02:55 No eventing-con process running
2021/12/23 20:02:55 Function: TestTimerInPastBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerInPastBucketOp deleting in background"
}
2021/12/23 20:02:57 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:03:07 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 20:03:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:03:09 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:03:19 Waiting for dst bucket item count to get to: 0 curr count: 4954
2021/12/23 20:03:24 Waiting for dst bucket item count to get to: 0 curr count: 2454
2021/12/23 20:03:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerInPastBucketOp (116.48s)
=== RUN   TestDeployUndeployLoopTimer
2021/12/23 20:03:34 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:03:34 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/23 20:03:34 No eventing-con process running
2021/12/23 20:03:34 Function: TestDeployUndeployLoopTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeployUndeployLoopTimer not found"
}
2021/12/23 20:03:36 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:03:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:03:42 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:03:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:03:47 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:03:49 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/23 20:03:49 Starting bucket ops to source bucket
2021/12/23 20:03:56 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:04:01 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:04:06 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:04:11 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:04:16 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:04:21 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:04:27 Waiting for dst bucket item count to get to: 5000 curr count: 2205
2021/12/23 20:04:32 Waiting for dst bucket item count to get to: 5000 curr count: 4705
2021/12/23 20:04:32 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 20:04:37 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/23 20:04:37 App: TestDeployUndeployLoopTimer got deployed
2021/12/23 20:04:37 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:04:37 Undeploying app: bucket_op_with_timer
2021/12/23 20:04:42 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:04:47 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:04:52 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:04:57 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:04:57 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/23 20:04:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:04:57 No eventing-con process running
2021/12/23 20:04:59 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:05:06 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:05:41 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:05:42 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/23 20:05:42 Starting bucket ops to source bucket
2021/12/23 20:05:50 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:05:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:06:00 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:06:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:06:10 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:06:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:06:20 Waiting for dst bucket item count to get to: 5000 curr count: 917
2021/12/23 20:06:25 Waiting for dst bucket item count to get to: 5000 curr count: 917
2021/12/23 20:06:25 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 20:06:30 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/23 20:06:30 App: TestDeployUndeployLoopTimer got deployed
2021/12/23 20:06:30 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:06:30 Undeploying app: bucket_op_with_timer
2021/12/23 20:06:35 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:06:40 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:06:45 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:06:50 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:06:50 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/23 20:06:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:06:50 No eventing-con process running
2021/12/23 20:06:52 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:06:59 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:07:34 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:07:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/23 20:07:36 Starting bucket ops to source bucket
2021/12/23 20:07:44 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:07:49 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:07:54 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:07:59 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:08:04 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:08:09 Waiting for dst bucket item count to get to: 5000 curr count: 2796
2021/12/23 20:08:14 Waiting for dst bucket item count to get to: 5000 curr count: 2796
2021/12/23 20:08:14 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 20:08:19 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/23 20:08:19 App: TestDeployUndeployLoopTimer got deployed
2021/12/23 20:08:19 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:08:19 Undeploying app: bucket_op_with_timer
2021/12/23 20:08:24 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:08:29 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:08:34 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:08:39 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:08:39 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/23 20:08:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:08:39 No eventing-con process running
2021/12/23 20:08:40 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:08:48 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:09:23 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:09:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/23 20:09:24 Starting bucket ops to source bucket
2021/12/23 20:09:32 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:09:37 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:09:42 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:09:47 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:09:52 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:09:57 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:10:02 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:10:07 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/23 20:10:07 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 20:10:12 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/23 20:10:12 App: TestDeployUndeployLoopTimer got deployed
2021/12/23 20:10:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:10:12 Undeploying app: bucket_op_with_timer
2021/12/23 20:10:17 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:10:22 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:10:27 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:10:32 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:10:32 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/23 20:10:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:10:32 No eventing-con process running
2021/12/23 20:10:34 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:10:41 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:11:16 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:11:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2021/12/23 20:11:17 Starting bucket ops to source bucket
2021/12/23 20:11:25 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:11:30 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:11:35 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:11:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:11:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:11:50 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:11:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:11:55 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 20:12:00 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2021/12/23 20:12:00 App: TestDeployUndeployLoopTimer got deployed
2021/12/23 20:12:00 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:12:00 Undeploying app: bucket_op_with_timer
2021/12/23 20:12:05 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:12:10 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:12:15 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:12:20 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2021/12/23 20:12:20 App: TestDeployUndeployLoopTimer got un-deployed
2021/12/23 20:12:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:12:20 No eventing-con process running
2021/12/23 20:12:22 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:12:29 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:13:05 Function: TestDeployUndeployLoopTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer deleting in background"
}
--- PASS: TestDeployUndeployLoopTimer (580.64s)
=== RUN   TestMultipleHandlers
2021/12/23 20:13:15 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/23 20:13:15 App: TestMultipleHandlers_bucket_op_on_update got un-deployed
2021/12/23 20:13:15 No eventing-con process running
2021/12/23 20:13:15 Function: TestMultipleHandlers_bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMultipleHandlers_bucket_op_on_update not found"
}
2021/12/23 20:13:16 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:13:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:13:23 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:13:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:13:33 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/23 20:13:33 App: TestMultipleHandlers_bucket_op_on_delete got un-deployed
2021/12/23 20:13:33 No eventing-con process running
2021/12/23 20:13:33 Function: TestMultipleHandlers_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMultipleHandlers_bucket_op_on_delete not found"
}
2021/12/23 20:13:35 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:13:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:13:42 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:13:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:13:47 Deploying app: TestMultipleHandlers_bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:13:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_update stored in temp store"
}
2021/12/23 20:13:48 Deploying app: TestMultipleHandlers_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:13:49 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_delete stored in temp store"
}
2021/12/23 20:13:54 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/23 20:13:59 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/23 20:14:04 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/23 20:14:09 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2021/12/23 20:14:09 App: TestMultipleHandlers_bucket_op_on_update got deployed
2021/12/23 20:14:14 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2021/12/23 20:14:19 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2021/12/23 20:14:24 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2021/12/23 20:14:24 App: TestMultipleHandlers_bucket_op_on_delete got deployed
2021/12/23 20:14:24 Starting bucket ops to source bucket
2021/12/23 20:14:34 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:14:39 Waiting for dst bucket item count to get to: 5000 curr count: 4043
2021/12/23 20:14:39 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 20:14:39 Starting bucket ops to source bucket
2021/12/23 20:14:54 Waiting for dst bucket item count to get to: 10000 curr count: 6726
2021/12/23 20:14:59 Waiting for dst bucket item count to get to: 10000 curr count: 9222
2021/12/23 20:14:59 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/23 20:14:59 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:14:59 Function: TestMultipleHandlers_bucket_op_on_update update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:14:59 Function: TestMultipleHandlers_bucket_op_on_delete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:15:04 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/23 20:15:09 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/23 20:15:14 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/23 20:15:19 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2021/12/23 20:15:19 App: TestMultipleHandlers_bucket_op_on_update got un-deployed
2021/12/23 20:15:19 No eventing-con process running
2021/12/23 20:15:19 Function: TestMultipleHandlers_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_update deleting in background"
}
2021/12/23 20:15:21 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:15:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:15:28 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:15:38 Waiting for dst bucket item count to get to: 0 curr count: 7313
2021/12/23 20:15:43 Waiting for dst bucket item count to get to: 0 curr count: 2317
2021/12/23 20:15:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:15:48 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/23 20:15:54 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/23 20:15:59 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/23 20:16:04 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2021/12/23 20:16:04 App: TestMultipleHandlers_bucket_op_on_delete got un-deployed
2021/12/23 20:16:04 No eventing-con process running
2021/12/23 20:16:04 Function: TestMultipleHandlers_bucket_op_on_delete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_delete deleting in background"
}
2021/12/23 20:16:05 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:16:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:16:12 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:16:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMultipleHandlers (192.59s)
=== RUN   TestPauseResumeLoopDefaultSettings
2021/12/23 20:16:27 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/23 20:16:27 App: TestPauseResumeLoopDefaultSettings got un-deployed
2021/12/23 20:16:27 No eventing-con process running
2021/12/23 20:16:27 Function: TestPauseResumeLoopDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeLoopDefaultSettings not found"
}
2021/12/23 20:16:29 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:16:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:16:36 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:16:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:16:41 Deploying app: TestPauseResumeLoopDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:16:42 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopDefaultSettings stored in temp store"
}
2021/12/23 20:16:42 Starting bucket ops to source bucket
2021/12/23 20:16:50 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:16:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:17:00 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:17:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:17:05 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 20:17:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:17:10 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/23 20:17:10 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/23 20:17:10 Pausing app: bucket_op_on_update
2021/12/23 20:17:10 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:17:15 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/23 20:17:15 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/23 20:17:15 Resuming app: bucket_op_on_update
2021/12/23 20:17:16 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:17:16 Starting bucket ops to source bucket
2021/12/23 20:17:24 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/23 20:17:29 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/23 20:17:34 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/23 20:17:34 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/23 20:17:34 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:17:39 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/23 20:17:39 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/23 20:17:39 Pausing app: bucket_op_on_update
2021/12/23 20:17:39 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:17:44 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/23 20:17:44 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/23 20:17:44 Resuming app: bucket_op_on_update
2021/12/23 20:17:45 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:17:45 Starting bucket ops to source bucket
2021/12/23 20:17:53 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/23 20:17:58 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/23 20:18:03 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/23 20:18:03 src & dst bucket item count matched up. src bucket count: 15000 dst bucket count: 15000
2021/12/23 20:18:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:18:08 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/23 20:18:08 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/23 20:18:08 Pausing app: bucket_op_on_update
2021/12/23 20:18:09 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:18:14 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/23 20:18:14 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/23 20:18:14 Resuming app: bucket_op_on_update
2021/12/23 20:18:15 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:18:15 Starting bucket ops to source bucket
2021/12/23 20:18:23 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/23 20:18:28 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/23 20:18:33 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/23 20:18:33 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2021/12/23 20:18:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:18:38 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/23 20:18:38 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/23 20:18:38 Pausing app: bucket_op_on_update
2021/12/23 20:18:38 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:18:43 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/23 20:18:43 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/23 20:18:43 Resuming app: bucket_op_on_update
2021/12/23 20:18:44 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:18:44 Starting bucket ops to source bucket
2021/12/23 20:18:52 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/23 20:18:57 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/23 20:19:02 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/23 20:19:07 Waiting for dst bucket item count to get to: 25000 curr count: 22500
2021/12/23 20:19:07 src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2021/12/23 20:19:07 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:19:12 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2021/12/23 20:19:12 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2021/12/23 20:19:12 Pausing app: bucket_op_on_update
2021/12/23 20:19:12 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:19:17 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2021/12/23 20:19:17 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2021/12/23 20:19:22 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/23 20:19:27 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/23 20:19:32 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/23 20:19:37 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2021/12/23 20:19:37 App: TestPauseResumeLoopDefaultSettings got un-deployed
2021/12/23 20:19:37 No eventing-con process running
2021/12/23 20:19:37 Function: TestPauseResumeLoopDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopDefaultSettings deleting in background"
}
2021/12/23 20:19:39 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:19:49 Waiting for dst bucket item count to get to: 0 curr count: 25000
2021/12/23 20:19:54 Waiting for dst bucket item count to get to: 0 curr count: 12500
2021/12/23 20:19:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:19:56 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:20:06 Waiting for dst bucket item count to get to: 0 curr count: 25000
2021/12/23 20:20:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeLoopDefaultSettings (228.78s)
=== RUN   TestPauseResumeLoopNonDefaultSettings
2021/12/23 20:20:16 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/23 20:20:16 App: TestPauseResumeLoopNonDefaultSettings got un-deployed
2021/12/23 20:20:16 No eventing-con process running
2021/12/23 20:20:16 Function: TestPauseResumeLoopNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeLoopNonDefaultSettings not found"
}
2021/12/23 20:20:18 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:20:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:20:24 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:20:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:20:29 Deploying app: TestPauseResumeLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:20:31 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopNonDefaultSettings stored in temp store"
}
2021/12/23 20:20:31 Starting bucket ops to source bucket
2021/12/23 20:20:38 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:20:43 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:20:48 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:20:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:20:59 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:21:04 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:21:09 Waiting for dst bucket item count to get to: 5000 curr count: 2966
2021/12/23 20:21:14 Waiting for dst bucket item count to get to: 5000 curr count: 2966
2021/12/23 20:21:14 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 20:21:14 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:21:19 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/23 20:21:19 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/23 20:21:19 Pausing app: bucket_op_with_timer
2021/12/23 20:21:19 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:21:24 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/23 20:21:24 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/23 20:21:24 Resuming app: bucket_op_with_timer
2021/12/23 20:21:25 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:21:25 Starting bucket ops to source bucket
2021/12/23 20:21:33 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/23 20:21:38 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/23 20:21:43 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/23 20:21:48 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/23 20:21:53 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/23 20:21:58 Waiting for dst bucket item count to get to: 10000 curr count: 9035
2021/12/23 20:22:03 Waiting for dst bucket item count to get to: 10000 curr count: 9035
2021/12/23 20:22:03 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/23 20:22:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:22:08 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/23 20:22:08 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/23 20:22:08 Pausing app: bucket_op_with_timer
2021/12/23 20:22:08 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:22:13 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/23 20:22:13 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/23 20:22:13 Resuming app: bucket_op_with_timer
2021/12/23 20:22:14 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:22:14 Starting bucket ops to source bucket
2021/12/23 20:22:22 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/23 20:22:27 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/23 20:22:32 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/23 20:22:37 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/23 20:22:42 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2021/12/23 20:22:47 Waiting for dst bucket item count to get to: 15000 curr count: 14833
2021/12/23 20:22:52 Waiting for dst bucket item count to get to: 15000 curr count: 14833
2021/12/23 20:22:52 src & dst bucket item count matched up. src bucket count: 15000 dst bucket count: 15000
2021/12/23 20:22:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:22:57 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/23 20:22:57 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/23 20:22:57 Pausing app: bucket_op_with_timer
2021/12/23 20:22:57 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:23:02 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/23 20:23:02 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/23 20:23:02 Resuming app: bucket_op_with_timer
2021/12/23 20:23:04 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:23:04 Starting bucket ops to source bucket
2021/12/23 20:23:12 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/23 20:23:17 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/23 20:23:22 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/23 20:23:27 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/23 20:23:32 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/23 20:23:37 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2021/12/23 20:23:42 Waiting for dst bucket item count to get to: 20000 curr count: 19980
2021/12/23 20:23:47 Waiting for dst bucket item count to get to: 20000 curr count: 19980
2021/12/23 20:23:47 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2021/12/23 20:23:47 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:23:52 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/23 20:23:52 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/23 20:23:52 Pausing app: bucket_op_with_timer
2021/12/23 20:23:52 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:23:57 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/23 20:23:57 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/23 20:23:57 Resuming app: bucket_op_with_timer
2021/12/23 20:23:58 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:23:58 Starting bucket ops to source bucket
2021/12/23 20:24:06 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/23 20:24:11 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/23 20:24:16 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/23 20:24:21 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/23 20:24:26 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2021/12/23 20:24:31 Waiting for dst bucket item count to get to: 25000 curr count: 20187
2021/12/23 20:24:36 Waiting for dst bucket item count to get to: 25000 curr count: 22687
2021/12/23 20:24:36 src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2021/12/23 20:24:36 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:24:41 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2021/12/23 20:24:41 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2021/12/23 20:24:41 Pausing app: bucket_op_with_timer
2021/12/23 20:24:41 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:24:46 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2021/12/23 20:24:46 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2021/12/23 20:24:51 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/23 20:24:56 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/23 20:25:01 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/23 20:25:06 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2021/12/23 20:25:06 App: TestPauseResumeLoopNonDefaultSettings got un-deployed
2021/12/23 20:25:06 No eventing-con process running
2021/12/23 20:25:06 Function: TestPauseResumeLoopNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopNonDefaultSettings deleting in background"
}
2021/12/23 20:25:08 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:25:18 Waiting for dst bucket item count to get to: 0 curr count: 16429
2021/12/23 20:25:23 Waiting for dst bucket item count to get to: 0 curr count: 3929
2021/12/23 20:25:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:25:25 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:25:35 Waiting for dst bucket item count to get to: 0 curr count: 25000
2021/12/23 20:25:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeLoopNonDefaultSettings (328.87s)
=== RUN   TestPauseAndResumeWithWorkerCountChange
2021/12/23 20:25:45 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/23 20:25:45 App: TestPauseAndResumeWithWorkerCountChange got un-deployed
2021/12/23 20:25:45 No eventing-con process running
2021/12/23 20:25:45 Function: TestPauseAndResumeWithWorkerCountChange delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseAndResumeWithWorkerCountChange not found"
}
2021/12/23 20:25:47 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:25:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:25:53 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:25:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:25:58 Deploying app: TestPauseAndResumeWithWorkerCountChange. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:25:59 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseAndResumeWithWorkerCountChange stored in temp store"
}
2021/12/23 20:26:04 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/23 20:26:09 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/23 20:26:15 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/23 20:26:20 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2021/12/23 20:26:20 App: TestPauseAndResumeWithWorkerCountChange got deployed
2021/12/23 20:26:20 Starting bucket ops to source bucket
2021/12/23 20:26:29 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:26:34 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:26:39 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:26:44 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:26:49 Waiting for dst bucket item count to get to: 5000 curr count: 1134
2021/12/23 20:26:54 Waiting for dst bucket item count to get to: 5000 curr count: 2270
2021/12/23 20:26:59 Waiting for dst bucket item count to get to: 5000 curr count: 3636
2021/12/23 20:26:59 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 20:26:59 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:26:59 Pausing app: bucket_op_with_timer
2021/12/23 20:26:59 Function: TestPauseAndResumeWithWorkerCountChange update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:27:04 Waiting for function: TestPauseAndResumeWithWorkerCountChange status to change to paused
2021/12/23 20:27:04 Function: TestPauseAndResumeWithWorkerCountChange status changed to paused
2021/12/23 20:27:04 Resuming app: bucket_op_with_timer
2021/12/23 20:27:05 Function: TestPauseAndResumeWithWorkerCountChange update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:6] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:27:05 Starting bucket ops to source bucket
2021/12/23 20:27:17 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/23 20:27:22 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/23 20:27:27 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/23 20:27:32 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/23 20:27:37 Waiting for dst bucket item count to get to: 10000 curr count: 7073
2021/12/23 20:27:42 Waiting for dst bucket item count to get to: 10000 curr count: 7073
2021/12/23 20:27:42 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/23 20:27:47 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/23 20:27:52 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/23 20:27:57 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/23 20:28:02 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2021/12/23 20:28:02 App: TestPauseAndResumeWithWorkerCountChange got un-deployed
2021/12/23 20:28:02 No eventing-con process running
2021/12/23 20:28:02 Function: TestPauseAndResumeWithWorkerCountChange delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseAndResumeWithWorkerCountChange deleting in background"
}
2021/12/23 20:28:04 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:28:14 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/23 20:28:19 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 20:28:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:28:21 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:28:31 Waiting for dst bucket item count to get to: 0 curr count: 8736
2021/12/23 20:28:36 Waiting for dst bucket item count to get to: 0 curr count: 8736
2021/12/23 20:28:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseAndResumeWithWorkerCountChange (180.93s)
=== RUN   TestPauseResumeWithEventingReb
2021/12/23 20:28:46 Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/23 20:28:46 App: TestPauseResumeWithEventingReb got un-deployed
2021/12/23 20:28:46 No eventing-con process running
2021/12/23 20:28:46 Function: TestPauseResumeWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeWithEventingReb not found"
}
2021/12/23 20:28:48 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:28:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:28:54 Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:28:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:28:59 Deploying app: TestPauseResumeWithEventingReb. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:29:00 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeWithEventingReb stored in temp store"
}
2021/12/23 20:29:05 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/23 20:29:10 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/23 20:29:15 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/23 20:29:21 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2021/12/23 20:29:21 App: TestPauseResumeWithEventingReb got deployed
2021/12/23 20:29:21 Starting bucket ops to source bucket
2021/12/23 20:29:30 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:29:35 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:29:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:29:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:29:50 Waiting for dst bucket item count to get to: 5000 curr count: 3530
2021/12/23 20:29:55 Waiting for dst bucket item count to get to: 5000 curr count: 3530
2021/12/23 20:29:55 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 20:29:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:29:55 Pausing app: bucket_op_with_timer
2021/12/23 20:29:55 Function: TestPauseResumeWithEventingReb update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:30:00 Waiting for function: TestPauseResumeWithEventingReb status to change to paused
2021/12/23 20:30:00 Function: TestPauseResumeWithEventingReb status changed to paused
2021/12/23 20:30:00 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/23 20:30:00 Removing node(s): [] from the cluster
2021/12/23 20:30:05 Rebalance progress: 29.16666666666666
2021/12/23 20:30:10 Rebalance progress: 29.16666666666666
2021/12/23 20:30:15 Rebalance progress: 100
2021/12/23 20:30:15 Resuming app: bucket_op_with_timer
2021/12/23 20:30:16 Function: TestPauseResumeWithEventingReb update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:6] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:30:16 Starting bucket ops to source bucket
2021/12/23 20:30:28 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/23 20:30:33 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/23 20:30:38 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/23 20:30:43 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2021/12/23 20:30:48 Waiting for dst bucket item count to get to: 10000 curr count: 6047
2021/12/23 20:30:53 Waiting for dst bucket item count to get to: 10000 curr count: 6047
2021/12/23 20:30:53 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/23 20:30:53 Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/23 20:30:59 Rebalance progress: 29.16666666666666
2021/12/23 20:31:04 Rebalance progress: 29.16666666666666
2021/12/23 20:31:09 Rebalance progress: 100

VB distribution across eventing nodes and their workers::

2021/12/23 20:31:14 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 20:31:29 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 20:31:44 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 20:31:59 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 20:32:14 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 20:32:29 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 20:32:44 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 20:32:59 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 20:33:14 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 20:33:29 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 20:33:44 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 20:33:59 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:72} {Name:#primary Bucket:hello-world Completion:100}]

DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: 8648489f6055120ac6bf1412a467218b
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [0-56]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [57-113]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [114-170]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [171-227]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [228-284]
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 57
	v: [285-341]
Producer node: 172.31.2.134:9300	Node UUID: 46f5cce582c7a7ef25d2d3ba9d54a25a
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 56
	v: [968-1023]
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [683-739]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [740-796]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [797-853]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [854-910]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [911-967]
Producer node: 127.0.0.1:9303	Node UUID: d1b3af527ea277cc77d0c2ec3174e2d6
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 56
	v: [627-682]
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [342-398]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [399-455]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [456-512]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [513-569]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [570-626]


2021/12/23 20:34:14 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:34:19 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/23 20:34:24 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/23 20:34:29 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/23 20:34:34 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2021/12/23 20:34:34 clusterSetup.go:405: App: TestPauseResumeWithEventingReb got un-deployed
2021/12/23 20:34:34 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:34:34 eventingSetup.go:418: Function: TestPauseResumeWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeWithEventingReb deleting in background"
}
2021/12/23 20:34:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:34:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/23 20:34:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:34:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:34:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5227
2021/12/23 20:35:03 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 227
2021/12/23 20:35:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeWithEventingReb (386.98s)
=== RUN   TestBucketDeleteAfterPause
2021/12/23 20:35:13 clusterSetup.go:397: Waiting for app: TestBucketDeleteAfterPause to get un-deployed
2021/12/23 20:35:13 clusterSetup.go:405: App: TestBucketDeleteAfterPause got un-deployed
2021/12/23 20:35:13 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:35:13 eventingSetup.go:418: Function: TestBucketDeleteAfterPause delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketDeleteAfterPause not found"
}
2021/12/23 20:35:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:35:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:35:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:35:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:35:26 eventingSetup.go:125: Deploying app: TestBucketDeleteAfterPause. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:35:27 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteAfterPause stored in temp store"
}
2021/12/23 20:35:32 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/23 20:35:37 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/23 20:35:42 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/23 20:35:47 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2021/12/23 20:35:47 clusterSetup.go:354: App: TestBucketDeleteAfterPause got deployed
2021/12/23 20:35:47 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 20:35:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 1008
2021/12/23 20:36:02 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 1008
2021/12/23 20:36:02 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 20:36:02 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:36:02 handler_test.go:712: Pausing app: bucket_op_on_update
2021/12/23 20:36:02 eventingSetup.go:270: Function: TestBucketDeleteAfterPause update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:36:07 eventingSetup.go:719: Waiting for function: TestBucketDeleteAfterPause status to change to paused
2021/12/23 20:36:07 eventingSetup.go:727: Function: TestBucketDeleteAfterPause status changed to paused
2021/12/23 20:36:07 handler_test.go:716: Deleting source bucket: default
2021/12/23 20:36:14 eventingSetup.go:719: Waiting for function: TestBucketDeleteAfterPause status to change to undeployed
2021/12/23 20:36:14 eventingSetup.go:727: Function: TestBucketDeleteAfterPause status changed to undeployed
2021/12/23 20:36:19 clusterSetup.go:397: Waiting for app: TestBucketDeleteAfterPause to get un-deployed
2021/12/23 20:36:19 clusterSetup.go:405: App: TestBucketDeleteAfterPause got un-deployed
2021/12/23 20:36:19 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:36:19 eventingSetup.go:418: Function: TestBucketDeleteAfterPause delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteAfterPause deleting in background"
}
2021/12/23 20:36:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:36:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:36:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:36:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 20:36:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBucketDeleteAfterPause (94.23s)
=== RUN   TestChangeFnCodeBetweenPauseResume
2021/12/23 20:36:47 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/23 20:36:47 clusterSetup.go:405: App: TestChangeFnCodeBetweenPauseResume got un-deployed
2021/12/23 20:36:47 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:36:47 eventingSetup.go:418: Function: TestChangeFnCodeBetweenPauseResume delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestChangeFnCodeBetweenPauseResume not found"
}
2021/12/23 20:36:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:36:53 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:36:55 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:37:00 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:37:00 eventingSetup.go:125: Deploying app: TestChangeFnCodeBetweenPauseResume. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:37:01 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume stored in temp store"
}
2021/12/23 20:37:06 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/23 20:37:11 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/23 20:37:16 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/23 20:37:21 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2021/12/23 20:37:21 clusterSetup.go:354: App: TestChangeFnCodeBetweenPauseResume got deployed
2021/12/23 20:37:21 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 20:37:56 handler_test.go:739: Pausing function: TestChangeFnCodeBetweenPauseResume
2021/12/23 20:37:56 eventingSetup.go:270: Function: TestChangeFnCodeBetweenPauseResume update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:38:01 eventingSetup.go:719: Waiting for function: TestChangeFnCodeBetweenPauseResume status to change to paused
2021/12/23 20:38:01 eventingSetup.go:727: Function: TestChangeFnCodeBetweenPauseResume status changed to paused
2021/12/23 20:41:01 handler_test.go:748: Resuming function: TestChangeFnCodeBetweenPauseResume
2021/12/23 20:41:01 eventingSetup.go:125: Deploying app: TestChangeFnCodeBetweenPauseResume. Item count src bucket: 5000 dst bucket: 0
2021/12/23 20:41:02 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume stored in temp store"
}
2021/12/23 20:41:07 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2021/12/23 20:41:07 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:41:07 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 0 expected 5000
2021/12/23 20:41:12 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2021/12/23 20:41:12 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:41:12 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 3081 expected 5000
2021/12/23 20:41:17 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2021/12/23 20:41:17 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:41:17 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 3901 expected 5000
2021/12/23 20:41:22 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2021/12/23 20:41:22 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:41:22 eventingSetup.go:804: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 5000
2021/12/23 20:41:22 handler_test.go:753: Undeploying function: TestChangeFnCodeBetweenPauseResume
2021/12/23 20:41:23 eventingSetup.go:270: Function: TestChangeFnCodeBetweenPauseResume update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:41:33 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/23 20:41:38 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/23 20:41:43 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2021/12/23 20:41:43 clusterSetup.go:405: App: TestChangeFnCodeBetweenPauseResume got un-deployed
2021/12/23 20:41:43 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:41:43 eventingSetup.go:418: Function: TestChangeFnCodeBetweenPauseResume delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume deleting in background"
}
2021/12/23 20:41:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:41:54 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 20:41:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/23 20:41:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:42:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:42:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestChangeFnCodeBetweenPauseResume (328.83s)
=== RUN   TestCommentUnCommentOnDelete
2021/12/23 20:42:16 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/23 20:42:16 clusterSetup.go:405: App: TestCommentUnCommentOnDelete got un-deployed
2021/12/23 20:42:16 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:42:16 eventingSetup.go:418: Function: TestCommentUnCommentOnDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCommentUnCommentOnDelete not found"
}
2021/12/23 20:42:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:42:22 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:42:24 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:42:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:42:29 eventingSetup.go:125: Deploying app: TestCommentUnCommentOnDelete. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:42:30 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete stored in temp store"
}
2021/12/23 20:42:35 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/23 20:42:40 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/23 20:42:45 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/23 20:42:50 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/23 20:42:50 clusterSetup.go:354: App: TestCommentUnCommentOnDelete got deployed
2021/12/23 20:42:50 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 20:42:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:43:04 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:43:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 20:43:04 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:43:04 handler_test.go:780: Undeploying app: TestCommentUnCommentOnDelete
2021/12/23 20:43:04 eventingSetup.go:270: Function: TestCommentUnCommentOnDelete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:43:34 eventingSetup.go:125: Deploying app: TestCommentUnCommentOnDelete. Item count src bucket: 5000 dst bucket: 5000
2021/12/23 20:43:35 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete stored in temp store"
}
2021/12/23 20:43:40 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/23 20:43:45 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/23 20:43:50 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/23 20:43:55 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2021/12/23 20:43:55 clusterSetup.go:354: App: TestCommentUnCommentOnDelete got deployed
2021/12/23 20:43:55 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 20:44:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 20:44:13 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 20:44:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:44:13 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:44:13 handler_test.go:799: Undeploying app: TestCommentUnCommentOnDelete
2021/12/23 20:44:13 eventingSetup.go:270: Function: TestCommentUnCommentOnDelete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:44:23 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/23 20:44:28 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/23 20:44:33 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2021/12/23 20:44:33 clusterSetup.go:405: App: TestCommentUnCommentOnDelete got un-deployed
2021/12/23 20:44:33 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:44:33 eventingSetup.go:418: Function: TestCommentUnCommentOnDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete deleting in background"
}
2021/12/23 20:44:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:44:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:44:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:44:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCommentUnCommentOnDelete (160.56s)
=== RUN   TestCPPWorkerCleanup
2021/12/23 20:44:56 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/23 20:44:56 clusterSetup.go:405: App: TestCPPWorkerCleanup got un-deployed
2021/12/23 20:44:56 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:44:56 eventingSetup.go:418: Function: TestCPPWorkerCleanup delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCPPWorkerCleanup not found"
}
2021/12/23 20:44:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:45:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:45:04 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:45:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:45:09 eventingSetup.go:125: Deploying app: TestCPPWorkerCleanup. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:45:11 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCPPWorkerCleanup stored in temp store"
}
2021/12/23 20:45:11 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 20:45:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:45:23 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:45:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:45:33 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:45:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 4106
2021/12/23 20:45:43 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 4106
2021/12/23 20:45:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 20:45:43 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:45:48 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/23 20:45:53 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/23 20:45:58 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/23 20:46:03 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2021/12/23 20:46:03 clusterSetup.go:405: App: TestCPPWorkerCleanup got un-deployed
2021/12/23 20:46:03 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:46:03 eventingSetup.go:418: Function: TestCPPWorkerCleanup delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCPPWorkerCleanup deleting in background"
}
2021/12/23 20:46:04 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:46:14 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 20:46:14 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:46:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:46:26 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 20:46:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCPPWorkerCleanup (129.76s)
=== RUN   TestWithUserXattrs
2021/12/23 20:47:06 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/23 20:47:06 clusterSetup.go:405: App: TestWithUserXattrs got un-deployed
2021/12/23 20:47:06 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:47:06 eventingSetup.go:418: Function: TestWithUserXattrs delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestWithUserXattrs not found"
}
2021/12/23 20:47:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:47:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:47:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:47:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:47:19 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 20:47:21 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 20:47:23 eventingSetup.go:125: Deploying app: TestWithUserXattrs. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:47:24 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestWithUserXattrs stored in temp store"
}
2021/12/23 20:47:29 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/23 20:47:34 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/23 20:47:39 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/23 20:47:44 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2021/12/23 20:47:44 clusterSetup.go:354: App: TestWithUserXattrs got deployed
2021/12/23 20:47:44 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 20:47:54 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:47:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 4165
2021/12/23 20:48:04 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 4165
2021/12/23 20:48:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 20:48:04 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:48:09 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/23 20:48:14 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/23 20:48:19 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/23 20:48:24 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2021/12/23 20:48:24 clusterSetup.go:405: App: TestWithUserXattrs got un-deployed
2021/12/23 20:48:24 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:48:24 eventingSetup.go:418: Function: TestWithUserXattrs delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestWithUserXattrs deleting in background"
}
2021/12/23 20:48:25 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:48:35 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 20:48:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:48:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:48:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 20:48:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestWithUserXattrs (110.83s)
=== RUN   TestEventProcessingPostBucketFlush
2021/12/23 20:48:57 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/23 20:48:57 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2021/12/23 20:48:57 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:48:57 eventingSetup.go:418: Function: TestEventProcessingPostBucketFlush delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventProcessingPostBucketFlush not found"
}
2021/12/23 20:48:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:49:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:49:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:49:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:49:10 eventingSetup.go:125: Deploying app: TestEventProcessingPostBucketFlush. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:49:11 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventProcessingPostBucketFlush stored in temp store"
}
2021/12/23 20:49:16 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/23 20:49:21 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/23 20:49:26 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/23 20:49:31 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2021/12/23 20:49:31 clusterSetup.go:354: App: TestEventProcessingPostBucketFlush got deployed
2021/12/23 20:49:31 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 20:49:40 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:49:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 20:49:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 20:49:45 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:49:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:49:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3144
2021/12/23 20:50:03 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 644
2021/12/23 20:50:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:50:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:50:15 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 20:50:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:50:15 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 20:50:41 eventingSetup.go:441: Waiting for dst bucket item count to get to: 25000 curr count: 15818
2021/12/23 20:50:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 25000 curr count: 15818
2021/12/23 20:50:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2021/12/23 20:50:46 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:50:46 eventingSetup.go:270: Function: TestEventProcessingPostBucketFlush update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 20:50:51 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/23 20:50:56 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/23 20:51:01 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/23 20:51:06 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/23 20:51:06 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2021/12/23 20:51:06 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:51:11 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2021/12/23 20:51:11 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2021/12/23 20:51:11 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:51:11 eventingSetup.go:418: Function: TestEventProcessingPostBucketFlush delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventProcessingPostBucketFlush deleting in background"
}
2021/12/23 20:51:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:51:22 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 25000
2021/12/23 20:51:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 25000
2021/12/23 20:51:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:51:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:51:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 25000
2021/12/23 20:51:44 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12500
2021/12/23 20:51:44 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventProcessingPostBucketFlush (177.13s)
=== RUN   TestMetaBucketDelete
2021/12/23 20:51:54 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2021/12/23 20:51:54 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2021/12/23 20:51:54 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:51:54 eventingSetup.go:418: Function: TestMetaBucketDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaBucketDelete not found"
}
2021/12/23 20:51:55 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:52:00 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:52:02 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:52:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:52:07 eventingSetup.go:125: Deploying app: TestMetaBucketDelete. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:52:08 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDelete stored in temp store"
}
2021/12/23 20:52:13 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/23 20:52:18 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/23 20:52:23 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/23 20:52:28 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2021/12/23 20:52:28 clusterSetup.go:354: App: TestMetaBucketDelete got deployed
2021/12/23 20:52:28 handler_test.go:902: Deleting metadata bucket: eventing
2021/12/23 20:52:30 handler_test.go:904: Deleted metadata bucket: eventing
2021/12/23 20:52:35 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2021/12/23 20:52:35 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2021/12/23 20:52:50 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2021/12/23 20:52:50 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2021/12/23 20:52:50 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:52:50 eventingSetup.go:418: Function: TestMetaBucketDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDelete deleting in background"
}
2021/12/23 20:52:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:52:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:52:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:53:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaBucketDelete (79.04s)
=== RUN   TestMetaBucketDeleteWithBootstrap
2021/12/23 20:53:13 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/23 20:53:13 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2021/12/23 20:53:13 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:53:13 eventingSetup.go:418: Function: TestMetaBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaBucketDeleteWithBootstrap not found"
}
2021/12/23 20:53:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:53:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:53:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:53:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:53:26 eventingSetup.go:125: Deploying app: TestMetaBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:53:27 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDeleteWithBootstrap stored in temp store"
}
2021/12/23 20:53:46 handler_test.go:923: Deleting metadata bucket: eventing
2021/12/23 20:53:47 handler_test.go:925: Deleted metadata bucket: eventing
2021/12/23 20:54:02 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/23 20:54:02 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2021/12/23 20:54:17 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/23 20:54:17 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2021/12/23 20:54:17 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:54:17 eventingSetup.go:418: Function: TestMetaBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDeleteWithBootstrap deleting in background"
}
2021/12/23 20:54:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:54:23 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:54:25 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:54:30 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaBucketDeleteWithBootstrap (87.00s)
=== RUN   TestSourceBucketDelete
2021/12/23 20:54:40 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2021/12/23 20:54:40 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2021/12/23 20:54:40 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:54:40 eventingSetup.go:418: Function: TestSourceBucketDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceBucketDelete not found"
}
2021/12/23 20:54:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:54:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:54:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:54:53 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:54:53 eventingSetup.go:125: Deploying app: TestSourceBucketDelete. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:54:54 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDelete stored in temp store"
}
2021/12/23 20:54:59 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/23 20:55:04 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/23 20:55:09 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/23 20:55:14 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2021/12/23 20:55:14 clusterSetup.go:354: App: TestSourceBucketDelete got deployed
2021/12/23 20:55:14 handler_test.go:945: Deleting source bucket: default
2021/12/23 20:55:16 handler_test.go:947: Deleted source bucket: default
2021/12/23 20:55:21 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2021/12/23 20:55:21 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2021/12/23 20:55:36 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2021/12/23 20:55:36 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2021/12/23 20:55:36 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:55:36 eventingSetup.go:418: Function: TestSourceBucketDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDelete deleting in background"
}
2021/12/23 20:55:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:55:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:55:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:55:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceBucketDelete (79.16s)
=== RUN   TestSourceBucketDeleteWithBootstrap
2021/12/23 20:55:59 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2021/12/23 20:55:59 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2021/12/23 20:55:59 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:55:59 eventingSetup.go:418: Function: TestSourceBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceBucketDeleteWithBootstrap not found"
}
2021/12/23 20:56:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:56:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:56:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:56:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:56:12 eventingSetup.go:125: Deploying app: TestSourceBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:56:13 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDeleteWithBootstrap stored in temp store"
}
2021/12/23 20:56:32 handler_test.go:966: Deleting source bucket: default
2021/12/23 20:56:34 handler_test.go:968: Deleted source bucket: default
2021/12/23 20:56:49 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2021/12/23 20:56:49 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2021/12/23 20:57:04 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2021/12/23 20:57:04 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2021/12/23 20:57:04 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:57:04 eventingSetup.go:418: Function: TestSourceBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDeleteWithBootstrap deleting in background"
}
2021/12/23 20:57:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:57:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:57:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:57:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceBucketDeleteWithBootstrap (87.83s)
=== RUN   TestSourceAndMetaBucketDeleteWithBootstrap
2021/12/23 20:57:27 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/23 20:57:27 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2021/12/23 20:57:27 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:57:27 eventingSetup.go:418: Function: TestSourceAndMetaBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceAndMetaBucketDeleteWithBootstrap not found"
}
2021/12/23 20:57:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:57:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:57:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:57:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:57:40 eventingSetup.go:125: Deploying app: TestSourceAndMetaBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:57:41 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceAndMetaBucketDeleteWithBootstrap stored in temp store"
}
2021/12/23 20:58:00 handler_test.go:988: Deleting source bucket: default
2021/12/23 20:58:01 handler_test.go:990: Deleted source bucket: default
2021/12/23 20:58:01 handler_test.go:992: Deleting metadata bucket: eventing
2021/12/23 20:58:02 handler_test.go:994: Deleted metadata bucket: eventing
2021/12/23 20:58:17 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/23 20:58:17 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2021/12/23 20:58:32 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2021/12/23 20:58:32 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2021/12/23 20:58:32 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:58:32 eventingSetup.go:418: Function: TestSourceAndMetaBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceAndMetaBucketDeleteWithBootstrap deleting in background"
}
2021/12/23 20:58:33 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:58:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:58:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:58:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceAndMetaBucketDeleteWithBootstrap (88.17s)
=== RUN   TestUndeployDuringBootstrap
2021/12/23 20:58:55 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/23 20:58:55 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2021/12/23 20:58:55 eventingSetup.go:46: No eventing-con process running
2021/12/23 20:58:55 eventingSetup.go:418: Function: TestUndeployDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployDuringBootstrap not found"
}
2021/12/23 20:58:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:59:02 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:59:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 20:59:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 20:59:08 eventingSetup.go:125: Deploying app: TestUndeployDuringBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/23 20:59:09 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployDuringBootstrap stored in temp store"
}
2021/12/23 20:59:09 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 20:59:21 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 20:59:21 clusterSetup.go:375: Apps undergoing bootstrap: true
2021/12/23 20:59:21 clusterSetup.go:378: App: TestUndeployDuringBootstrap started bootstrap
2021/12/23 20:59:21 clusterSetup.go:375: Apps undergoing bootstrap: true
2021/12/23 20:59:26 clusterSetup.go:375: Apps undergoing bootstrap: true
2021/12/23 20:59:31 clusterSetup.go:367: No apps undergoing bootstrap
2021/12/23 20:59:36 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/23 20:59:41 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/23 20:59:46 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/23 20:59:47 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2021/12/23 20:59:47 eventingSetup.go:46: No eventing-con process running
2021/12/23 21:00:12 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2021/12/23 21:00:12 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2021/12/23 21:00:12 eventingSetup.go:46: No eventing-con process running
2021/12/23 21:00:12 eventingSetup.go:418: Function: TestUndeployDuringBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployDuringBootstrap deleting in background"
}
2021/12/23 21:00:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:00:23 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 21:00:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/23 21:00:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:00:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:00:40 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 267
2021/12/23 21:00:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 267
2021/12/23 21:00:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployDuringBootstrap (119.42s)
=== RUN   TestDeleteBeforeUndeploy
2021/12/23 21:00:50 eventingSetup.go:125: Deploying app: TestDeleteBeforeUndeploy. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:00:51 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeleteBeforeUndeploy stored in temp store"
}
2021/12/23 21:00:56 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/23 21:01:01 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/23 21:01:06 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/23 21:01:11 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2021/12/23 21:01:11 clusterSetup.go:354: App: TestDeleteBeforeUndeploy got deployed
2021/12/23 21:01:11 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 422 dump: {
 "name": "ERR_APP_NOT_UNDEPLOYED",
 "code": 22,
 "description": "Function: TestDeleteBeforeUndeploy skipping delete request as it hasn't been undeployed"
}
2021/12/23 21:01:11 eventingSetup.go:270: Function: TestDeleteBeforeUndeploy update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 21:01:11 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeleteBeforeUndeploy deleting in background"
}
2021/12/23 21:01:16 clusterSetup.go:397: Waiting for app: TestDeleteBeforeUndeploy to get un-deployed
2021/12/23 21:01:16 clusterSetup.go:405: App: TestDeleteBeforeUndeploy got un-deployed
2021/12/23 21:01:16 eventingSetup.go:46: No eventing-con process running
2021/12/23 21:01:16 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeleteBeforeUndeploy not found"
}
2021/12/23 21:01:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:01:23 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:01:24 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:01:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDeleteBeforeUndeploy (44.74s)
=== RUN   TestUndeployWhenTimersAreFired
2021/12/23 21:01:39 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/23 21:01:39 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2021/12/23 21:01:39 eventingSetup.go:46: No eventing-con process running
2021/12/23 21:01:39 eventingSetup.go:418: Function: TestUndeployWhenTimersAreFired delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployWhenTimersAreFired not found"
}
2021/12/23 21:01:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:01:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:01:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:01:52 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:01:52 eventingSetup.go:125: Deploying app: TestUndeployWhenTimersAreFired. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:01:54 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWhenTimersAreFired stored in temp store"
}
2021/12/23 21:01:59 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/23 21:02:04 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/23 21:02:09 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/23 21:02:14 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2021/12/23 21:02:14 clusterSetup.go:354: App: TestUndeployWhenTimersAreFired got deployed
2021/12/23 21:02:14 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 21:02:49 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/23 21:02:54 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/23 21:02:59 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/23 21:03:04 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/23 21:03:04 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2021/12/23 21:03:04 eventingSetup.go:46: No eventing-con process running
2021/12/23 21:04:49 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2021/12/23 21:04:49 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2021/12/23 21:04:49 eventingSetup.go:46: No eventing-con process running
2021/12/23 21:04:49 eventingSetup.go:418: Function: TestUndeployWhenTimersAreFired delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWhenTimersAreFired deleting in background"
}
2021/12/23 21:04:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:05:01 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 21:05:06 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 21:05:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:05:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:05:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/23 21:05:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployWhenTimersAreFired (228.17s)
=== RUN   TestUndeployWithKVFailover
2021/12/23 21:05:28 clusterSetup.go:397: Waiting for app: TestUndeployWithKVFailover to get un-deployed
2021/12/23 21:05:28 clusterSetup.go:405: App: TestUndeployWithKVFailover got un-deployed
2021/12/23 21:05:28 eventingSetup.go:46: No eventing-con process running
2021/12/23 21:05:28 eventingSetup.go:418: Function: TestUndeployWithKVFailover delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployWithKVFailover not found"
}
2021/12/23 21:05:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:05:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:05:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:05:41 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:05:41 eventingSetup.go:125: Deploying app: TestUndeployWithKVFailover. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:05:42 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWithKVFailover stored in temp store"
}
2021/12/23 21:05:42 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 21:05:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 21:05:54 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 21:05:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 21:06:04 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 21:06:09 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 21:06:14 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 21:06:19 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2836
2021/12/23 21:06:24 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 2836
2021/12/23 21:06:24 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 21:06:24 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/23 21:06:24 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 21:06:29 Rebalance progress: 29.16666666666666
2021/12/23 21:06:34 Rebalance progress: 29.16666666666666
2021/12/23 21:06:39 Rebalance progress: 100
2021/12/23 21:06:39 Failing over: [127.0.0.1:19003]
2021/12/23 21:06:49 Function: TestUndeployWithKVFailover update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2021/12/23 21:07:49 Removing node(s): [] from the cluster
2021/12/23 21:07:54 Rebalance progress: 29.16666666666666
2021/12/23 21:07:59 Rebalance progress: 29.16666666666666
2021/12/23 21:08:04 Rebalance progress: 100
2021/12/23 21:08:09 Waiting for app: TestUndeployWithKVFailover to get un-deployed
2021/12/23 21:08:09 App: TestUndeployWithKVFailover got un-deployed
2021/12/23 21:08:09 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:08:14 Waiting for app: TestUndeployWithKVFailover to get un-deployed
2021/12/23 21:08:14 App: TestUndeployWithKVFailover got un-deployed
2021/12/23 21:08:14 No eventing-con process running
2021/12/23 21:08:14 Function: TestUndeployWithKVFailover delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWithKVFailover deleting in background"
}
2021/12/23 21:08:16 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:08:26 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 21:08:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:08:27 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:08:37 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/23 21:08:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployWithKVFailover (199.79s)
=== RUN   TestBucketFlushWhileFnDeployed
2021/12/23 21:08:47 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/23 21:08:47 App: TestBucketFlushWhileFnDeployed got un-deployed
2021/12/23 21:08:47 No eventing-con process running
2021/12/23 21:08:47 Function: TestBucketFlushWhileFnDeployed delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketFlushWhileFnDeployed not found"
}
2021/12/23 21:08:49 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:08:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:08:56 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:09:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:09:01 Deploying app: TestBucketFlushWhileFnDeployed. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:09:02 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketFlushWhileFnDeployed stored in temp store"
}
2021/12/23 21:09:07 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/23 21:09:12 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/23 21:09:17 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/23 21:09:22 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2021/12/23 21:09:22 App: TestBucketFlushWhileFnDeployed got deployed
2021/12/23 21:09:22 Starting bucket ops to source bucket
2021/12/23 21:09:42 Waiting for dst bucket item count to get to: 20000 curr count: 8226
2021/12/23 21:09:47 Waiting for dst bucket item count to get to: 20000 curr count: 19970
2021/12/23 21:09:52 Waiting for dst bucket item count to get to: 20000 curr count: 19970
2021/12/23 21:09:52 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2021/12/23 21:09:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:09:55 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:10:05 Waiting for dst bucket item count to get to: 0 curr count: 20000
2021/12/23 21:10:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:10:07 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:10:17 Waiting for dst bucket item count to get to: 0 curr count: 20000
2021/12/23 21:10:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:10:17 Starting bucket ops to source bucket
2021/12/23 21:10:30 Waiting for dst bucket item count to get to: 10000 curr count: 1687
2021/12/23 21:10:35 Waiting for dst bucket item count to get to: 10000 curr count: 1687
2021/12/23 21:10:35 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/23 21:10:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:10:40 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/23 21:10:45 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/23 21:10:50 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/23 21:10:55 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2021/12/23 21:10:55 App: TestBucketFlushWhileFnDeployed got un-deployed
2021/12/23 21:10:55 No eventing-con process running
2021/12/23 21:10:55 Function: TestBucketFlushWhileFnDeployed delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketFlushWhileFnDeployed deleting in background"
}
2021/12/23 21:10:56 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:11:06 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/23 21:11:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:11:08 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:11:18 Waiting for dst bucket item count to get to: 0 curr count: 6236
2021/12/23 21:11:23 Waiting for dst bucket item count to get to: 0 curr count: 1236
2021/12/23 21:11:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBucketFlushWhileFnDeployed (165.51s)
=== RUN   TestTimerOverwrite
2021/12/23 21:11:33 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/23 21:11:33 App: TestTimerOverwrite got un-deployed
2021/12/23 21:11:33 No eventing-con process running
2021/12/23 21:11:33 Function: TestTimerOverwrite delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerOverwrite not found"
}
2021/12/23 21:11:34 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:11:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:11:41 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:11:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:11:46 Deploying app: TestTimerOverwrite. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:11:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverwrite stored in temp store"
}
2021/12/23 21:11:52 Waiting for app: TestTimerOverwrite to get deployed
2021/12/23 21:11:57 Waiting for app: TestTimerOverwrite to get deployed
2021/12/23 21:12:02 Waiting for app: TestTimerOverwrite to get deployed
2021/12/23 21:12:07 Waiting for app: TestTimerOverwrite to get deployed
2021/12/23 21:12:07 App: TestTimerOverwrite got deployed
2021/12/23 21:12:17 Starting bucket ops to source bucket
2021/12/23 21:12:26 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 21:12:31 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 21:12:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 21:12:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 21:12:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 21:12:51 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 21:12:56 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 21:13:01 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 21:13:06 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 21:13:11 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 21:13:16 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 21:13:21 Waiting for dst bucket item count to get to: 5000 curr count: 22
2021/12/23 21:13:26 Waiting for dst bucket item count to get to: 5000 curr count: 22
2021/12/23 21:13:26 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 21:13:36 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:13:42 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/23 21:13:47 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/23 21:13:52 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/23 21:13:57 Waiting for app: TestTimerOverwrite to get un-deployed
2021/12/23 21:13:57 App: TestTimerOverwrite got un-deployed
2021/12/23 21:13:57 No eventing-con process running
2021/12/23 21:13:57 Function: TestTimerOverwrite delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverwrite deleting in background"
}
2021/12/23 21:13:58 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:14:08 Waiting for dst bucket item count to get to: 0 curr count: 3508
2021/12/23 21:14:13 Waiting for dst bucket item count to get to: 0 curr count: 1008
2021/12/23 21:14:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:14:15 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:14:25 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 21:14:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerOverwrite (181.83s)
=== RUN   TestUndeployBackdoorDuringBootstrap
2021/12/23 21:14:30 Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/23 21:14:30 Removing node(s): [] from the cluster
2021/12/23 21:14:35 Rebalance progress: 100
2021/12/23 21:14:35 Failing over: [127.0.0.1:19003]
2021/12/23 21:14:40 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2021/12/23 21:14:40 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2021/12/23 21:14:40 No eventing-con process running
2021/12/23 21:14:40 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployBackdoorDuringBootstrap not found"
}
2021/12/23 21:14:41 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:14:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:14:48 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:14:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:14:53 Deploying app: TestUndeployBackdoorDuringBootstrap. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:14:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployBackdoorDuringBootstrap stored in temp store"
}
2021/12/23 21:14:54 Starting bucket ops to source bucket
2021/12/23 21:15:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:15:05 Context: Post to set retry counter, response code: 200 dump: {
 "code": 0
}
2021/12/23 21:15:05 set retry counter, response &{[123 10 32 34 99 111 100 101 34 58 32 48 10 125] }
2021/12/23 21:16:10 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2021/12/23 21:16:10 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2021/12/23 21:16:10 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:16:10 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployBackdoorDuringBootstrap deleting in background"
}
2021/12/23 21:16:15 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2021/12/23 21:16:15 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2021/12/23 21:16:15 No eventing-con process running
2021/12/23 21:16:15 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployBackdoorDuringBootstrap not found"
}
2021/12/23 21:16:16 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:16:26 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 21:16:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:16:28 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:16:38 Waiting for dst bucket item count to get to: 0 curr count: 2446
2021/12/23 21:16:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:16:38 Removing node(s): [] from the cluster
2021/12/23 21:16:43 Rebalance progress: 100
--- PASS: TestUndeployBackdoorDuringBootstrap (137.99s)
=== RUN   TestOnUpdateSrcMutation
2021/12/23 21:16:53 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/23 21:16:53 App: TestOnUpdateSrcMutation got un-deployed
2021/12/23 21:16:53 No eventing-con process running
2021/12/23 21:16:53 Function: TestOnUpdateSrcMutation delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateSrcMutation not found"
}
2021/12/23 21:16:54 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:16:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:17:01 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:17:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:17:06 Deploying app: TestOnUpdateSrcMutation. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:17:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutation stored in temp store"
}
2021/12/23 21:17:07 Starting bucket ops to source bucket
2021/12/23 21:17:34 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/23 21:17:34 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:17:39 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/23 21:17:44 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/23 21:17:49 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/23 21:17:54 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2021/12/23 21:17:54 App: TestOnUpdateSrcMutation got un-deployed
2021/12/23 21:17:54 No eventing-con process running
2021/12/23 21:17:54 Function: TestOnUpdateSrcMutation delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutation deleting in background"
}
2021/12/23 21:17:55 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:18:05 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/23 21:18:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:18:07 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:18:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateSrcMutation (89.51s)
=== RUN   TestOnDeleteSrcMutation
2021/12/23 21:18:22 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/23 21:18:22 App: TestOnDeleteSrcMutation got un-deployed
2021/12/23 21:18:22 No eventing-con process running
2021/12/23 21:18:22 Function: TestOnDeleteSrcMutation delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteSrcMutation not found"
}
2021/12/23 21:18:23 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:18:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:18:30 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:18:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:18:35 Deploying app: TestOnDeleteSrcMutation. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:18:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutation stored in temp store"
}
2021/12/23 21:18:36 Starting bucket ops to source bucket
2021/12/23 21:19:05 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 21:19:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:19:10 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/23 21:19:15 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/23 21:19:20 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/23 21:19:25 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2021/12/23 21:19:25 App: TestOnDeleteSrcMutation got un-deployed
2021/12/23 21:19:25 No eventing-con process running
2021/12/23 21:19:25 Function: TestOnDeleteSrcMutation delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutation deleting in background"
}
2021/12/23 21:19:27 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:19:37 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 21:19:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:19:38 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:19:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteSrcMutation (91.15s)
=== RUN   TestOnUpdateSrcMutationWithTimer
2021/12/23 21:19:53 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/23 21:19:53 App: TestOnUpdateSrcMutationWithTimer got un-deployed
2021/12/23 21:19:53 No eventing-con process running
2021/12/23 21:19:53 Function: TestOnUpdateSrcMutationWithTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateSrcMutationWithTimer not found"
}
2021/12/23 21:19:55 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:20:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:20:01 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:20:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:20:06 Deploying app: TestOnUpdateSrcMutationWithTimer. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:20:08 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutationWithTimer stored in temp store"
}
2021/12/23 21:20:08 Starting bucket ops to source bucket
2021/12/23 21:20:45 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/23 21:20:45 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:20:50 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/23 21:20:55 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/23 21:21:00 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/23 21:21:05 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2021/12/23 21:21:05 App: TestOnUpdateSrcMutationWithTimer got un-deployed
2021/12/23 21:21:05 No eventing-con process running
2021/12/23 21:21:05 Function: TestOnUpdateSrcMutationWithTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutationWithTimer deleting in background"
}
2021/12/23 21:21:06 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:21:16 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/23 21:21:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:21:18 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:21:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateSrcMutationWithTimer (99.47s)
=== RUN   TestOnDeleteSrcMutationsWithTimer
2021/12/23 21:21:33 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/23 21:21:33 App: TestOnDeleteSrcMutationsWithTimer got un-deployed
2021/12/23 21:21:33 No eventing-con process running
2021/12/23 21:21:33 Function: TestOnDeleteSrcMutationsWithTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteSrcMutationsWithTimer not found"
}
2021/12/23 21:21:34 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:21:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:21:41 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:21:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:21:46 Deploying app: TestOnDeleteSrcMutationsWithTimer. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:21:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutationsWithTimer stored in temp store"
}
2021/12/23 21:21:47 Starting bucket ops to source bucket
2021/12/23 21:22:36 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 21:22:36 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:22:41 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/23 21:22:46 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/23 21:22:51 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/23 21:22:56 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2021/12/23 21:22:56 App: TestOnDeleteSrcMutationsWithTimer got un-deployed
2021/12/23 21:22:56 No eventing-con process running
2021/12/23 21:22:56 Function: TestOnDeleteSrcMutationsWithTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutationsWithTimer deleting in background"
}
2021/12/23 21:22:57 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:23:07 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/23 21:23:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:23:09 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:23:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteSrcMutationsWithTimer (111.43s)
=== RUN   TestInterHandlerRecursion
2021/12/23 21:23:24 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/23 21:23:24 App: TestInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/23 21:23:24 No eventing-con process running
2021/12/23 21:23:24 Function: TestInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_source_bucket_update_op not found"
}
2021/12/23 21:23:26 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:23:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:23:32 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:23:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:23:42 Waiting for app: TestInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/23 21:23:42 App: TestInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/23 21:23:42 No eventing-con process running
2021/12/23 21:23:42 Function: TestInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2021/12/23 21:23:44 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:23:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:23:50 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:23:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:23:55 Deploying app: TestInterHandlerRecursion_source_bucket_update_op. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:23:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op stored in temp store"
}
2021/12/23 21:23:57 response body {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op stored in temp store"
} err 
2021/12/23 21:24:02 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/23 21:24:07 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/23 21:24:12 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/23 21:24:17 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/23 21:24:17 App: TestInterHandlerRecursion_source_bucket_update_op got deployed
2021/12/23 21:24:17 Deploying app: TestInterHandlerRecursion_src_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:24:17 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_FUNCTION_RECURSION",
 "code": 50,
 "description": "Inter handler recursion error"
}
2021/12/23 21:24:17 response body {
 "name": "ERR_INTER_FUNCTION_RECURSION",
 "code": 50,
 "description": "Inter handler recursion error"
} err 
2021/12/23 21:24:22 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/23 21:24:27 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/23 21:24:32 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/23 21:24:37 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/23 21:24:37 App: TestInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/23 21:24:37 No eventing-con process running
2021/12/23 21:24:37 Function: TestInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op deleting in background"
}
2021/12/23 21:24:38 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:24:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:24:45 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:24:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:24:55 Waiting for app: TestInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/23 21:24:55 App: TestInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/23 21:24:55 No eventing-con process running
2021/12/23 21:24:55 Function: TestInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2021/12/23 21:24:56 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:25:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:25:03 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:25:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterHandlerRecursion (113.85s)
=== RUN   TestInterBucketRecursion
2021/12/23 21:25:13 Deploying app: TestInterBucketRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:25:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 stored in temp store"
}
2021/12/23 21:25:14 response body {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 stored in temp store"
} err 
2021/12/23 21:25:14 Deploying app: TestInterBucketRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:25:14 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestInterBucketRecursion_function2 causes a cycle involving functions: [TestInterBucketRecursion_function1], hence deployment is disallowed"
}
2021/12/23 21:25:19 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/23 21:25:24 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/23 21:25:29 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/23 21:25:34 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2021/12/23 21:25:34 App: TestInterBucketRecursion_function1 got deployed
2021/12/23 21:25:39 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/23 21:25:44 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/23 21:25:49 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/23 21:25:54 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2021/12/23 21:25:55 App: TestInterBucketRecursion_function1 got un-deployed
2021/12/23 21:25:55 No eventing-con process running
2021/12/23 21:25:55 Function: TestInterBucketRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 deleting in background"
}
2021/12/23 21:25:56 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:26:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:26:03 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:26:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:26:13 Waiting for app: TestInterBucketRecursion_function2 to get un-deployed
2021/12/23 21:26:13 App: TestInterBucketRecursion_function2 got un-deployed
2021/12/23 21:26:13 No eventing-con process running
2021/12/23 21:26:13 Function: TestInterBucketRecursion_function2 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterBucketRecursion_function2 not found"
}
2021/12/23 21:26:14 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:26:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:26:21 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:26:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterBucketRecursion (77.57s)
=== RUN   TestLargeHandler
2021/12/23 21:26:26 Changed force_compress value to false
2021/12/23 21:26:26 Deploying app: TestLargeHandler_function. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:26:26 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_APPCODE_SIZE",
 "code": 39,
 "description": "Function: TestLargeHandler_function handler Code size is more than 131072. Code Size: 131768"
}
2021/12/23 21:26:26 Changed force_compress value to true
2021/12/23 21:26:26 Deploying app: TestLargeHandler_function. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:26:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestLargeHandler_function stored in temp store"
}
2021/12/23 21:26:33 Waiting for app: TestLargeHandler_function to get deployed
2021/12/23 21:26:38 Waiting for app: TestLargeHandler_function to get deployed
2021/12/23 21:26:43 Waiting for app: TestLargeHandler_function to get deployed
2021/12/23 21:26:48 Waiting for app: TestLargeHandler_function to get deployed
2021/12/23 21:26:48 App: TestLargeHandler_function got deployed
2021/12/23 21:26:53 Waiting for app: TestLargeHandler_function to get un-deployed
2021/12/23 21:26:58 Waiting for app: TestLargeHandler_function to get un-deployed
2021/12/23 21:27:03 Waiting for app: TestLargeHandler_function to get un-deployed
2021/12/23 21:27:08 Waiting for app: TestLargeHandler_function to get un-deployed
2021/12/23 21:27:08 App: TestLargeHandler_function got un-deployed
2021/12/23 21:27:08 No eventing-con process running
2021/12/23 21:27:08 Function: TestLargeHandler_function delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestLargeHandler_function deleting in background"
}
2021/12/23 21:27:09 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:27:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:27:16 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:27:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestLargeHandler (55.45s)
=== RUN   TestAllowInterHandlerRecursion
2021/12/23 21:27:31 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/23 21:27:31 App: TestAllowInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/23 21:27:31 No eventing-con process running
2021/12/23 21:27:31 Function: TestAllowInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op not found"
}
2021/12/23 21:27:32 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:27:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:27:39 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:27:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:27:49 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/23 21:27:49 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/23 21:27:49 No eventing-con process running
2021/12/23 21:27:49 Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2021/12/23 21:27:50 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:27:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:27:57 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:28:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:28:02 Deploying app: TestAllowInterHandlerRecursion_source_bucket_update_op. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:28:03 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op stored in temp store"
}
2021/12/23 21:28:03 response body {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op stored in temp store"
} err 
2021/12/23 21:28:08 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/23 21:28:13 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/23 21:28:18 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/23 21:28:23 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2021/12/23 21:28:23 App: TestAllowInterHandlerRecursion_source_bucket_update_op got deployed
2021/12/23 21:28:23 Deploying app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:28:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete stored in temp store"
}
2021/12/23 21:28:25 response body {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete stored in temp store"
} err 
2021/12/23 21:28:30 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/23 21:28:35 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/23 21:28:40 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/23 21:28:45 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2021/12/23 21:28:45 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got deployed
2021/12/23 21:28:45 TestAllowInterHandlerRecursion_src_bucket_op_on_delete is deployed
2021/12/23 21:28:50 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/23 21:28:55 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/23 21:29:00 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/23 21:29:05 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2021/12/23 21:29:05 App: TestAllowInterHandlerRecursion_source_bucket_update_op got un-deployed
2021/12/23 21:29:05 No eventing-con process running
2021/12/23 21:29:05 Function: TestAllowInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op deleting in background"
}
2021/12/23 21:29:07 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:29:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:29:14 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:29:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:29:24 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/23 21:29:29 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/23 21:29:34 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/23 21:29:39 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2021/12/23 21:29:39 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2021/12/23 21:29:39 No eventing-con process running
2021/12/23 21:29:39 Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete deleting in background"
}
2021/12/23 21:29:41 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:29:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:29:47 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:29:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAllowInterHandlerRecursion (151.27s)
=== RUN   TestAllowInterBucketRecursion
2021/12/23 21:29:57 Deploying app: TestAllowInterBucketRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:29:59 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 stored in temp store"
}
2021/12/23 21:29:59 response body {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 stored in temp store"
} err 
2021/12/23 21:30:04 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/23 21:30:09 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/23 21:30:14 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/23 21:30:19 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2021/12/23 21:30:19 App: TestAllowInterBucketRecursion_function1 got deployed
2021/12/23 21:30:19 Deploying app: TestAllowInterBucketRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:30:20 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 stored in temp store"
}
2021/12/23 21:30:20 response body {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 stored in temp store"
} err 
2021/12/23 21:30:25 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/23 21:30:30 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/23 21:30:35 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/23 21:30:40 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2021/12/23 21:30:40 App: TestAllowInterBucketRecursion_function2 got deployed
2021/12/23 21:30:40 TestAllowInterBucketRecursion_function2 is deployed
2021/12/23 21:30:45 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/23 21:30:50 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/23 21:30:55 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/23 21:31:00 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2021/12/23 21:31:00 App: TestAllowInterBucketRecursion_function1 got un-deployed
2021/12/23 21:31:00 No eventing-con process running
2021/12/23 21:31:00 Function: TestAllowInterBucketRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 deleting in background"
}
2021/12/23 21:31:01 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:31:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:31:10 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:31:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:31:20 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/23 21:31:25 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/23 21:31:30 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/23 21:31:35 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2021/12/23 21:31:35 App: TestAllowInterBucketRecursion_function2 got un-deployed
2021/12/23 21:31:35 No eventing-con process running
2021/12/23 21:31:35 Function: TestAllowInterBucketRecursion_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 deleting in background"
}
2021/12/23 21:31:36 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:31:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:31:43 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:31:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAllowInterBucketRecursion (115.55s)
=== RUN   TestInterBucketRecursion2
2021/12/23 21:31:54 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:32:00 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:32:06 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:32:12 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:32:17 Deploying app: TestInterBucketRecursion2_function1. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:32:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function1 stored in temp store"
}
2021/12/23 21:32:23 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/23 21:32:28 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/23 21:32:33 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/23 21:32:38 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/23 21:32:43 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/23 21:32:48 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2021/12/23 21:32:48 App: TestInterBucketRecursion2_function1 got deployed
2021/12/23 21:32:48 Deploying app: TestInterBucketRecursion2_function2. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:32:49 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function2 stored in temp store"
}
2021/12/23 21:32:54 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/23 21:32:59 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/23 21:33:04 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/23 21:33:09 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2021/12/23 21:33:09 App: TestInterBucketRecursion2_function2 got deployed
2021/12/23 21:33:09 Deploying app: TestInterBucketRecursion2_function3. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:33:10 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function3 stored in temp store"
}
2021/12/23 21:33:15 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/23 21:33:20 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/23 21:33:25 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/23 21:33:30 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2021/12/23 21:33:30 App: TestInterBucketRecursion2_function3 got deployed
2021/12/23 21:33:31 Deploying app: TestInterBucketRecursion2_function4. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:33:31 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestInterBucketRecursion2_function4 causes a cycle involving functions: [TestInterBucketRecursion2_function1 TestInterBucketRecursion2_function2 TestInterBucketRecursion2_function3], hence deployment is disallowed"
}
2021/12/23 21:33:36 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/23 21:33:41 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/23 21:33:46 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/23 21:33:51 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2021/12/23 21:33:51 App: TestInterBucketRecursion2_function1 got un-deployed
2021/12/23 21:33:51 No eventing-con process running
2021/12/23 21:33:51 Function: TestInterBucketRecursion2_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function1 deleting in background"
}
2021/12/23 21:33:52 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:33:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:33:59 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:34:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:34:09 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/23 21:34:14 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/23 21:34:19 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/23 21:34:24 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2021/12/23 21:34:24 App: TestInterBucketRecursion2_function2 got un-deployed
2021/12/23 21:34:24 No eventing-con process running
2021/12/23 21:34:24 Function: TestInterBucketRecursion2_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function2 deleting in background"
}
2021/12/23 21:34:26 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:34:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:34:33 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:34:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:34:43 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/23 21:34:48 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/23 21:34:53 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/23 21:34:58 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2021/12/23 21:34:58 App: TestInterBucketRecursion2_function3 got un-deployed
2021/12/23 21:34:58 No eventing-con process running
2021/12/23 21:34:58 Function: TestInterBucketRecursion2_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function3 deleting in background"
}
2021/12/23 21:34:59 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:35:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:35:06 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:35:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:35:16 Waiting for app: TestInterBucketRecursion2_function4 to get un-deployed
2021/12/23 21:35:16 App: TestInterBucketRecursion2_function4 got un-deployed
2021/12/23 21:35:16 No eventing-con process running
2021/12/23 21:35:16 Function: TestInterBucketRecursion2_function4 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterBucketRecursion2_function4 not found"
}
2021/12/23 21:35:17 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:35:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:35:24 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:35:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterBucketRecursion2 (222.99s)
=== RUN   TestBucketDeleteWithRebOut
2021/12/23 21:35:36 Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/23 21:35:41 Rebalance progress: 100

VB distribution across eventing nodes and their workers::

2021/12/23 21:35:44 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 21:35:59 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 21:36:14 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 21:36:29 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 21:36:44 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 21:36:59 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 21:37:14 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 21:37:29 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 21:37:44 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]
2021/12/23 21:37:59 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:38} {Name:#primary Bucket:hello-world Completion:100}]

DCP Stream statuses:

vbucket curr owner:


2021/12/23 21:38:14 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:38:14 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/23 21:38:14 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 21:38:19 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:

vbucket curr owner:


2021/12/23 21:38:19 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:38:19 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 21:38:20 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 21:38:25 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:

vbucket curr owner:


2021/12/23 21:38:25 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:38:30 clusterSetup.go:397: Waiting for app: TestBucketDeleteWithRebOut to get un-deployed
2021/12/23 21:38:30 clusterSetup.go:405: App: TestBucketDeleteWithRebOut got un-deployed
2021/12/23 21:38:30 eventingSetup.go:46: No eventing-con process running
2021/12/23 21:38:30 eventingSetup.go:418: Function: TestBucketDeleteWithRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketDeleteWithRebOut not found"
}
2021/12/23 21:38:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:38:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:38:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:38:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:38:48 eventingSetup.go:125: Deploying app: TestBucketDeleteWithRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:38:49 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteWithRebOut stored in temp store"
}
2021/12/23 21:38:54 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/23 21:38:59 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/23 21:39:04 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/23 21:39:09 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2021/12/23 21:39:09 clusterSetup.go:354: App: TestBucketDeleteWithRebOut got deployed

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: 8648489f6055120ac6bf1412a467218b
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [114-227]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 114
	v: [228-341]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [0-113]
Producer node: 172.31.2.134:9300	Node UUID: 46f5cce582c7a7ef25d2d3ba9d54a25a
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [911-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [683-796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [797-910]
Producer node: 127.0.0.1:9303	Node UUID: d1b3af527ea277cc77d0c2ec3174e2d6
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [342-455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [456-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [570-682]


2021/12/23 21:39:09 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:39:09 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/23 21:39:14 Rebalance progress: 29.16666666666666
2021/12/23 21:39:19 Rebalance progress: 29.16666666666666
2021/12/23 21:39:24 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: 8648489f6055120ac6bf1412a467218b
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 114
	v: [228-341]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [0-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [114-227]
Producer node: 172.31.2.134:9300	Node UUID: 46f5cce582c7a7ef25d2d3ba9d54a25a
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [683-796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [797-910]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [911-1023]
Producer node: 127.0.0.1:9303	Node UUID: d1b3af527ea277cc77d0c2ec3174e2d6
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [342-455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [456-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [570-682]


2021/12/23 21:39:24 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:39:24 handler_test.go:1674: Deleting source bucket: default
2021/12/23 21:39:26 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 21:39:26 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 21:39:31 Rebalance progress: 29.16666666666666
2021/12/23 21:39:36 Rebalance progress: 29.16666666666666
2021/12/23 21:39:41 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: stopped
	len: 122
	vb list dump: [0, 2, 22, 28, 38-39, 46, 57, 62, 72, 87, 101, 112-115, 124-125, 130, 137, 139, 150, 157-158, 160, 182, 190, 211, 226, 232, 235, 241, 245, 255, 277, 280, 286, 302, 307, 310, 319, 324, 356, 364, 367, 383-384, 402, 408, 411, 414, 427, 438, 440, 454, 457, 465, 469, 471, 479-480, 485, 487-488, 495, 497, 503, 505, 511, 571, 574-576, 585, 620, 640, 644, 651, 656, 670, 674, 686, 688, 692, 701, 704, 712, 720, 722, 731, 743, 750-751, 776, 784, 795, 804, 808-809, 817, 820, 825, 828, 845, 847, 868, 879, 883, 910, 918-920, 924, 941, 943-944, 952, 967, 973, 981, 994, 1004]
	stream status: running
	len: 902
	vb list dump: [1, 3-21, 23-27, 29-37, 40-45, 47-56, 58-61, 63-71, 73-86, 88-100, 102-111, 116-123, 126-129, 131-136, 138, 140-149, 151-156, 159, 161-181, 183-189, 191-210, 212-225, 227-231, 233-234, 236-240, 242-244, 246-254, 256-276, 278-279, 281-285, 287-301, 303-306, 308-309, 311-318, 320-323, 325-355, 357-363, 365-366, 368-382, 385-401, 403-407, 409-410, 412-413, 415-426, 428-437, 439, 441-453, 455-456, 458-464, 466-468, 470, 472-478, 481-484, 486, 489-494, 496, 498-502, 504, 506-510, 512-570, 572-573, 577-584, 586-619, 621-639, 641-643, 645-650, 652-655, 657-669, 671-673, 675-685, 687, 689-691, 693-700, 702-703, 705-711, 713-719, 721, 723-730, 732-742, 744-749, 752-775, 777-783, 785-794, 796-803, 805-807, 810-816, 818-819, 821-824, 826-827, 829-844, 846, 848-867, 869-878, 880-882, 884-909, 911-917, 921-923, 925-940, 942, 945-951, 953-966, 968-972, 974-980, 982-993, 995-1003, 1005-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: 8648489f6055120ac6bf1412a467218b
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 99
	v: [116-123, 126-129, 131-136, 138, 140-149, 151-156, 159, 161-181, 183-189, 191-210, 212-225, 227]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 101
	v: [228-231, 233-234, 236-240, 242-244, 246-254, 256-276, 278-279, 281-285, 287-301, 303-306, 308-309, 311-318, 320-323, 325-341]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 100
	v: [1, 3-21, 23-27, 29-37, 40-45, 47-56, 58-61, 63-71, 73-86, 88-100, 102-111]
Producer node: 172.31.2.134:9300	Node UUID: 46f5cce582c7a7ef25d2d3ba9d54a25a
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 100
	v: [911-917, 921-923, 925-940, 942, 945-951, 953-966, 968-972, 974-980, 982-993, 995-1003, 1005-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 99
	v: [683-685, 687, 689-691, 693-700, 702-703, 705-711, 713-719, 721, 723-730, 732-742, 744-749, 752-775, 777-783, 785-794, 796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 101
	v: [797-803, 805-807, 810-816, 818-819, 821-824, 826-827, 829-844, 846, 848-867, 869-878, 880-882, 884-909]
Producer node: 127.0.0.1:9303	Node UUID: d1b3af527ea277cc77d0c2ec3174e2d6
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 101
	v: [342-355, 357-363, 365-366, 368-382, 385-401, 403-407, 409-410, 412-413, 415-426, 428-437, 439, 441-453, 455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 100
	v: [456, 458-464, 466-468, 470, 472-478, 481-484, 486, 489-494, 496, 498-502, 504, 506-510, 512-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 101
	v: [570, 572-573, 577-584, 586-619, 621-639, 641-643, 645-650, 652-655, 657-669, 671-673, 675-682]


2021/12/23 21:39:42 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:39:47 eventingSetup.go:719: Waiting for function: TestBucketDeleteWithRebOut status to change to undeployed
2021/12/23 21:39:47 eventingSetup.go:727: Function: TestBucketDeleteWithRebOut status changed to undeployed
2021/12/23 21:39:52 clusterSetup.go:397: Waiting for app: TestBucketDeleteWithRebOut to get un-deployed
2021/12/23 21:39:52 clusterSetup.go:405: App: TestBucketDeleteWithRebOut got un-deployed
2021/12/23 21:39:52 eventingSetup.go:46: No eventing-con process running
2021/12/23 21:39:52 eventingSetup.go:418: Function: TestBucketDeleteWithRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteWithRebOut deleting in background"
}
2021/12/23 21:39:53 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:39:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:40:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:40:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:40:05 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2021/12/23 21:40:06 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 21:40:11 Rebalance progress: 100
--- PASS: TestBucketDeleteWithRebOut (282.66s)
=== RUN   TestN1QLRecursion
2021/12/23 21:40:14 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/23 21:40:14 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2021/12/23 21:40:14 Removing node(s): [] from the cluster
2021/12/23 21:40:19 Rebalance progress: 100
2021/12/23 21:40:25 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:40:31 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:40:37 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:40:42 Deploying app: TestN1QLRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:40:43 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 stored in temp store"
}
2021/12/23 21:40:43 response body {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 stored in temp store"
} err 
2021/12/23 21:40:48 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/23 21:40:53 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/23 21:40:58 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/23 21:41:03 Waiting for app: TestN1QLRecursion_function1 to get deployed
2021/12/23 21:41:03 App: TestN1QLRecursion_function1 got deployed
2021/12/23 21:41:03 TestN1QLRecursion_function1 is deployed
2021/12/23 21:41:03 Deploying app: TestN1QLRecursion_function3. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:41:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 stored in temp store"
}
2021/12/23 21:41:04 response body {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 stored in temp store"
} err 
2021/12/23 21:41:09 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/23 21:41:14 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/23 21:41:19 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/23 21:41:24 Waiting for app: TestN1QLRecursion_function3 to get deployed
2021/12/23 21:41:24 App: TestN1QLRecursion_function3 got deployed
2021/12/23 21:41:24 TestN1QLRecursion_function3 is deployed
2021/12/23 21:41:24 Deploying app: TestN1QLRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:41:24 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestN1QLRecursion_function2 causes a cycle involving functions: [TestN1QLRecursion_function3 TestN1QLRecursion_function1], hence deployment is disallowed"
}
2021/12/23 21:41:24 response body {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestN1QLRecursion_function2 causes a cycle involving functions: [TestN1QLRecursion_function3 TestN1QLRecursion_function1], hence deployment is disallowed"
} err 
2021/12/23 21:41:24 Success: TestN1QLRecursion_function2 is not deployed
2021/12/23 21:41:29 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/23 21:41:34 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/23 21:41:39 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/23 21:41:44 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2021/12/23 21:41:44 App: TestN1QLRecursion_function1 got un-deployed
2021/12/23 21:41:44 No eventing-con process running
2021/12/23 21:41:45 Function: TestN1QLRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 deleting in background"
}
2021/12/23 21:41:46 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:41:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:41:53 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:41:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:42:03 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/23 21:42:08 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/23 21:42:13 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/23 21:42:18 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2021/12/23 21:42:18 App: TestN1QLRecursion_function3 got un-deployed
2021/12/23 21:42:18 No eventing-con process running
2021/12/23 21:42:18 Function: TestN1QLRecursion_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 deleting in background"
}
2021/12/23 21:42:20 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:42:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:42:27 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:42:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:42:34 Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/23 21:42:39 Rebalance progress: 100
--- PASS: TestN1QLRecursion (145.02s)
=== RUN   TestN1QLAllowRecursion
2021/12/23 21:42:39 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/23 21:42:40 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2021/12/23 21:42:40 Removing node(s): [] from the cluster
2021/12/23 21:42:45 Rebalance progress: 100
2021/12/23 21:42:50 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:42:56 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:43:03 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:43:08 Deploying app: TestN1QLAllowRecursion_function1. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:43:09 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 stored in temp store"
}
2021/12/23 21:43:09 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 stored in temp store"
} err 
2021/12/23 21:43:14 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/23 21:43:19 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/23 21:43:24 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/23 21:43:29 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2021/12/23 21:43:29 App: TestN1QLAllowRecursion_function1 got deployed
2021/12/23 21:43:29 TestN1QLAllowRecursion_function1 is deployed
2021/12/23 21:43:29 Deploying app: TestN1QLAllowRecursion_function3. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:43:30 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 stored in temp store"
}
2021/12/23 21:43:30 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 stored in temp store"
} err 
2021/12/23 21:43:35 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/23 21:43:40 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/23 21:43:45 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/23 21:43:50 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2021/12/23 21:43:50 App: TestN1QLAllowRecursion_function3 got deployed
2021/12/23 21:43:50 TestN1QLAllowRecursion_function3 is deployed
2021/12/23 21:43:50 Deploying app: TestN1QLAllowRecursion_function2. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:43:51 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 stored in temp store"
}
2021/12/23 21:43:51 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 stored in temp store"
} err 
2021/12/23 21:43:56 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/23 21:44:01 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/23 21:44:06 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/23 21:44:11 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2021/12/23 21:44:11 App: TestN1QLAllowRecursion_function2 got deployed
2021/12/23 21:44:11 Success: TestN1QLAllowRecursion_function2 is deployed after allow_interbucket_recursion
2021/12/23 21:44:17 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/23 21:44:22 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/23 21:44:27 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/23 21:44:32 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2021/12/23 21:44:32 App: TestN1QLAllowRecursion_function1 got un-deployed
2021/12/23 21:44:32 No eventing-con process running
2021/12/23 21:44:32 Function: TestN1QLAllowRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 deleting in background"
}
2021/12/23 21:44:33 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:44:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:44:40 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:44:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:44:51 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/23 21:44:56 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/23 21:45:01 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/23 21:45:06 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2021/12/23 21:45:06 App: TestN1QLAllowRecursion_function2 got un-deployed
2021/12/23 21:45:06 No eventing-con process running
2021/12/23 21:45:06 Function: TestN1QLAllowRecursion_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 deleting in background"
}
2021/12/23 21:45:08 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:45:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:45:14 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:45:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:45:25 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2021/12/23 21:45:30 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2021/12/23 21:45:35 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2021/12/23 21:45:40 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2021/12/23 21:45:40 App: TestN1QLAllowRecursion_function3 got un-deployed
2021/12/23 21:45:40 No eventing-con process running
2021/12/23 21:45:40 Function: TestN1QLAllowRecursion_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 deleting in background"
}
2021/12/23 21:45:42 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:45:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:45:48 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:45:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:45:55 Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/23 21:46:00 Rebalance progress: 100
--- PASS: TestN1QLAllowRecursion (201.18s)
=== RUN   TestOnDeleteExpiryBucketOp
2021/12/23 21:46:00 Sleeping for some time
2021/12/23 21:46:10 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/23 21:46:10 App: TestOnDeleteExpiryBucketOp got un-deployed
2021/12/23 21:46:10 No eventing-con process running
2021/12/23 21:46:10 Function: TestOnDeleteExpiryBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteExpiryBucketOp not found"
}
2021/12/23 21:46:12 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:46:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:46:18 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:46:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:46:23 Deploying app: TestOnDeleteExpiryBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:46:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteExpiryBucketOp stored in temp store"
}
2021/12/23 21:46:25 Starting bucket ops to source bucket
2021/12/23 21:47:14 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 21:47:19 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 21:47:24 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2021/12/23 21:47:24 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 21:47:24 Starting bucket ops to source bucket
2021/12/23 21:47:25 Starting bucket ops to source bucket
2021/12/23 21:48:31 Waiting for dst bucket item count to get to: 7000 curr count: 5000
2021/12/23 21:48:31 src & dst bucket item count matched up. src bucket count: 7000 dst bucket count: 7000
2021/12/23 21:48:31 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:48:36 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/23 21:48:41 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/23 21:48:46 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/23 21:48:51 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2021/12/23 21:48:51 App: TestOnDeleteExpiryBucketOp got un-deployed
2021/12/23 21:48:51 No eventing-con process running
2021/12/23 21:48:51 Function: TestOnDeleteExpiryBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteExpiryBucketOp deleting in background"
}
2021/12/23 21:48:53 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:49:03 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/23 21:49:08 Waiting for dst bucket item count to get to: 0 curr count: 501
2021/12/23 21:49:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:49:10 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:49:20 Waiting for dst bucket item count to get to: 0 curr count: 3500
2021/12/23 21:49:25 Waiting for dst bucket item count to get to: 0 curr count: 3500
2021/12/23 21:49:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteExpiryBucketOp (204.93s)
=== RUN   TestTimerOverWriteSameReference
2021/12/23 21:49:30 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/23 21:49:30 App: TestTimerOverWriteSameReference got un-deployed
2021/12/23 21:49:30 No eventing-con process running
2021/12/23 21:49:30 Function: TestTimerOverWriteSameReference delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerOverWriteSameReference not found"
}
2021/12/23 21:49:31 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:49:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:49:38 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:49:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:49:43 Deploying app: TestTimerOverWriteSameReference. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:49:44 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverWriteSameReference stored in temp store"
}
2021/12/23 21:49:49 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/23 21:49:54 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/23 21:49:59 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/23 21:50:05 Waiting for app: TestTimerOverWriteSameReference to get deployed
2021/12/23 21:50:05 App: TestTimerOverWriteSameReference got deployed
2021/12/23 21:50:15 Starting bucket ops to source bucket
2021/12/23 21:51:16 src & dst bucket item count matched up. src bucket count: 1 dst bucket count: 1
2021/12/23 21:51:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:51:31 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/23 21:51:36 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/23 21:51:41 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/23 21:51:46 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2021/12/23 21:51:46 App: TestTimerOverWriteSameReference got un-deployed
2021/12/23 21:51:46 No eventing-con process running
2021/12/23 21:51:46 Function: TestTimerOverWriteSameReference delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverWriteSameReference deleting in background"
}
2021/12/23 21:51:48 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:51:58 Waiting for dst bucket item count to get to: 0 curr count: 581
2021/12/23 21:52:03 Waiting for dst bucket item count to get to: 0 curr count: 81
2021/12/23 21:52:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:52:05 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:52:15 Waiting for dst bucket item count to get to: 0 curr count: 1
2021/12/23 21:52:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerOverWriteSameReference (169.90s)
=== RUN   TestCancelTimerBucketop
2021/12/23 21:52:20 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/23 21:52:20 App: TestCancelTimerBucketop got un-deployed
2021/12/23 21:52:20 No eventing-con process running
2021/12/23 21:52:20 Function: TestCancelTimerBucketop delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCancelTimerBucketop not found"
}
2021/12/23 21:52:21 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:52:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:52:28 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:52:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:52:33 Deploying app: TestCancelTimerBucketop. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:52:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCancelTimerBucketop stored in temp store"
}
2021/12/23 21:52:39 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/23 21:52:44 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/23 21:52:49 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/23 21:52:54 Waiting for app: TestCancelTimerBucketop to get deployed
2021/12/23 21:52:54 App: TestCancelTimerBucketop got deployed
2021/12/23 21:52:54 Starting bucket ops to source bucket
2021/12/23 21:53:02 Starting bucket ops to source bucket
2021/12/23 21:54:04 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/23 21:54:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:54:09 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/23 21:54:14 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/23 21:54:19 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/23 21:54:24 Waiting for app: TestCancelTimerBucketop to get un-deployed
2021/12/23 21:54:24 App: TestCancelTimerBucketop got un-deployed
2021/12/23 21:54:24 No eventing-con process running
2021/12/23 21:54:24 Function: TestCancelTimerBucketop delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCancelTimerBucketop deleting in background"
}
2021/12/23 21:54:26 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:54:36 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/23 21:54:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:54:38 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:54:48 Waiting for dst bucket item count to get to: 0 curr count: 653
2021/12/23 21:54:53 Waiting for dst bucket item count to get to: 0 curr count: 153
2021/12/23 21:54:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCancelTimerBucketop (158.34s)
=== RUN   TestJSExpiryDate
2021/12/23 21:54:58 Starting bucket ops to source bucket
2021/12/23 21:55:16 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 21:55:16 Deploying app: TestJSExpiryDate. Item count src bucket: 5000 dst bucket: 0
2021/12/23 21:55:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestJSExpiryDate stored in temp store"
}
2021/12/23 21:55:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:55:47 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:55:52 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/23 21:55:57 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/23 21:56:02 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/23 21:56:07 Waiting for app: TestJSExpiryDate to get un-deployed
2021/12/23 21:56:08 App: TestJSExpiryDate got un-deployed
2021/12/23 21:56:08 No eventing-con process running
2021/12/23 21:56:08 Function: TestJSExpiryDate delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestJSExpiryDate deleting in background"
}
2021/12/23 21:56:09 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:56:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:56:17 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:56:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestJSExpiryDate (88.94s)
=== RUN   TestBinaryDoc
2021/12/23 21:56:27 Starting bucket ops to source bucket
2021/12/23 21:56:27 Deploying app: TestBinaryDoc. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:56:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBinaryDoc stored in temp store"
}
2021/12/23 21:56:28 Starting bucket ops to source bucket
2021/12/23 21:56:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:56:28 Deleting source bucket docs now
2021/12/23 21:56:28 Starting bucket ops to source bucket
2021/12/23 21:57:05 Waiting for dst bucket item count to get to: 32 curr count: 24
2021/12/23 21:57:10 Waiting for dst bucket item count to get to: 32 curr count: 29
2021/12/23 21:57:15 Waiting for dst bucket item count to get to: 32 curr count: 31
2021/12/23 21:57:15 src & dst bucket item count matched up. src bucket count: 32 dst bucket count: 32
2021/12/23 21:57:15 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:57:21 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/23 21:57:26 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/23 21:57:31 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/23 21:57:36 Waiting for app: TestBinaryDoc to get un-deployed
2021/12/23 21:57:36 App: TestBinaryDoc got un-deployed
2021/12/23 21:57:36 No eventing-con process running
2021/12/23 21:57:36 Function: TestBinaryDoc delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBinaryDoc deleting in background"
}
2021/12/23 21:57:37 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:57:47 Waiting for dst bucket item count to get to: 0 curr count: 18
2021/12/23 21:57:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:57:49 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:57:59 Waiting for dst bucket item count to get to: 0 curr count: 32
2021/12/23 21:58:04 Waiting for dst bucket item count to get to: 0 curr count: 16
2021/12/23 21:58:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBinaryDoc (102.40s)
=== RUN   TestConstantBindings
2021/12/23 21:58:04 Deploying app: TestConstantBindings. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:58:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestConstantBindings stored in temp store"
}
2021/12/23 21:58:05 Starting bucket ops to source bucket
2021/12/23 21:58:11 Waiting for dst bucket item count to get to: 6000 curr count: 0
2021/12/23 21:58:16 Waiting for dst bucket item count to get to: 6000 curr count: 0
2021/12/23 21:58:21 Waiting for dst bucket item count to get to: 6000 curr count: 0
2021/12/23 21:58:26 Waiting for dst bucket item count to get to: 6000 curr count: 3183
2021/12/23 21:58:31 Waiting for dst bucket item count to get to: 6000 curr count: 3183
2021/12/23 21:58:31 src & dst bucket item count matched up. src bucket count: 6000 dst bucket count: 6000
2021/12/23 21:58:31 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 21:58:36 Waiting for app: TestConstantBindings to get un-deployed
2021/12/23 21:58:41 Waiting for app: TestConstantBindings to get un-deployed
2021/12/23 21:58:46 Waiting for app: TestConstantBindings to get un-deployed
2021/12/23 21:58:51 Waiting for app: TestConstantBindings to get un-deployed
2021/12/23 21:58:51 App: TestConstantBindings got un-deployed
2021/12/23 21:58:51 No eventing-con process running
2021/12/23 21:58:52 Function: TestConstantBindings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestConstantBindings deleting in background"
}
2021/12/23 21:58:53 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:59:03 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/23 21:59:08 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/23 21:59:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:59:10 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:59:20 Waiting for dst bucket item count to get to: 0 curr count: 3981
2021/12/23 21:59:25 Waiting for dst bucket item count to get to: 0 curr count: 3981
2021/12/23 21:59:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestConstantBindings (80.86s)
=== RUN   TestCodeInsight
2021/12/23 21:59:30 Waiting for app: TestCodeInsight to get un-deployed
2021/12/23 21:59:30 App: TestCodeInsight got un-deployed
2021/12/23 21:59:30 No eventing-con process running
2021/12/23 21:59:30 Function: TestCodeInsight delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCodeInsight not found"
}
2021/12/23 21:59:32 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:59:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:59:39 Context: Bucket flush, response code: 200 dump: 
2021/12/23 21:59:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 21:59:44 Starting bucket ops to source bucket
2021/12/23 21:59:44 Deploying app: TestCodeInsight. Item count src bucket: 0 dst bucket: 0
2021/12/23 21:59:45 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCodeInsight stored in temp store"
}
2021/12/23 21:59:50 Waiting for app: TestCodeInsight to get deployed
2021/12/23 21:59:56 Waiting for app: TestCodeInsight to get deployed
2021/12/23 22:00:01 Waiting for app: TestCodeInsight to get deployed
2021/12/23 22:00:06 Waiting for app: TestCodeInsight to get deployed
2021/12/23 22:00:06 App: TestCodeInsight got deployed
2021/12/23 22:00:11 Waiting for dst bucket item count to get to: 1000 curr count: 504
2021/12/23 22:00:11 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/23 22:00:16 Waiting for app: TestCodeInsight to get un-deployed
2021/12/23 22:00:21 Waiting for app: TestCodeInsight to get un-deployed
2021/12/23 22:00:26 Waiting for app: TestCodeInsight to get un-deployed
2021/12/23 22:00:31 Waiting for app: TestCodeInsight to get un-deployed
2021/12/23 22:00:31 App: TestCodeInsight got un-deployed
2021/12/23 22:00:31 No eventing-con process running
2021/12/23 22:00:31 Function: TestCodeInsight delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCodeInsight deleting in background"
}
2021/12/23 22:00:33 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:00:43 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/23 22:00:48 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/23 22:00:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:00:50 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:01:00 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/23 22:01:05 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/23 22:01:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCodeInsight (99.41s)
=== RUN   TestParserTransform
--- PASS: TestParserTransform (0.04s)
=== RUN   TestParserDetect
--- PASS: TestParserDetect (0.00s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	12752.629s

Functional tests took 3 hours, 32 minutes and 35 seconds.

N1ql tests

2021/12/23 22:01:13 Started n1ql
2021/12/23 22:01:23 Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2021/12/23 22:01:23 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2021/12/23 22:01:23 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 22:01:23 Removing node(s): [] from the cluster
2021/12/23 22:01:28 Rebalance progress: 100
=== RUN   TestRecursiveMutationN1QL
2021/12/23 22:01:33 Waiting for app: TestRecursiveMutationN1QL to get un-deployed
2021/12/23 22:01:33 App: TestRecursiveMutationN1QL got un-deployed
2021/12/23 22:01:33 No eventing-con process running
2021/12/23 22:01:33 Function: TestRecursiveMutationN1QL delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestRecursiveMutationN1QL not found"
}
2021/12/23 22:01:35 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:01:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:01:42 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:01:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:01:47 Deploying app: TestRecursiveMutationN1QL. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:01:47 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Function: TestRecursiveMutationN1QL N1QL DML to source keyspace default:default"
}
--- PASS: TestRecursiveMutationN1QL (18.47s)
=== RUN   TestFlexReset1
2021/12/23 22:01:52 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/23 22:01:52 App: TestFlexReset1 got un-deployed
2021/12/23 22:01:52 No eventing-con process running
2021/12/23 22:01:52 Function: TestFlexReset1 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestFlexReset1 not found"
}
2021/12/23 22:01:54 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:01:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:02:00 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:02:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:02:05 Starting bucket ops to source bucket
2021/12/23 22:02:06 Deploying app: TestFlexReset1. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:02:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset1 stored in temp store"
}
2021/12/23 22:02:12 Waiting for app: TestFlexReset1 to get deployed
2021/12/23 22:02:17 Waiting for app: TestFlexReset1 to get deployed
2021/12/23 22:02:22 Waiting for app: TestFlexReset1 to get deployed
2021/12/23 22:02:27 Waiting for app: TestFlexReset1 to get deployed
2021/12/23 22:02:27 App: TestFlexReset1 got deployed
2021/12/23 22:02:32 Waiting for dst bucket item count to get to: 1000 curr count: 52
2021/12/23 22:02:32 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/23 22:02:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 22:02:37 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/23 22:02:43 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/23 22:02:48 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/23 22:02:53 Waiting for app: TestFlexReset1 to get un-deployed
2021/12/23 22:02:53 App: TestFlexReset1 got un-deployed
2021/12/23 22:02:53 No eventing-con process running
2021/12/23 22:02:53 Function: TestFlexReset1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset1 deleting in background"
}
2021/12/23 22:02:54 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:03:04 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/23 22:03:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:03:06 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:03:16 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/23 22:03:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestFlexReset1 (89.41s)
=== RUN   TestFlexReset2
2021/12/23 22:03:21 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/23 22:03:21 App: TestFlexReset2 got un-deployed
2021/12/23 22:03:21 No eventing-con process running
2021/12/23 22:03:21 Function: TestFlexReset2 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestFlexReset2 not found"
}
2021/12/23 22:03:23 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:03:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:03:30 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:03:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:03:35 Starting bucket ops to source bucket
2021/12/23 22:03:35 Deploying app: TestFlexReset2. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:03:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset2 stored in temp store"
}
2021/12/23 22:03:42 Waiting for app: TestFlexReset2 to get deployed
2021/12/23 22:03:47 Waiting for app: TestFlexReset2 to get deployed
2021/12/23 22:03:52 Waiting for app: TestFlexReset2 to get deployed
2021/12/23 22:03:57 Waiting for app: TestFlexReset2 to get deployed
2021/12/23 22:03:57 App: TestFlexReset2 got deployed
2021/12/23 22:04:02 Waiting for dst bucket item count to get to: 1000 curr count: 81
2021/12/23 22:04:02 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2021/12/23 22:04:02 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 22:04:07 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/23 22:04:12 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/23 22:04:17 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/23 22:04:22 Waiting for app: TestFlexReset2 to get un-deployed
2021/12/23 22:04:22 App: TestFlexReset2 got un-deployed
2021/12/23 22:04:22 No eventing-con process running
2021/12/23 22:04:22 Function: TestFlexReset2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset2 deleting in background"
}
2021/12/23 22:04:24 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:04:34 Waiting for dst bucket item count to get to: 0 curr count: 1000
2021/12/23 22:04:39 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/23 22:04:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:04:40 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:04:50 Waiting for dst bucket item count to get to: 0 curr count: 838
2021/12/23 22:04:55 Waiting for dst bucket item count to get to: 0 curr count: 838
2021/12/23 22:04:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestFlexReset2 (99.35s)
=== RUN   TestN1QLLabelledBreak
2021/12/23 22:05:01 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/23 22:05:01 App: TestN1QLLabelledBreak got un-deployed
2021/12/23 22:05:01 No eventing-con process running
2021/12/23 22:05:01 Function: TestN1QLLabelledBreak delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLLabelledBreak not found"
}
2021/12/23 22:05:02 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:05:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:05:09 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:05:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:05:14 Deploying app: TestN1QLLabelledBreak. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:05:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLLabelledBreak stored in temp store"
}
2021/12/23 22:05:20 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/23 22:05:25 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/23 22:05:30 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/23 22:05:35 Waiting for app: TestN1QLLabelledBreak to get deployed
2021/12/23 22:05:35 App: TestN1QLLabelledBreak got deployed
2021/12/23 22:05:35 Starting bucket ops to source bucket
2021/12/23 22:05:45 Waiting for dst bucket item count to get to: 10000 curr count: 377
2021/12/23 22:05:50 Waiting for dst bucket item count to get to: 10000 curr count: 377
2021/12/23 22:05:55 Waiting for dst bucket item count to get to: 10000 curr count: 377
2021/12/23 22:06:00 Waiting for dst bucket item count to get to: 10000 curr count: 3954
2021/12/23 22:06:05 Waiting for dst bucket item count to get to: 10000 curr count: 3954
2021/12/23 22:06:10 Waiting for dst bucket item count to get to: 10000 curr count: 7988
2021/12/23 22:06:15 Waiting for dst bucket item count to get to: 10000 curr count: 7988
2021/12/23 22:06:15 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/23 22:06:15 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 22:06:20 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/23 22:06:25 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/23 22:06:30 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/23 22:06:35 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2021/12/23 22:06:35 App: TestN1QLLabelledBreak got un-deployed
2021/12/23 22:06:35 No eventing-con process running
2021/12/23 22:06:35 Function: TestN1QLLabelledBreak delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLLabelledBreak deleting in background"
}
2021/12/23 22:06:37 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:06:47 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 22:06:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:06:49 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:06:59 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/23 22:07:04 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 22:07:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLLabelledBreak (128.40s)
=== RUN   TestN1QLUnlabelledBreak
2021/12/23 22:07:09 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/23 22:07:09 App: TestN1QLUnlabelledBreak got un-deployed
2021/12/23 22:07:09 No eventing-con process running
2021/12/23 22:07:09 Function: TestN1QLUnlabelledBreak delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLUnlabelledBreak not found"
}
2021/12/23 22:07:11 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:07:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:07:17 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:07:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:07:22 Deploying app: TestN1QLUnlabelledBreak. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:07:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLUnlabelledBreak stored in temp store"
}
2021/12/23 22:07:29 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/23 22:07:34 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/23 22:07:39 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/23 22:07:44 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2021/12/23 22:07:44 App: TestN1QLUnlabelledBreak got deployed
2021/12/23 22:07:44 Starting bucket ops to source bucket
2021/12/23 22:07:53 Waiting for dst bucket item count to get to: 10000 curr count: 364
2021/12/23 22:07:58 Waiting for dst bucket item count to get to: 10000 curr count: 1117
2021/12/23 22:08:03 Waiting for dst bucket item count to get to: 10000 curr count: 1117
2021/12/23 22:08:08 Waiting for dst bucket item count to get to: 10000 curr count: 3763
2021/12/23 22:08:13 Waiting for dst bucket item count to get to: 10000 curr count: 6632
2021/12/23 22:08:18 Waiting for dst bucket item count to get to: 10000 curr count: 8622
2021/12/23 22:08:18 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/23 22:08:18 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 22:08:23 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/23 22:08:29 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/23 22:08:34 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/23 22:08:39 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2021/12/23 22:08:39 App: TestN1QLUnlabelledBreak got un-deployed
2021/12/23 22:08:39 No eventing-con process running
2021/12/23 22:08:39 Function: TestN1QLUnlabelledBreak delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLUnlabelledBreak deleting in background"
}
2021/12/23 22:08:40 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:08:50 Waiting for dst bucket item count to get to: 0 curr count: 4156
2021/12/23 22:08:55 Waiting for dst bucket item count to get to: 0 curr count: 4156
2021/12/23 22:08:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:08:57 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:09:07 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/23 22:09:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLUnlabelledBreak (123.31s)
=== RUN   TestN1QLThrowStatement
2021/12/23 22:09:12 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/23 22:09:12 App: TestN1QLThrowStatement got un-deployed
2021/12/23 22:09:12 No eventing-con process running
2021/12/23 22:09:12 Function: TestN1QLThrowStatement delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLThrowStatement not found"
}
2021/12/23 22:09:14 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:09:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:09:21 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:09:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:09:26 Deploying app: TestN1QLThrowStatement. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:09:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLThrowStatement stored in temp store"
}
2021/12/23 22:09:32 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/23 22:09:37 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/23 22:09:42 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/23 22:09:47 Waiting for app: TestN1QLThrowStatement to get deployed
2021/12/23 22:09:47 App: TestN1QLThrowStatement got deployed
2021/12/23 22:09:47 Starting bucket ops to source bucket
2021/12/23 22:09:57 Waiting for dst bucket item count to get to: 10000 curr count: 137
2021/12/23 22:10:02 Waiting for dst bucket item count to get to: 10000 curr count: 137
2021/12/23 22:10:07 Waiting for dst bucket item count to get to: 10000 curr count: 137
2021/12/23 22:10:12 Waiting for dst bucket item count to get to: 10000 curr count: 3256
2021/12/23 22:10:17 Waiting for dst bucket item count to get to: 10000 curr count: 3256
2021/12/23 22:10:22 Waiting for dst bucket item count to get to: 10000 curr count: 7272
2021/12/23 22:10:27 Waiting for dst bucket item count to get to: 10000 curr count: 7272
2021/12/23 22:10:27 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2021/12/23 22:10:27 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 22:10:32 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/23 22:10:37 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/23 22:10:42 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/23 22:10:47 Waiting for app: TestN1QLThrowStatement to get un-deployed
2021/12/23 22:10:47 App: TestN1QLThrowStatement got un-deployed
2021/12/23 22:10:47 No eventing-con process running
2021/12/23 22:10:47 Function: TestN1QLThrowStatement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLThrowStatement deleting in background"
}
2021/12/23 22:10:49 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:10:59 Waiting for dst bucket item count to get to: 0 curr count: 4870
2021/12/23 22:11:04 Waiting for dst bucket item count to get to: 0 curr count: 2370
2021/12/23 22:11:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:11:06 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:11:16 Waiting for dst bucket item count to get to: 0 curr count: 10000
2021/12/23 22:11:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLThrowStatement (128.46s)
=== RUN   TestN1QLNestedForLoop
2021/12/23 22:11:21 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/23 22:11:21 App: TestN1QLNestedForLoop got un-deployed
2021/12/23 22:11:21 No eventing-con process running
2021/12/23 22:11:21 Function: TestN1QLNestedForLoop delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLNestedForLoop not found"
}
2021/12/23 22:11:22 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:11:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:11:29 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:11:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:11:34 Deploying app: TestN1QLNestedForLoop. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:11:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLNestedForLoop stored in temp store"
}
2021/12/23 22:11:40 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/23 22:11:45 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/23 22:11:50 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/23 22:11:55 Waiting for app: TestN1QLNestedForLoop to get deployed
2021/12/23 22:11:55 App: TestN1QLNestedForLoop got deployed
2021/12/23 22:11:55 Starting bucket ops to source bucket
2021/12/23 22:12:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2021/12/23 22:12:10 Waiting for dst bucket item count to get to: 5000 curr count: 196
2021/12/23 22:12:15 Waiting for dst bucket item count to get to: 5000 curr count: 196
2021/12/23 22:12:20 Waiting for dst bucket item count to get to: 5000 curr count: 2341
2021/12/23 22:12:25 Waiting for dst bucket item count to get to: 5000 curr count: 2341
2021/12/23 22:12:30 Waiting for dst bucket item count to get to: 5000 curr count: 4740
2021/12/23 22:12:35 Waiting for dst bucket item count to get to: 5000 curr count: 4740
2021/12/23 22:12:35 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 22:12:35 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 22:12:40 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/23 22:12:45 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/23 22:12:50 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2021/12/23 22:12:50 App: TestN1QLNestedForLoop got un-deployed
2021/12/23 22:12:50 No eventing-con process running
2021/12/23 22:12:50 Function: TestN1QLNestedForLoop delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLNestedForLoop deleting in background"
}
2021/12/23 22:12:52 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:13:02 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 22:13:07 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 22:13:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:13:09 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:13:19 Waiting for dst bucket item count to get to: 0 curr count: 4956
2021/12/23 22:13:24 Waiting for dst bucket item count to get to: 0 curr count: 2456
2021/12/23 22:13:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLNestedForLoop (128.20s)
=== RUN   TestN1QLAutoClose
2021/12/23 22:13:29 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/23 22:13:29 App: TestN1QLAutoClose got un-deployed
2021/12/23 22:13:29 No eventing-con process running
2021/12/23 22:13:29 Function: TestN1QLAutoClose delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLAutoClose not found"
}
2021/12/23 22:13:31 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:13:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:13:37 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:13:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:13:42 Deploying app: TestN1QLAutoClose. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:13:44 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAutoClose stored in temp store"
}
2021/12/23 22:13:49 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/23 22:13:54 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/23 22:13:59 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/23 22:14:04 Waiting for app: TestN1QLAutoClose to get deployed
2021/12/23 22:14:04 App: TestN1QLAutoClose got deployed
2021/12/23 22:14:04 Starting bucket ops to source bucket
2021/12/23 22:14:09 Waiting for dst bucket item count to get to: 500 curr count: 0
2021/12/23 22:14:14 Waiting for dst bucket item count to get to: 500 curr count: 4
2021/12/23 22:14:19 Waiting for dst bucket item count to get to: 500 curr count: 10
2021/12/23 22:14:24 Waiting for dst bucket item count to get to: 500 curr count: 20
2021/12/23 22:14:29 Waiting for dst bucket item count to get to: 500 curr count: 31
2021/12/23 22:14:34 Waiting for dst bucket item count to get to: 500 curr count: 42
2021/12/23 22:14:39 Waiting for dst bucket item count to get to: 500 curr count: 54
2021/12/23 22:14:44 Waiting for dst bucket item count to get to: 500 curr count: 63
2021/12/23 22:14:49 Waiting for dst bucket item count to get to: 500 curr count: 75
2021/12/23 22:14:54 Waiting for dst bucket item count to get to: 500 curr count: 87
2021/12/23 22:14:59 Waiting for dst bucket item count to get to: 500 curr count: 97
2021/12/23 22:15:04 Waiting for dst bucket item count to get to: 500 curr count: 105
2021/12/23 22:15:09 Waiting for dst bucket item count to get to: 500 curr count: 118
2021/12/23 22:15:14 Waiting for dst bucket item count to get to: 500 curr count: 128
2021/12/23 22:15:19 Waiting for dst bucket item count to get to: 500 curr count: 128
2021/12/23 22:15:24 Waiting for dst bucket item count to get to: 500 curr count: 139
2021/12/23 22:15:29 Waiting for dst bucket item count to get to: 500 curr count: 149
2021/12/23 22:15:34 Waiting for dst bucket item count to get to: 500 curr count: 160
2021/12/23 22:15:39 Waiting for dst bucket item count to get to: 500 curr count: 181
2021/12/23 22:15:44 Waiting for dst bucket item count to get to: 500 curr count: 181
2021/12/23 22:15:49 Waiting for dst bucket item count to get to: 500 curr count: 205
2021/12/23 22:15:54 Waiting for dst bucket item count to get to: 500 curr count: 205
2021/12/23 22:15:59 Waiting for dst bucket item count to get to: 500 curr count: 227
2021/12/23 22:16:04 Waiting for dst bucket item count to get to: 500 curr count: 227
2021/12/23 22:16:09 Waiting for dst bucket item count to get to: 500 curr count: 247
2021/12/23 22:16:14 Waiting for dst bucket item count to get to: 500 curr count: 247
2021/12/23 22:16:19 Waiting for dst bucket item count to get to: 500 curr count: 269
2021/12/23 22:16:24 Waiting for dst bucket item count to get to: 500 curr count: 269
2021/12/23 22:16:29 Waiting for dst bucket item count to get to: 500 curr count: 289
2021/12/23 22:16:34 Waiting for dst bucket item count to get to: 500 curr count: 289
2021/12/23 22:16:40 Waiting for dst bucket item count to get to: 500 curr count: 311
2021/12/23 22:16:45 Waiting for dst bucket item count to get to: 500 curr count: 311
2021/12/23 22:16:50 Waiting for dst bucket item count to get to: 500 curr count: 332
2021/12/23 22:16:55 Waiting for dst bucket item count to get to: 500 curr count: 332
2021/12/23 22:17:00 Waiting for dst bucket item count to get to: 500 curr count: 354
2021/12/23 22:17:05 Waiting for dst bucket item count to get to: 500 curr count: 354
2021/12/23 22:17:10 Waiting for dst bucket item count to get to: 500 curr count: 373
2021/12/23 22:17:15 Waiting for dst bucket item count to get to: 500 curr count: 373
2021/12/23 22:17:20 Waiting for dst bucket item count to get to: 500 curr count: 392
2021/12/23 22:17:25 Waiting for dst bucket item count to get to: 500 curr count: 392
2021/12/23 22:17:30 Waiting for dst bucket item count to get to: 500 curr count: 414
2021/12/23 22:17:35 Waiting for dst bucket item count to get to: 500 curr count: 414
2021/12/23 22:17:40 Waiting for dst bucket item count to get to: 500 curr count: 434
2021/12/23 22:17:45 Waiting for dst bucket item count to get to: 500 curr count: 434
2021/12/23 22:17:50 Waiting for dst bucket item count to get to: 500 curr count: 456
2021/12/23 22:17:55 Waiting for dst bucket item count to get to: 500 curr count: 468
2021/12/23 22:18:00 Waiting for dst bucket item count to get to: 500 curr count: 479
2021/12/23 22:18:05 Waiting for dst bucket item count to get to: 500 curr count: 487
2021/12/23 22:18:10 Waiting for dst bucket item count to get to: 500 curr count: 497
2021/12/23 22:18:10 src & dst bucket item count matched up. src bucket count: 500 dst bucket count: 500
2021/12/23 22:18:10 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 22:18:15 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/23 22:18:20 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/23 22:18:25 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/23 22:18:30 Waiting for app: TestN1QLAutoClose to get un-deployed
2021/12/23 22:18:30 App: TestN1QLAutoClose got un-deployed
2021/12/23 22:18:30 No eventing-con process running
2021/12/23 22:18:30 Function: TestN1QLAutoClose delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAutoClose deleting in background"
}
2021/12/23 22:18:32 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:18:42 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/23 22:18:47 Waiting for dst bucket item count to get to: 0 curr count: 500
2021/12/23 22:18:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:18:49 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:18:59 Waiting for dst bucket item count to get to: 0 curr count: 450
2021/12/23 22:19:04 Waiting for dst bucket item count to get to: 0 curr count: 200
2021/12/23 22:19:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLAutoClose (339.75s)
=== RUN   TestN1QLPosParams
2021/12/23 22:19:09 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/23 22:19:09 App: TestN1QLPosParams got un-deployed
2021/12/23 22:19:09 No eventing-con process running
2021/12/23 22:19:09 Function: TestN1QLPosParams delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLPosParams not found"
}
2021/12/23 22:19:10 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:19:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:19:17 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:19:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:19:22 Deploying app: TestN1QLPosParams. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:19:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLPosParams stored in temp store"
}
2021/12/23 22:19:28 Waiting for app: TestN1QLPosParams to get deployed
2021/12/23 22:19:33 Waiting for app: TestN1QLPosParams to get deployed
2021/12/23 22:19:38 Waiting for app: TestN1QLPosParams to get deployed
2021/12/23 22:19:43 Waiting for app: TestN1QLPosParams to get deployed
2021/12/23 22:19:43 App: TestN1QLPosParams got deployed
2021/12/23 22:19:43 Starting bucket ops to source bucket
2021/12/23 22:19:53 Waiting for dst bucket item count to get to: 5000 curr count: 639
2021/12/23 22:19:58 Waiting for dst bucket item count to get to: 5000 curr count: 1921
2021/12/23 22:20:03 Waiting for dst bucket item count to get to: 5000 curr count: 3782
2021/12/23 22:20:03 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 22:20:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 22:20:08 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/23 22:20:13 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/23 22:20:18 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/23 22:20:23 Waiting for app: TestN1QLPosParams to get un-deployed
2021/12/23 22:20:23 App: TestN1QLPosParams got un-deployed
2021/12/23 22:20:23 No eventing-con process running
2021/12/23 22:20:23 Function: TestN1QLPosParams delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLPosParams deleting in background"
}
2021/12/23 22:20:25 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:20:35 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 22:20:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:20:37 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:20:47 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 22:20:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLPosParams (103.34s)
=== RUN   TestN1QLExhaustConnPool
2021/12/23 22:20:52 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/23 22:20:52 App: TestN1QLExhaustConnPool got un-deployed
2021/12/23 22:20:52 No eventing-con process running
2021/12/23 22:20:52 Function: TestN1QLExhaustConnPool delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLExhaustConnPool not found"
}
2021/12/23 22:20:54 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:20:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:21:01 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:21:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:21:06 Deploying app: TestN1QLExhaustConnPool. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:21:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLExhaustConnPool stored in temp store"
}
2021/12/23 22:21:12 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/23 22:21:17 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/23 22:21:22 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/23 22:21:27 Waiting for app: TestN1QLExhaustConnPool to get deployed
2021/12/23 22:21:27 App: TestN1QLExhaustConnPool got deployed
2021/12/23 22:21:27 Starting bucket ops to source bucket
2021/12/23 22:21:32 Waiting for dst bucket item count to get to: 100 curr count: 0
2021/12/23 22:21:37 Waiting for dst bucket item count to get to: 100 curr count: 40
2021/12/23 22:21:42 Waiting for dst bucket item count to get to: 100 curr count: 40
2021/12/23 22:21:42 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2021/12/23 22:21:42 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 22:21:47 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/23 22:21:52 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/23 22:21:57 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/23 22:22:02 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2021/12/23 22:22:02 App: TestN1QLExhaustConnPool got un-deployed
2021/12/23 22:22:02 No eventing-con process running
2021/12/23 22:22:02 Function: TestN1QLExhaustConnPool delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLExhaustConnPool deleting in background"
}
2021/12/23 22:22:04 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:22:14 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 22:22:19 Waiting for dst bucket item count to get to: 0 curr count: 50
2021/12/23 22:22:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:22:21 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:22:31 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 22:22:36 Waiting for dst bucket item count to get to: 0 curr count: 100
2021/12/23 22:22:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLExhaustConnPool (109.02s)
=== RUN   TestN1QLGraceSufficientTimeOut
2021/12/23 22:22:41 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/23 22:22:41 App: TestN1QLGraceSufficientTimeOut got un-deployed
2021/12/23 22:22:41 No eventing-con process running
2021/12/23 22:22:41 Function: TestN1QLGraceSufficientTimeOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLGraceSufficientTimeOut not found"
}
2021/12/23 22:22:43 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:22:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:22:49 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:22:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:22:54 Starting bucket ops to source bucket
2021/12/23 22:23:12 Starting bucket ops to source bucket
2021/12/23 22:23:29 Deploying app: TestN1QLGraceSufficientTimeOut. Item count src bucket: 30000 dst bucket: 11580
2021/12/23 22:23:30 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLGraceSufficientTimeOut stored in temp store"
}
2021/12/23 22:23:35 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/23 22:23:40 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/23 22:23:45 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/23 22:23:50 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2021/12/23 22:23:50 App: TestN1QLGraceSufficientTimeOut got deployed
2021/12/23 22:23:50 Starting bucket ops to source bucket
2021/12/23 22:23:55 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/23 22:24:00 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/23 22:24:05 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/23 22:24:10 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/23 22:24:15 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/23 22:24:20 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/23 22:24:25 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/23 22:24:30 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/23 22:24:35 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/23 22:24:40 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/23 22:24:45 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2021/12/23 22:24:45 src & dst bucket item count matched up. src bucket count: 30001 dst bucket count: 30001
2021/12/23 22:24:45 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 22:24:50 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/23 22:24:55 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/23 22:25:00 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2021/12/23 22:25:01 App: TestN1QLGraceSufficientTimeOut got un-deployed
2021/12/23 22:25:01 No eventing-con process running
2021/12/23 22:25:01 Function: TestN1QLGraceSufficientTimeOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLGraceSufficientTimeOut deleting in background"
}
2021/12/23 22:25:02 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:25:12 Waiting for dst bucket item count to get to: 0 curr count: 30000
2021/12/23 22:25:17 Waiting for dst bucket item count to get to: 0 curr count: 15000
2021/12/23 22:25:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:25:19 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:25:29 Waiting for dst bucket item count to get to: 0 curr count: 30001
2021/12/23 22:25:34 Waiting for dst bucket item count to get to: 0 curr count: 15001
2021/12/23 22:25:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLGraceSufficientTimeOut (178.19s)
=== RUN   TestN1QLQueryConsistency
2021/12/23 22:25:39 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/23 22:25:39 App: n1qlquery_consistency got un-deployed
2021/12/23 22:25:39 No eventing-con process running
2021/12/23 22:25:39 Function: n1qlquery_consistency delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: n1qlquery_consistency not found"
}
2021/12/23 22:25:41 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:25:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:25:48 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:25:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:25:53 Starting bucket ops to source bucket
2021/12/23 22:25:56 Deploying app: n1qlquery_consistency. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:25:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: n1qlquery_consistency stored in temp store"
}
2021/12/23 22:26:02 Waiting for app: n1qlquery_consistency to get deployed
2021/12/23 22:26:07 Waiting for app: n1qlquery_consistency to get deployed
2021/12/23 22:26:12 Waiting for app: n1qlquery_consistency to get deployed
2021/12/23 22:26:17 Waiting for app: n1qlquery_consistency to get deployed
2021/12/23 22:26:17 App: n1qlquery_consistency got deployed
2021/12/23 22:26:22 Waiting for dst bucket item count to get to: 5000 curr count: 122
2021/12/23 22:26:27 Waiting for dst bucket item count to get to: 5000 curr count: 2622
2021/12/23 22:26:27 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2021/12/23 22:26:27 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2021/12/23 22:26:32 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/23 22:26:37 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/23 22:26:42 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/23 22:26:47 Waiting for app: n1qlquery_consistency to get un-deployed
2021/12/23 22:26:47 App: n1qlquery_consistency got un-deployed
2021/12/23 22:26:47 No eventing-con process running
2021/12/23 22:26:47 Function: n1qlquery_consistency delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: n1qlquery_consistency deleting in background"
}
2021/12/23 22:26:49 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:26:59 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 22:27:04 Waiting for dst bucket item count to get to: 0 curr count: 2500
2021/12/23 22:27:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:27:06 Context: Bucket flush, response code: 200 dump: 
2021/12/23 22:27:16 Waiting for dst bucket item count to get to: 0 curr count: 5000
2021/12/23 22:27:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLQueryConsistency (101.91s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	1558.572s

N1ql tests took 0 hours, 26 minutes and 3 seconds.

Starting server
Starting server: attempt 1

Rebalance tests

2021/12/23 22:28:51 Started rebalance
Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:47144->127.0.0.1:9000: read: connection reset by peer
Quota setup Post "http://127.0.0.1:9000/pools/default": read tcp 127.0.0.1:47144->127.0.0.1:9000: read: connection reset by peer
=== RUN   TestDuplicateWithEventingRebIn
2021/12/23 22:29:10 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
running apps fetch error json: cannot unmarshal number into Go value of type string
2021/12/23 22:29:15 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/23 22:29:15 App: TestDuplicateWithEventingRebIn got un-deployed
2021/12/23 22:29:15 No eventing-con process running
2021/12/23 22:29:15 Function: TestDuplicateWithEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingRebIn not found"
}
2021/12/23 22:29:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:29:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:29:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:29:23 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:29:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:29:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:29:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:29:33 Deploying app: TestDuplicateWithEventingRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:29:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebIn stored in temp store"
}
2021/12/23 22:29:39 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/23 22:29:44 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/23 22:29:49 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/23 22:29:54 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2021/12/23 22:29:54 App: TestDuplicateWithEventingRebIn got deployed
2021/12/23 22:29:54 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 22:29:54 Starting bucket ops to source bucket
2021/12/23 22:30:09 Removing node(s): [] from the cluster
2021/12/23 22:30:14 Rebalance progress: 0
2021/12/23 22:30:19 Rebalance progress: 0
2021/12/23 22:30:24 Rebalance progress: 16.66666666666666
2021/12/23 22:30:29 Rebalance progress: 25
2021/12/23 22:30:34 Rebalance progress: 25
2021/12/23 22:30:39 Rebalance progress: 25
2021/12/23 22:30:44 Rebalance progress: 25
2021/12/23 22:30:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:30:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:30:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:30:49 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/23 22:30:49 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 22:30:49 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 22:30:54 Rebalance progress: 25
2021/12/23 22:30:59 Rebalance progress: 25
2021/12/23 22:31:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:31:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:31:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:31:04 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/23 22:31:04 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 22:31:04 Waiting for src bucket item count to get to: 200000 curr count: 107698
2021/12/23 22:31:09 Waiting for src bucket item count to get to: 200000 curr count: 107698
2021/12/23 22:31:14 Waiting for src bucket item count to get to: 200000 curr count: 124342
2021/12/23 22:31:19 Waiting for src bucket item count to get to: 200000 curr count: 124342
2021/12/23 22:31:24 Waiting for src bucket item count to get to: 200000 curr count: 141278
2021/12/23 22:31:29 Waiting for src bucket item count to get to: 200000 curr count: 141278
2021/12/23 22:31:34 Waiting for src bucket item count to get to: 200000 curr count: 158504
2021/12/23 22:31:39 Waiting for src bucket item count to get to: 200000 curr count: 158504
2021/12/23 22:31:44 Waiting for src bucket item count to get to: 200000 curr count: 174939
2021/12/23 22:31:49 Waiting for src bucket item count to get to: 200000 curr count: 174939
2021/12/23 22:31:54 Waiting for src bucket item count to get to: 200000 curr count: 191514
2021/12/23 22:31:59 Waiting for src bucket item count to get to: 200000 curr count: 191514
2021/12/23 22:32:04 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/23 22:32:04 Post SET ops. Expected item count: 200000 got 200000
2021/12/23 22:32:09 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/23 22:32:14 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/23 22:32:19 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/23 22:32:24 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2021/12/23 22:32:24 App: TestDuplicateWithEventingRebIn got un-deployed
2021/12/23 22:32:24 No eventing-con process running
2021/12/23 22:32:24 Function: TestDuplicateWithEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebIn deleting in background"
}
2021/12/23 22:32:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:32:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:32:36 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/23 22:32:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:32:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:32:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:32:48 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/23 22:32:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingRebIn (227.94s)
=== RUN   TestDuplicateWithEventingRebOut
2021/12/23 22:32:53 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 22:32:53 Removing node(s): [] from the cluster
2021/12/23 22:32:58 Rebalance progress: 100
2021/12/23 22:33:03 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/23 22:33:03 App: TestDuplicateWithEventingRebOut got un-deployed
2021/12/23 22:33:03 No eventing-con process running
2021/12/23 22:33:03 Function: TestDuplicateWithEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingRebOut not found"
}
2021/12/23 22:33:05 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:33:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:33:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:33:11 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:33:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:33:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:33:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:33:21 Deploying app: TestDuplicateWithEventingRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:33:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebOut stored in temp store"
}
2021/12/23 22:33:28 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/23 22:33:33 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/23 22:33:38 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/23 22:33:43 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2021/12/23 22:33:43 App: TestDuplicateWithEventingRebOut got deployed
2021/12/23 22:33:43 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 22:33:43 Starting bucket ops to source bucket
2021/12/23 22:33:48 Rebalance progress: 25
2021/12/23 22:33:53 Rebalance progress: 25
2021/12/23 22:33:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:33:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:33:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:33:58 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/23 22:33:58 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 22:33:58 Waiting for src bucket item count to get to: 200000 curr count: 10497
2021/12/23 22:34:03 Waiting for src bucket item count to get to: 200000 curr count: 27020
2021/12/23 22:34:08 Waiting for src bucket item count to get to: 200000 curr count: 27020
2021/12/23 22:34:13 Waiting for src bucket item count to get to: 200000 curr count: 43837
2021/12/23 22:34:18 Waiting for src bucket item count to get to: 200000 curr count: 43837
2021/12/23 22:34:23 Waiting for src bucket item count to get to: 200000 curr count: 60278
2021/12/23 22:34:28 Waiting for src bucket item count to get to: 200000 curr count: 60278
2021/12/23 22:34:33 Waiting for src bucket item count to get to: 200000 curr count: 60278
2021/12/23 22:34:38 Waiting for src bucket item count to get to: 200000 curr count: 76741
2021/12/23 22:34:43 Waiting for src bucket item count to get to: 200000 curr count: 76741
2021/12/23 22:34:48 Waiting for src bucket item count to get to: 200000 curr count: 93117
2021/12/23 22:34:53 Waiting for src bucket item count to get to: 200000 curr count: 93117
2021/12/23 22:34:58 Waiting for src bucket item count to get to: 200000 curr count: 110077
2021/12/23 22:35:03 Waiting for src bucket item count to get to: 200000 curr count: 110077
2021/12/23 22:35:08 Waiting for src bucket item count to get to: 200000 curr count: 126825
2021/12/23 22:35:13 Waiting for src bucket item count to get to: 200000 curr count: 126825
2021/12/23 22:35:18 Waiting for src bucket item count to get to: 200000 curr count: 143475
2021/12/23 22:35:23 Waiting for src bucket item count to get to: 200000 curr count: 143475
2021/12/23 22:35:28 Waiting for src bucket item count to get to: 200000 curr count: 160283
2021/12/23 22:35:33 Waiting for src bucket item count to get to: 200000 curr count: 160283
2021/12/23 22:35:38 Waiting for src bucket item count to get to: 200000 curr count: 176373
2021/12/23 22:35:43 Waiting for src bucket item count to get to: 200000 curr count: 176373
2021/12/23 22:35:48 Waiting for src bucket item count to get to: 200000 curr count: 192634
2021/12/23 22:35:53 Waiting for src bucket item count to get to: 200000 curr count: 192634
2021/12/23 22:35:58 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/23 22:35:58 Post SET ops. Expected item count: 200000 got 200000
2021/12/23 22:36:03 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/23 22:36:08 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/23 22:36:13 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/23 22:36:18 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2021/12/23 22:36:18 App: TestDuplicateWithEventingRebOut got un-deployed
2021/12/23 22:36:18 No eventing-con process running
2021/12/23 22:36:18 Function: TestDuplicateWithEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebOut deleting in background"
}
2021/12/23 22:36:20 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:36:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:36:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:36:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:36:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:36:36 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/23 22:36:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingRebOut (228.73s)
=== RUN   TestDuplicateWithEventingSwapReb
2021/12/23 22:36:46 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/23 22:36:46 App: TestDuplicateWithEventingSwapReb got un-deployed
2021/12/23 22:36:46 No eventing-con process running
2021/12/23 22:36:46 Function: TestDuplicateWithEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingSwapReb not found"
}
2021/12/23 22:36:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:36:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:36:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:36:55 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:37:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:37:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:37:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:37:05 Deploying app: TestDuplicateWithEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:37:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingSwapReb stored in temp store"
}
2021/12/23 22:37:11 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/23 22:37:16 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/23 22:37:21 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/23 22:37:26 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2021/12/23 22:37:26 App: TestDuplicateWithEventingSwapReb got deployed
2021/12/23 22:37:26 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 22:37:26 Starting bucket ops to source bucket
2021/12/23 22:37:27 Removing node(s): [] from the cluster
2021/12/23 22:37:32 Rebalance progress: 25
2021/12/23 22:37:37 Rebalance progress: 25
2021/12/23 22:37:42 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:37:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:37:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:37:42 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2021/12/23 22:37:42 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 22:37:42 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 22:37:49 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 22:37:54 Rebalance progress: 16.66666666666667
2021/12/23 22:37:59 Rebalance progress: 16.66666666666667
2021/12/23 22:38:04 Rebalance progress: 16.66666666666667
2021/12/23 22:38:09 Rebalance progress: 20.47026279391424
2021/12/23 22:38:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:38:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:38:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:38:14 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 22:38:14 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/23 22:38:19 Rebalance progress: 16.66666666666667
2021/12/23 22:38:24 Rebalance progress: 16.66666666666667
2021/12/23 22:38:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:38:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:38:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:38:29 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 22:38:29 Waiting for src bucket item count to get to: 200000 curr count: 80592
2021/12/23 22:38:34 Waiting for src bucket item count to get to: 200000 curr count: 97137
2021/12/23 22:38:39 Waiting for src bucket item count to get to: 200000 curr count: 97137
2021/12/23 22:38:44 Waiting for src bucket item count to get to: 200000 curr count: 113821
2021/12/23 22:38:49 Waiting for src bucket item count to get to: 200000 curr count: 113821
2021/12/23 22:38:54 Waiting for src bucket item count to get to: 200000 curr count: 130263
2021/12/23 22:38:59 Waiting for src bucket item count to get to: 200000 curr count: 130263
2021/12/23 22:39:04 Waiting for src bucket item count to get to: 200000 curr count: 146654
2021/12/23 22:39:09 Waiting for src bucket item count to get to: 200000 curr count: 146654
2021/12/23 22:39:14 Waiting for src bucket item count to get to: 200000 curr count: 163003
2021/12/23 22:39:19 Waiting for src bucket item count to get to: 200000 curr count: 163003
2021/12/23 22:39:24 Waiting for src bucket item count to get to: 200000 curr count: 178776
2021/12/23 22:39:29 Waiting for src bucket item count to get to: 200000 curr count: 178776
2021/12/23 22:39:34 Waiting for src bucket item count to get to: 200000 curr count: 195267
2021/12/23 22:39:39 Waiting for src bucket item count to get to: 200000 curr count: 195267
2021/12/23 22:39:44 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/23 22:39:44 Post SET ops. Expected item count: 200000 got 200000
2021/12/23 22:39:49 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/23 22:39:54 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/23 22:39:59 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/23 22:40:05 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2021/12/23 22:40:05 App: TestDuplicateWithEventingSwapReb got un-deployed
2021/12/23 22:40:05 No eventing-con process running
2021/12/23 22:40:05 Function: TestDuplicateWithEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingSwapReb deleting in background"
}
2021/12/23 22:40:06 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:40:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:40:16 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/23 22:40:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:40:18 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:40:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:40:28 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/23 22:40:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingSwapReb (231.54s)
=== RUN   TestDuplicateWithKVRebIn
2021/12/23 22:40:38 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/23 22:40:38 App: TestDuplicateWithKVRebIn got un-deployed
2021/12/23 22:40:38 No eventing-con process running
2021/12/23 22:40:38 Function: TestDuplicateWithKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVRebIn not found"
}
2021/12/23 22:40:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:40:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:40:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:40:47 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:40:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:40:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:40:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:40:57 Deploying app: TestDuplicateWithKVRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:40:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebIn stored in temp store"
}
2021/12/23 22:41:03 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/23 22:41:08 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/23 22:41:13 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/23 22:41:18 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2021/12/23 22:41:18 App: TestDuplicateWithKVRebIn got deployed
2021/12/23 22:41:18 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/23 22:41:18 Starting bucket ops to source bucket
2021/12/23 22:41:18 Removing node(s): [] from the cluster
2021/12/23 22:41:23 Rebalance progress: 16.66666666666667
2021/12/23 22:41:28 Rebalance progress: 16.66666666666667
2021/12/23 22:41:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:41:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:41:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:41:33 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 22:41:33 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 22:41:38 Rebalance progress: 16.66666666666667
2021/12/23 22:41:43 Rebalance progress: 16.66666666666667
2021/12/23 22:41:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:41:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:41:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:41:48 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 22:41:48 Waiting for src bucket item count to get to: 200000 curr count: 33758
2021/12/23 22:41:53 Waiting for src bucket item count to get to: 200000 curr count: 49719
2021/12/23 22:41:58 Waiting for src bucket item count to get to: 200000 curr count: 49719
2021/12/23 22:42:03 Waiting for src bucket item count to get to: 200000 curr count: 66235
2021/12/23 22:42:08 Waiting for src bucket item count to get to: 200000 curr count: 66235
2021/12/23 22:42:13 Waiting for src bucket item count to get to: 200000 curr count: 81505
2021/12/23 22:42:18 Waiting for src bucket item count to get to: 200000 curr count: 81505
2021/12/23 22:42:23 Waiting for src bucket item count to get to: 200000 curr count: 81505
2021/12/23 22:42:28 Waiting for src bucket item count to get to: 200000 curr count: 97677
2021/12/23 22:42:33 Waiting for src bucket item count to get to: 200000 curr count: 97677
2021/12/23 22:42:38 Waiting for src bucket item count to get to: 200000 curr count: 114188
2021/12/23 22:42:43 Waiting for src bucket item count to get to: 200000 curr count: 114188
2021/12/23 22:42:48 Waiting for src bucket item count to get to: 200000 curr count: 130613
2021/12/23 22:42:53 Waiting for src bucket item count to get to: 200000 curr count: 130613
2021/12/23 22:42:58 Waiting for src bucket item count to get to: 200000 curr count: 146904
2021/12/23 22:43:03 Waiting for src bucket item count to get to: 200000 curr count: 146904
2021/12/23 22:43:08 Waiting for src bucket item count to get to: 200000 curr count: 163390
2021/12/23 22:43:13 Waiting for src bucket item count to get to: 200000 curr count: 163390
2021/12/23 22:43:18 Waiting for src bucket item count to get to: 200000 curr count: 179087
2021/12/23 22:43:23 Waiting for src bucket item count to get to: 200000 curr count: 179087
2021/12/23 22:43:28 Waiting for src bucket item count to get to: 200000 curr count: 195330
2021/12/23 22:43:33 Waiting for src bucket item count to get to: 200000 curr count: 195330
2021/12/23 22:43:38 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/23 22:43:38 Post SET ops. Expected item count: 200000 got 200000
2021/12/23 22:43:43 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/23 22:43:48 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/23 22:43:53 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/23 22:43:58 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2021/12/23 22:43:58 App: TestDuplicateWithKVRebIn got un-deployed
2021/12/23 22:43:58 No eventing-con process running
2021/12/23 22:43:58 Function: TestDuplicateWithKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebIn deleting in background"
}
2021/12/23 22:44:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:44:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:44:10 Waiting for dst bucket item count to get to: 0 curr count: 49607
2021/12/23 22:44:15 Waiting for dst bucket item count to get to: 0 curr count: 49607
2021/12/23 22:44:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:44:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:44:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:44:27 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/23 22:44:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVRebIn (238.97s)
=== RUN   TestDuplicateWithKVRebOut
2021/12/23 22:44:32 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/23 22:44:32 Removing node(s): [] from the cluster
2021/12/23 22:44:37 Rebalance progress: 100
2021/12/23 22:44:42 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/23 22:44:42 App: TestDuplicateWithKVRebOut got un-deployed
2021/12/23 22:44:42 No eventing-con process running
2021/12/23 22:44:42 Function: TestDuplicateWithKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVRebOut not found"
}
2021/12/23 22:44:44 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:44:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:44:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:44:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:44:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:44:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:45:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:45:01 Deploying app: TestDuplicateWithKVRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:45:02 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebOut stored in temp store"
}
2021/12/23 22:45:07 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/23 22:45:12 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/23 22:45:17 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/23 22:45:22 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2021/12/23 22:45:22 App: TestDuplicateWithKVRebOut got deployed
2021/12/23 22:45:22 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 22:45:22 Starting bucket ops to source bucket
2021/12/23 22:45:27 Rebalance progress: 16.66666666666667
2021/12/23 22:45:32 Rebalance progress: 16.66666666666667
2021/12/23 22:45:37 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:45:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:45:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:45:37 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 22:45:37 Waiting for src bucket item count to get to: 200000 curr count: 11258
2021/12/23 22:45:42 Waiting for src bucket item count to get to: 200000 curr count: 27461
2021/12/23 22:45:47 Waiting for src bucket item count to get to: 200000 curr count: 27461
2021/12/23 22:45:52 Waiting for src bucket item count to get to: 200000 curr count: 43587
2021/12/23 22:45:57 Waiting for src bucket item count to get to: 200000 curr count: 43587
2021/12/23 22:46:02 Waiting for src bucket item count to get to: 200000 curr count: 59915
2021/12/23 22:46:07 Waiting for src bucket item count to get to: 200000 curr count: 59915
2021/12/23 22:46:12 Waiting for src bucket item count to get to: 200000 curr count: 59915
2021/12/23 22:46:17 Waiting for src bucket item count to get to: 200000 curr count: 75404
2021/12/23 22:46:22 Waiting for src bucket item count to get to: 200000 curr count: 75404
2021/12/23 22:46:27 Waiting for src bucket item count to get to: 200000 curr count: 91387
2021/12/23 22:46:32 Waiting for src bucket item count to get to: 200000 curr count: 91387
2021/12/23 22:46:37 Waiting for src bucket item count to get to: 200000 curr count: 107718
2021/12/23 22:46:42 Waiting for src bucket item count to get to: 200000 curr count: 107718
2021/12/23 22:46:47 Waiting for src bucket item count to get to: 200000 curr count: 124145
2021/12/23 22:46:52 Waiting for src bucket item count to get to: 200000 curr count: 124145
2021/12/23 22:46:57 Waiting for src bucket item count to get to: 200000 curr count: 140470
2021/12/23 22:47:02 Waiting for src bucket item count to get to: 200000 curr count: 140470
2021/12/23 22:47:07 Waiting for src bucket item count to get to: 200000 curr count: 156693
2021/12/23 22:47:12 Waiting for src bucket item count to get to: 200000 curr count: 156693
2021/12/23 22:47:17 Waiting for src bucket item count to get to: 200000 curr count: 172002
2021/12/23 22:47:22 Waiting for src bucket item count to get to: 200000 curr count: 172002
2021/12/23 22:47:27 Waiting for src bucket item count to get to: 200000 curr count: 188026
2021/12/23 22:47:32 Waiting for src bucket item count to get to: 200000 curr count: 188026
2021/12/23 22:47:37 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/23 22:47:37 Post SET ops. Expected item count: 200000 got 200000
2021/12/23 22:47:42 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/23 22:47:47 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/23 22:47:52 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/23 22:47:57 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2021/12/23 22:47:57 App: TestDuplicateWithKVRebOut got un-deployed
2021/12/23 22:47:57 No eventing-con process running
2021/12/23 22:47:57 Function: TestDuplicateWithKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebOut deleting in background"
}
2021/12/23 22:47:59 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:48:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:48:09 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/23 22:48:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:48:11 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:48:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:48:21 Waiting for dst bucket item count to get to: 0 curr count: 149834
2021/12/23 22:48:26 Waiting for dst bucket item count to get to: 0 curr count: 149834
2021/12/23 22:48:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVRebOut (238.73s)
=== RUN   TestDuplicateWithKVSwapReb
2021/12/23 22:48:36 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/23 22:48:36 App: TestDuplicateWithKVSwapReb got un-deployed
2021/12/23 22:48:36 No eventing-con process running
2021/12/23 22:48:36 Function: TestDuplicateWithKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVSwapReb not found"
}
2021/12/23 22:48:37 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:48:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:48:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:48:44 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:48:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:48:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:48:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:48:54 Deploying app: TestDuplicateWithKVSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:48:55 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVSwapReb stored in temp store"
}
2021/12/23 22:49:00 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/23 22:49:05 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/23 22:49:10 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/23 22:49:15 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2021/12/23 22:49:15 App: TestDuplicateWithKVSwapReb got deployed
2021/12/23 22:49:15 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/23 22:49:15 Starting bucket ops to source bucket
2021/12/23 22:49:16 Removing node(s): [] from the cluster
2021/12/23 22:49:21 Rebalance progress: 16.66666666666667
2021/12/23 22:49:26 Rebalance progress: 16.66666666666667
2021/12/23 22:49:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:49:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:49:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:49:31 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 22:49:31 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/23 22:49:32 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 22:49:37 Rebalance progress: 16.66666666666667
2021/12/23 22:49:42 Rebalance progress: 16.66666666666667
2021/12/23 22:49:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:49:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:49:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:49:47 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 22:49:47 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/23 22:49:52 Rebalance progress: 16.66666666666667
2021/12/23 22:49:57 Rebalance progress: 16.66666666666667
2021/12/23 22:50:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:50:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:50:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:50:02 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 22:50:02 Waiting for src bucket item count to get to: 200000 curr count: 69253
2021/12/23 22:50:07 Waiting for src bucket item count to get to: 200000 curr count: 69253
2021/12/23 22:50:12 Waiting for src bucket item count to get to: 200000 curr count: 84295
2021/12/23 22:50:17 Waiting for src bucket item count to get to: 200000 curr count: 84295
2021/12/23 22:50:22 Waiting for src bucket item count to get to: 200000 curr count: 100818
2021/12/23 22:50:27 Waiting for src bucket item count to get to: 200000 curr count: 100818
2021/12/23 22:50:32 Waiting for src bucket item count to get to: 200000 curr count: 117414
2021/12/23 22:50:37 Waiting for src bucket item count to get to: 200000 curr count: 117414
2021/12/23 22:50:42 Waiting for src bucket item count to get to: 200000 curr count: 134103
2021/12/23 22:50:47 Waiting for src bucket item count to get to: 200000 curr count: 134103
2021/12/23 22:50:52 Waiting for src bucket item count to get to: 200000 curr count: 150843
2021/12/23 22:50:57 Waiting for src bucket item count to get to: 200000 curr count: 150843
2021/12/23 22:51:02 Waiting for src bucket item count to get to: 200000 curr count: 167371
2021/12/23 22:51:07 Waiting for src bucket item count to get to: 200000 curr count: 167371
2021/12/23 22:51:12 Waiting for src bucket item count to get to: 200000 curr count: 182859
2021/12/23 22:51:17 Waiting for src bucket item count to get to: 200000 curr count: 182859
2021/12/23 22:51:22 Waiting for src bucket item count to get to: 200000 curr count: 199481
2021/12/23 22:51:27 Waiting for src bucket item count to get to: 200000 curr count: 199481
2021/12/23 22:51:32 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/23 22:51:32 Post SET ops. Expected item count: 200000 got 200000
2021/12/23 22:51:38 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/23 22:51:43 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/23 22:51:48 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/23 22:51:53 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2021/12/23 22:51:53 App: TestDuplicateWithKVSwapReb got un-deployed
2021/12/23 22:51:53 No eventing-con process running
2021/12/23 22:51:53 Function: TestDuplicateWithKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVSwapReb deleting in background"
}
2021/12/23 22:51:54 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:51:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:52:04 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/23 22:52:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:52:06 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:52:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:52:16 Waiting for dst bucket item count to get to: 0 curr count: 200000
2021/12/23 22:52:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVSwapReb (230.42s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpOneByOne
2021/12/23 22:52:26 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/23 22:52:26 App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/23 22:52:26 No eventing-con process running
2021/12/23 22:52:26 Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne not found"
}
2021/12/23 22:52:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:52:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:52:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:52:35 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:52:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:52:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:52:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:52:45 Deploying app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:52:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2021/12/23 22:52:51 Starting bucket ops to source bucket
2021/12/23 22:52:56 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/23 22:53:01 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/23 22:53:06 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/23 22:53:06 App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:53:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:53:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:53:06 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 22:53:06 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 22:53:06 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 22:53:11 Rebalance progress: 16.66666666666667
2021/12/23 22:53:16 Rebalance progress: 16.66666666666667
2021/12/23 22:53:21 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:53:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:53:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:53:21 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 22:53:21 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 22:53:22 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 22:53:27 Rebalance progress: 16.66666666666667
2021/12/23 22:53:32 Rebalance progress: 16.66666666666667
2021/12/23 22:53:37 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:53:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:53:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:53:37 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2021/12/23 22:53:37 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/23 22:53:42 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 22:53:47 Rebalance progress: 12.5
2021/12/23 22:53:52 Rebalance progress: 12.5
2021/12/23 22:53:57 Rebalance progress: 12.5
2021/12/23 22:54:02 Rebalance progress: 66.08527131782945
2021/12/23 22:54:07 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:54:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:54:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:54:07 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 22:54:12 Rebalance progress: 12.5
2021/12/23 22:54:17 Rebalance progress: 12.5
2021/12/23 22:54:22 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:54:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:54:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:54:22 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/23 22:54:27 Rebalance progress: 12.5
2021/12/23 22:54:32 Rebalance progress: 12.5
2021/12/23 22:54:37 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:54:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:54:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:54:37 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/23 22:54:42 Rebalance progress: 12.5
2021/12/23 22:54:47 Rebalance progress: 12.5
2021/12/23 22:54:52 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:54:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:54:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:54:58 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/23 22:55:03 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/23 22:55:08 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/23 22:55:13 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/23 22:55:13 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/23 22:55:13 eventingSetup.go:46: No eventing-con process running
2021/12/23 22:55:13 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2021/12/23 22:55:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:55:20 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:55:25 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12164
2021/12/23 22:55:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:55:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:55:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:55:36 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12164
2021/12/23 22:55:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpOneByOne (200.16s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce
2021/12/23 22:55:46 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/23 22:55:46 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got un-deployed
2021/12/23 22:55:46 eventingSetup.go:46: No eventing-con process running
2021/12/23 22:55:46 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce not found"
}
2021/12/23 22:55:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:55:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:55:53 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:55:55 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:56:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:56:00 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:56:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:56:05 eventingSetup.go:125: Deploying app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:56:06 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce stored in temp store"
}
2021/12/23 22:56:11 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 22:56:16 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2021/12/23 22:56:21 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2021/12/23 22:56:26 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2021/12/23 22:56:26 clusterSetup.go:354: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:56:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:56:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:56:26 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 22:56:26 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 22:56:27 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/23 22:56:27 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 22:56:32 Rebalance progress: 12.5
2021/12/23 22:56:37 Rebalance progress: 12.5
2021/12/23 22:56:42 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:56:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:56:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:56:42 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/23 22:56:47 Rebalance progress: 12.5
2021/12/23 22:56:52 Rebalance progress: 12.5
2021/12/23 22:56:57 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:56:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:56:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:57:02 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/23 22:57:07 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/23 22:57:12 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/23 22:57:17 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2021/12/23 22:57:17 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got un-deployed
2021/12/23 22:57:17 eventingSetup.go:46: No eventing-con process running
2021/12/23 22:57:17 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce deleting in background"
}
2021/12/23 22:57:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:57:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:57:29 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4591
2021/12/23 22:57:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:57:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:57:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:57:41 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3726
2021/12/23 22:57:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3726
2021/12/23 22:57:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce (129.47s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings
2021/12/23 22:57:56 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/23 22:57:56 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/23 22:57:56 eventingSetup.go:46: No eventing-con process running
2021/12/23 22:57:56 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings not found"
}
2021/12/23 22:57:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:58:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:58:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 22:58:04 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:58:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:58:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:58:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 22:58:14 eventingSetup.go:125: Deploying app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2021/12/23 22:58:15 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings stored in temp store"
}
2021/12/23 22:58:20 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 22:58:25 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2021/12/23 22:58:30 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2021/12/23 22:58:35 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2021/12/23 22:58:35 clusterSetup.go:354: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:58:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:58:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:58:35 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 22:58:36 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 22:58:41 Rebalance progress: 12.5
2021/12/23 22:58:46 Rebalance progress: 12.5
2021/12/23 22:58:51 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:58:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:58:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:58:51 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 22:58:51 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 22:58:56 Rebalance progress: 12.5
2021/12/23 22:59:01 Rebalance progress: 12.5
2021/12/23 22:59:06 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:59:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:59:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:59:06 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/23 22:59:07 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 22:59:12 Rebalance progress: 12.5
2021/12/23 22:59:17 Rebalance progress: 12.5
2021/12/23 22:59:22 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:59:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:59:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:59:22 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 22:59:27 Rebalance progress: 12.5
2021/12/23 22:59:32 Rebalance progress: 12.5
2021/12/23 22:59:37 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:59:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:59:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:59:37 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/23 22:59:42 Rebalance progress: 12.5
2021/12/23 22:59:47 Rebalance progress: 12.5
2021/12/23 22:59:52 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:59:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 22:59:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 22:59:52 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/23 22:59:57 Rebalance progress: 12.5
2021/12/23 23:00:02 Rebalance progress: 12.5
2021/12/23 23:00:07 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:00:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:00:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:00:12 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/23 23:00:17 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/23 23:00:22 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/23 23:00:27 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2021/12/23 23:00:27 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got un-deployed
2021/12/23 23:00:27 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:00:27 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings deleting in background"
}
2021/12/23 23:00:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:00:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:00:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10661
2021/12/23 23:00:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:00:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:00:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:00:51 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10112
2021/12/23 23:00:56 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10112
2021/12/23 23:00:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings (190.19s)
=== RUN   TestEventingSwapRebOnUpdateBucketOp
2021/12/23 23:01:06 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/23 23:01:06 clusterSetup.go:405: App: TestEventingSwapRebOnUpdateBucketOp got un-deployed
2021/12/23 23:01:06 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:01:06 eventingSetup.go:418: Function: TestEventingSwapRebOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebOnUpdateBucketOp not found"
}
2021/12/23 23:01:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:01:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:01:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:01:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:01:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:01:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:01:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:01:19 eventingSetup.go:125: Deploying app: TestEventingSwapRebOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/23 23:01:21 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebOnUpdateBucketOp stored in temp store"
}
2021/12/23 23:01:26 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 23:01:31 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2021/12/23 23:01:36 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2021/12/23 23:01:41 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2021/12/23 23:01:41 clusterSetup.go:354: App: TestEventingSwapRebOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:01:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:01:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:01:41 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 23:01:41 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:01:46 Rebalance progress: 12.5
2021/12/23 23:01:51 Rebalance progress: 12.5
2021/12/23 23:01:56 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:01:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:01:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:01:56 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 23:01:56 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 23:02:02 Rebalance progress: 12.5
2021/12/23 23:02:07 Rebalance progress: 12.5
2021/12/23 23:02:12 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:02:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:02:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:02:12 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/23 23:02:17 Rebalance progress: 12.5
2021/12/23 23:02:22 Rebalance progress: 12.5
2021/12/23 23:02:27 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:02:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:02:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:02:32 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/23 23:02:37 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/23 23:02:42 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/23 23:02:47 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2021/12/23 23:02:47 clusterSetup.go:405: App: TestEventingSwapRebOnUpdateBucketOp got un-deployed
2021/12/23 23:02:47 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:02:47 eventingSetup.go:418: Function: TestEventingSwapRebOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebOnUpdateBucketOp deleting in background"
}
2021/12/23 23:02:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:02:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:02:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6094
2021/12/23 23:02:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:03:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:03:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:03:10 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2949
2021/12/23 23:03:15 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2949
2021/12/23 23:03:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebOnUpdateBucketOp (139.43s)
=== RUN   TestMetaRollbackWithEventingReb
2021/12/23 23:03:20 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 23:03:21 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:03:26 Rebalance progress: 100
2021/12/23 23:03:31 Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/23 23:03:31 App: TestMetaRollbackWithEventingReb got un-deployed
2021/12/23 23:03:31 No eventing-con process running
2021/12/23 23:03:31 Function: TestMetaRollbackWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaRollbackWithEventingReb not found"
}
2021/12/23 23:03:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:03:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:03:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:03:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:03:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:03:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:03:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:03:44 Deploying app: TestMetaRollbackWithEventingReb. Item count src bucket: 0 dst bucket: 0
2021/12/23 23:03:45 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaRollbackWithEventingReb stored in temp store"
}
2021/12/23 23:03:50 Starting bucket ops to source bucket
2021/12/23 23:03:55 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2021/12/23 23:04:00 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2021/12/23 23:04:05 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2021/12/23 23:04:05 App: TestMetaRollbackWithEventingReb got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:04:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:04:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:04:05 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 23:04:06 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:04:11 Rebalance progress: 12.5
2021/12/23 23:04:16 Rebalance progress: 12.5
2021/12/23 23:04:21 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:04:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:04:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:04:21 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2021/12/23 23:04:21 bucketOps.go:134: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2021/12/23 23:04:26 Rebalance progress: 12.5
2021/12/23 23:04:31 Rebalance progress: 12.5
2021/12/23 23:04:36 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:04:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:04:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:04:41 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/23 23:04:46 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/23 23:04:51 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/23 23:04:56 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2021/12/23 23:04:56 clusterSetup.go:405: App: TestMetaRollbackWithEventingReb got un-deployed
2021/12/23 23:04:56 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:04:56 eventingSetup.go:418: Function: TestMetaRollbackWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaRollbackWithEventingReb deleting in background"
}
2021/12/23 23:04:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:05:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:05:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4549
2021/12/23 23:05:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:05:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:05:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:05:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaRollbackWithEventingReb (119.17s)
=== RUN   TestMetaPartialRollbackWithEventingReb
2021/12/23 23:05:20 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 23:05:20 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:05:25 Rebalance progress: 100
2021/12/23 23:05:30 Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/23 23:05:30 App: TestMetaPartialRollbackWithEventingReb got un-deployed
2021/12/23 23:05:30 No eventing-con process running
2021/12/23 23:05:30 Function: TestMetaPartialRollbackWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaPartialRollbackWithEventingReb not found"
}
2021/12/23 23:05:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:05:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:05:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:05:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:05:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:05:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:05:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:05:43 Deploying app: TestMetaPartialRollbackWithEventingReb. Item count src bucket: 0 dst bucket: 0
2021/12/23 23:05:44 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaPartialRollbackWithEventingReb stored in temp store"
}
2021/12/23 23:05:49 Starting bucket ops to source bucket
2021/12/23 23:05:54 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2021/12/23 23:05:59 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2021/12/23 23:06:05 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2021/12/23 23:06:05 App: TestMetaPartialRollbackWithEventingReb got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:06:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:06:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:06:05 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 23:06:06 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:06:11 Rebalance progress: 12.5
2021/12/23 23:06:16 Rebalance progress: 12.5
2021/12/23 23:06:21 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:06:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:06:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:06:21 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2021/12/23 23:06:21 bucketOps.go:65: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaPartialRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2021/12/23 23:06:26 Rebalance progress: 12.5
2021/12/23 23:06:31 Rebalance progress: 12.5
2021/12/23 23:06:36 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:06:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:06:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:06:36 bucketOps.go:65: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaPartialRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2021/12/23 23:06:41 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/23 23:06:46 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/23 23:06:51 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/23 23:06:56 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2021/12/23 23:06:56 clusterSetup.go:405: App: TestMetaPartialRollbackWithEventingReb got un-deployed
2021/12/23 23:06:56 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:06:56 eventingSetup.go:418: Function: TestMetaPartialRollbackWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaPartialRollbackWithEventingReb deleting in background"
}
2021/12/23 23:06:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:07:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:07:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 38702
2021/12/23 23:07:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:07:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:07:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:07:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaPartialRollbackWithEventingReb (120.00s)
=== RUN   TestEventingRebMultipleHandlersOneByOne
2021/12/23 23:07:25 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/23 23:07:25 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got un-deployed
2021/12/23 23:07:25 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:07:25 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op not found"
}
2021/12/23 23:07:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:07:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:07:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:07:33 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:07:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:07:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:07:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:07:43 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/23 23:07:44 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:07:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:07:44 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/23 23:07:45 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update stored in temp store"
}
2021/12/23 23:07:50 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 23:07:55 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2021/12/23 23:08:00 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2021/12/23 23:08:06 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2021/12/23 23:08:06 clusterSetup.go:354: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got deployed
2021/12/23 23:08:11 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2021/12/23 23:08:16 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2021/12/23 23:08:21 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2021/12/23 23:08:21 clusterSetup.go:354: App: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:08:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:08:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:08:21 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 23:08:21 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:08:26 Rebalance progress: 12.5
2021/12/23 23:08:31 Rebalance progress: 12.5
2021/12/23 23:08:36 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:08:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:08:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:08:36 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 23:08:36 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:08:41 Rebalance progress: 12.5
2021/12/23 23:08:46 Rebalance progress: 12.5
2021/12/23 23:08:51 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:08:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:08:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:08:51 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/23 23:08:52 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:08:57 Rebalance progress: 12.5
2021/12/23 23:09:02 Rebalance progress: 12.5
2021/12/23 23:09:07 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:09:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:09:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:09:07 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 23:09:12 Rebalance progress: 12.5
2021/12/23 23:09:17 Rebalance progress: 12.5
2021/12/23 23:09:22 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:09:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:09:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:09:22 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/23 23:09:27 Rebalance progress: 12.5
2021/12/23 23:09:32 Rebalance progress: 12.5
2021/12/23 23:09:37 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:09:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:09:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:09:37 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/23 23:09:42 Rebalance progress: 12.5
2021/12/23 23:09:47 Rebalance progress: 12.5
2021/12/23 23:09:52 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:09:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:09:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:09:57 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/23 23:10:02 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/23 23:10:07 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/23 23:10:12 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2021/12/23 23:10:12 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got un-deployed
2021/12/23 23:10:12 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:10:12 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op deleting in background"
}
2021/12/23 23:10:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:10:20 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:10:25 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12142
2021/12/23 23:10:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:10:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:10:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:10:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12142
2021/12/23 23:10:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:10:42 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/23 23:10:47 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/23 23:10:52 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/23 23:10:57 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2021/12/23 23:10:57 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update got un-deployed
2021/12/23 23:10:57 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:10:57 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update deleting in background"
}
2021/12/23 23:10:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:11:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:11:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:11:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:11:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:11:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultipleHandlersOneByOne (236.01s)
=== RUN   TestEventingRebMultipleHandlersAllAtOnce
2021/12/23 23:11:21 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/23 23:11:21 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got un-deployed
2021/12/23 23:11:21 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:11:21 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op not found"
}
2021/12/23 23:11:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:11:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:11:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:11:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:11:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:11:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:11:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:11:39 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/23 23:11:40 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:11:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:11:40 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/23 23:11:41 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update stored in temp store"
}
2021/12/23 23:11:46 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 23:11:51 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2021/12/23 23:11:56 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2021/12/23 23:12:01 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2021/12/23 23:12:01 clusterSetup.go:354: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got deployed
2021/12/23 23:12:06 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2021/12/23 23:12:11 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2021/12/23 23:12:16 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2021/12/23 23:12:17 clusterSetup.go:354: App: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:12:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:12:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:12:17 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 23:12:17 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 23:12:18 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2021/12/23 23:12:18 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:12:23 Rebalance progress: 12.5
2021/12/23 23:12:28 Rebalance progress: 12.5
2021/12/23 23:12:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:12:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:12:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:12:33 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/23 23:12:38 Rebalance progress: 12.5
2021/12/23 23:12:43 Rebalance progress: 12.5
2021/12/23 23:12:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:12:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:12:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:12:53 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/23 23:12:58 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/23 23:13:03 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/23 23:13:09 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2021/12/23 23:13:09 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got un-deployed
2021/12/23 23:13:09 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:13:09 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op deleting in background"
}
2021/12/23 23:13:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:13:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:13:22 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4262
2021/12/23 23:13:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4262
2021/12/23 23:13:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:13:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:13:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:13:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6170
2021/12/23 23:13:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:13:44 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2021/12/23 23:13:49 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2021/12/23 23:13:54 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2021/12/23 23:13:54 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update got un-deployed
2021/12/23 23:13:54 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:13:54 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update deleting in background"
}
2021/12/23 23:13:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:14:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:14:01 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:14:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:14:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:14:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultipleHandlersAllAtOnce (177.10s)
=== RUN   TestEventingSwapRebMultipleHandlers
2021/12/23 23:14:18 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/23 23:14:18 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got un-deployed
2021/12/23 23:14:18 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:14:18 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update not found"
}
2021/12/23 23:14:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:14:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:14:24 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:14:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:14:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:14:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:14:36 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/23 23:14:36 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got un-deployed
2021/12/23 23:14:36 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:14:36 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op not found"
}
2021/12/23 23:14:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:14:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:14:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:14:45 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:14:50 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:14:50 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:14:50 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:14:50 eventingSetup.go:125: Deploying app: TestEventingSwapRebMultipleHandlersbucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/23 23:14:51 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:14:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:14:51 eventingSetup.go:125: Deploying app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/23 23:14:52 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op stored in temp store"
}
2021/12/23 23:14:57 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 23:15:02 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2021/12/23 23:15:07 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2021/12/23 23:15:12 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2021/12/23 23:15:12 clusterSetup.go:354: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got deployed
2021/12/23 23:15:17 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2021/12/23 23:15:22 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2021/12/23 23:15:27 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2021/12/23 23:15:27 clusterSetup.go:354: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:15:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:15:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:15:27 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 23:15:27 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:15:32 Rebalance progress: 12.5
2021/12/23 23:15:37 Rebalance progress: 12.5
2021/12/23 23:15:42 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:15:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:15:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:15:43 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 23:15:43 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 23:15:48 Rebalance progress: 12.5
2021/12/23 23:15:53 Rebalance progress: 12.5
2021/12/23 23:15:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:15:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:15:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:15:58 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/23 23:16:03 Rebalance progress: 12.5
2021/12/23 23:16:08 Rebalance progress: 12.5
2021/12/23 23:16:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:16:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:16:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:16:18 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/23 23:16:23 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/23 23:16:28 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/23 23:16:33 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2021/12/23 23:16:33 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got un-deployed
2021/12/23 23:16:33 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:16:33 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update deleting in background"
}
2021/12/23 23:16:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:16:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:16:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7584
2021/12/23 23:16:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:16:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:16:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:16:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7584
2021/12/23 23:16:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:17:03 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/23 23:17:08 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/23 23:17:13 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/23 23:17:18 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2021/12/23 23:17:18 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got un-deployed
2021/12/23 23:17:18 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:17:19 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op deleting in background"
}
2021/12/23 23:17:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:17:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:17:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:17:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:17:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:17:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebMultipleHandlers (204.37s)
=== RUN   TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne
2021/12/23 23:17:42 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/23 23:17:42 clusterSetup.go:405: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/23 23:17:42 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:17:42 eventingSetup.go:418: Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne not found"
}
2021/12/23 23:17:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:17:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:17:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:17:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:17:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:17:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:18:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:18:01 eventingSetup.go:125: Deploying app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2021/12/23 23:18:02 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2021/12/23 23:18:07 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 23:18:12 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/23 23:18:17 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/23 23:18:22 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/23 23:18:22 clusterSetup.go:354: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:18:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:18:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:18:22 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 23:18:22 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:18:42 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:18:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:18:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:19:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:19:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:19:13 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:19:18 Rebalance progress: 12.5
2021/12/23 23:19:23 Rebalance progress: 12.5
2021/12/23 23:19:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:19:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:19:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:19:28 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 23:19:28 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 23:19:33 Rebalance progress: 12.5
2021/12/23 23:19:38 Rebalance progress: 12.5
2021/12/23 23:19:43 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:19:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:19:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:19:43 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/23 23:19:49 Rebalance progress: 12.5
2021/12/23 23:19:54 Rebalance progress: 12.5
2021/12/23 23:19:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:19:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:19:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:20:04 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/23 23:20:09 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/23 23:20:14 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/23 23:20:19 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/23 23:20:19 clusterSetup.go:405: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/23 23:20:19 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:20:19 eventingSetup.go:418: Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2021/12/23 23:20:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:20:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:20:31 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7332
2021/12/23 23:20:36 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7332
2021/12/23 23:20:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:20:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:20:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:20:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11177
2021/12/23 23:20:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne (195.31s)
=== RUN   TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne
2021/12/23 23:20:57 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/23 23:20:57 clusterSetup.go:405: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/23 23:20:57 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:20:57 eventingSetup.go:418: Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne not found"
}
2021/12/23 23:20:59 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:21:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:21:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:21:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:21:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:21:11 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:21:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:21:16 eventingSetup.go:125: Deploying app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2021/12/23 23:21:17 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2021/12/23 23:21:22 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 23:21:27 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/23 23:21:32 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/23 23:21:37 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2021/12/23 23:21:37 clusterSetup.go:354: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:21:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:21:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:21:37 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 23:21:37 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:21:57 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:21:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:21:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:22:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:22:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:22:08 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 23:22:08 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:22:28 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:22:29 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:22:29 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:22:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:22:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:22:39 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 23:22:39 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:22:59 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:22:59 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:22:59 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:23:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:23:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:23:10 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 23:23:10 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:23:30 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:23:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:23:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:23:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:23:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:23:40 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 23:23:41 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:24:01 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:24:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:24:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:24:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:24:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:24:11 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:24:16 Rebalance progress: 12.5
2021/12/23 23:24:21 Rebalance progress: 12.5
2021/12/23 23:24:26 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:24:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:24:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:24:26 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 23:24:27 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 23:24:32 Rebalance progress: 12.5
2021/12/23 23:24:37 Rebalance progress: 12.5
2021/12/23 23:24:42 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:24:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:24:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:24:42 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/23 23:24:47 Rebalance progress: 12.5
2021/12/23 23:24:52 Rebalance progress: 12.5
2021/12/23 23:24:57 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:24:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:24:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:25:02 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/23 23:25:07 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/23 23:25:12 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2021/12/23 23:25:12 clusterSetup.go:405: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2021/12/23 23:25:12 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:25:12 eventingSetup.go:418: Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2021/12/23 23:25:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:25:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:25:24 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 21489
2021/12/23 23:25:29 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 21489
2021/12/23 23:25:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:25:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:25:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:25:41 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 16657
2021/12/23 23:25:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 16657
2021/12/23 23:25:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne (298.42s)
=== RUN   TestEventingFailoverOnUpdateBucketOp
2021/12/23 23:25:56 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/23 23:25:56 clusterSetup.go:405: App: TestEventingFailoverOnUpdateBucketOp got un-deployed
2021/12/23 23:25:56 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:25:56 eventingSetup.go:418: Function: TestEventingFailoverOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingFailoverOnUpdateBucketOp not found"
}
2021/12/23 23:25:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:26:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:26:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:26:04 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:26:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:26:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:26:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:26:14 eventingSetup.go:125: Deploying app: TestEventingFailoverOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/23 23:26:15 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingFailoverOnUpdateBucketOp stored in temp store"
}
2021/12/23 23:26:20 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 23:26:25 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2021/12/23 23:26:30 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2021/12/23 23:26:35 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2021/12/23 23:26:35 clusterSetup.go:354: App: TestEventingFailoverOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:26:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:26:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:26:36 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 23:26:36 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:26:41 Rebalance progress: 12.5
2021/12/23 23:26:46 Rebalance progress: 12.5
2021/12/23 23:26:51 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:26:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:26:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:26:51 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:27:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:27:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:27:01 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:27:06 Rebalance progress: 12.5
2021/12/23 23:27:11 Rebalance progress: 12.5
2021/12/23 23:27:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:27:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:27:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:27:16 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 23:27:16 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 23:27:21 Rebalance progress: 12.5
2021/12/23 23:27:26 Rebalance progress: 12.5
2021/12/23 23:27:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:27:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:27:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:27:32 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/23 23:27:37 Rebalance progress: 12.5
2021/12/23 23:27:42 Rebalance progress: 12.5
2021/12/23 23:27:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:27:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:27:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:27:52 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/23 23:27:57 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/23 23:28:02 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/23 23:28:07 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2021/12/23 23:28:07 clusterSetup.go:405: App: TestEventingFailoverOnUpdateBucketOp got un-deployed
2021/12/23 23:28:07 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:28:07 eventingSetup.go:418: Function: TestEventingFailoverOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingFailoverOnUpdateBucketOp deleting in background"
}
2021/12/23 23:28:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:28:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:28:19 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8600
2021/12/23 23:28:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:28:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:28:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:28:30 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4848
2021/12/23 23:28:35 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4848
2021/12/23 23:28:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingFailoverOnUpdateBucketOp (169.66s)
=== RUN   TestEventingKVRebalanceOnUpdateBucketOp
2021/12/23 23:28:45 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/23 23:28:45 clusterSetup.go:405: App: TestEventingKVRebalanceOnUpdateBucketOp got un-deployed
2021/12/23 23:28:45 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:28:45 eventingSetup.go:418: Function: TestEventingKVRebalanceOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingKVRebalanceOnUpdateBucketOp not found"
}
2021/12/23 23:28:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:28:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:28:52 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:28:54 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:28:59 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:28:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:29:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:29:04 eventingSetup.go:125: Deploying app: TestEventingKVRebalanceOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2021/12/23 23:29:05 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingKVRebalanceOnUpdateBucketOp stored in temp store"
}
2021/12/23 23:29:10 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 23:29:15 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2021/12/23 23:29:20 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2021/12/23 23:29:25 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2021/12/23 23:29:25 clusterSetup.go:354: App: TestEventingKVRebalanceOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:29:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:29:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:29:25 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing,kv to the cluster
2021/12/23 23:29:26 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:29:31 Rebalance progress: 12.5
2021/12/23 23:29:36 Rebalance progress: 12.5
2021/12/23 23:29:41 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:29:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:29:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:29:41 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing,kv to the cluster
2021/12/23 23:29:42 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 23:29:47 Rebalance progress: 12.5
2021/12/23 23:29:52 Rebalance progress: 12.5
2021/12/23 23:29:57 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:29:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:29:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:29:57 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/23 23:30:02 Rebalance progress: 12.5
2021/12/23 23:30:07 Rebalance progress: 12.5
2021/12/23 23:30:12 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:30:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:30:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:30:17 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/23 23:30:22 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/23 23:30:27 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/23 23:30:32 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2021/12/23 23:30:32 clusterSetup.go:405: App: TestEventingKVRebalanceOnUpdateBucketOp got un-deployed
2021/12/23 23:30:32 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:30:32 eventingSetup.go:418: Function: TestEventingKVRebalanceOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingKVRebalanceOnUpdateBucketOp deleting in background"
}
2021/12/23 23:30:34 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:30:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:30:44 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6157
2021/12/23 23:30:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6157
2021/12/23 23:30:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:30:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:30:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:31:01 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3964
2021/12/23 23:31:06 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3964
2021/12/23 23:31:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingKVRebalanceOnUpdateBucketOp (150.15s)
=== RUN   TestEventingRebInWithOps
2021/12/23 23:31:16 clusterSetup.go:397: Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/23 23:31:16 clusterSetup.go:405: App: TestEventingRebInWithOps got un-deployed
2021/12/23 23:31:16 eventingSetup.go:46: No eventing-con process running
2021/12/23 23:31:16 eventingSetup.go:418: Function: TestEventingRebInWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebInWithOps not found"
}
2021/12/23 23:31:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:31:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:31:22 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:31:24 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:31:29 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:31:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:31:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:31:34 eventingSetup.go:125: Deploying app: TestEventingRebInWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/23 23:31:35 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithOps stored in temp store"
}
2021/12/23 23:31:40 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/23 23:31:45 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/23 23:31:50 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/23 23:31:55 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2021/12/23 23:31:55 clusterSetup.go:354: App: TestEventingRebInWithOps got deployed
2021/12/23 23:31:55 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 23:31:55 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/23 23:31:56 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/23 23:32:01 Rebalance progress: 12.5
2021/12/23 23:32:06 Rebalance progress: 12.5
2021/12/23 23:32:11 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:32:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:32:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:32:11 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 23:32:16 Rebalance progress: 12.5
2021/12/23 23:32:21 Rebalance progress: 12.5
2021/12/23 23:32:26 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:32:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:32:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:32:26 Waiting for src bucket item count to get to: 200000 curr count: 36961
2021/12/23 23:32:31 Waiting for src bucket item count to get to: 200000 curr count: 52845
2021/12/23 23:32:36 Waiting for src bucket item count to get to: 200000 curr count: 52845
2021/12/23 23:32:41 Waiting for src bucket item count to get to: 200000 curr count: 68931
2021/12/23 23:32:46 Waiting for src bucket item count to get to: 200000 curr count: 68931
2021/12/23 23:32:51 Waiting for src bucket item count to get to: 200000 curr count: 83703
2021/12/23 23:32:56 Waiting for src bucket item count to get to: 200000 curr count: 83703
2021/12/23 23:33:01 Waiting for src bucket item count to get to: 200000 curr count: 99764
2021/12/23 23:33:06 Waiting for src bucket item count to get to: 200000 curr count: 99764
2021/12/23 23:33:11 Waiting for src bucket item count to get to: 200000 curr count: 99764
2021/12/23 23:33:16 Waiting for src bucket item count to get to: 200000 curr count: 115859
2021/12/23 23:33:21 Waiting for src bucket item count to get to: 200000 curr count: 115859
2021/12/23 23:33:26 Waiting for src bucket item count to get to: 200000 curr count: 132117
2021/12/23 23:33:31 Waiting for src bucket item count to get to: 200000 curr count: 132117
2021/12/23 23:33:36 Waiting for src bucket item count to get to: 200000 curr count: 148197
2021/12/23 23:33:41 Waiting for src bucket item count to get to: 200000 curr count: 148197
2021/12/23 23:33:46 Waiting for src bucket item count to get to: 200000 curr count: 164377
2021/12/23 23:33:51 Waiting for src bucket item count to get to: 200000 curr count: 164377
2021/12/23 23:33:56 Waiting for src bucket item count to get to: 200000 curr count: 179727
2021/12/23 23:34:01 Waiting for src bucket item count to get to: 200000 curr count: 179727
2021/12/23 23:34:06 Waiting for src bucket item count to get to: 200000 curr count: 196323
2021/12/23 23:34:11 Waiting for src bucket item count to get to: 200000 curr count: 196323
2021/12/23 23:34:16 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/23 23:34:16 Post SET ops. Expected item count: 200000 got 200000
2021/12/23 23:34:16 Starting bucket ops to source bucket
2021/12/23 23:38:02 Waiting for dst bucket item count to get to: 0 curr count: 14708
2021/12/23 23:38:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:38:02 Post DELETE ops. Expected item count: 0 got 0
2021/12/23 23:38:07 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/23 23:38:12 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/23 23:38:17 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/23 23:38:22 Waiting for app: TestEventingRebInWithOps to get un-deployed
2021/12/23 23:38:22 App: TestEventingRebInWithOps got un-deployed
2021/12/23 23:38:22 No eventing-con process running
2021/12/23 23:38:23 Function: TestEventingRebInWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithOps deleting in background"
}
2021/12/23 23:38:24 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:38:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:38:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:38:31 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:38:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:38:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebInWithOps (450.40s)
=== RUN   TestEventingRebOutWithOps
2021/12/23 23:38:41 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 23:38:41 Removing node(s): [] from the cluster
2021/12/23 23:38:46 Rebalance progress: 100
2021/12/23 23:38:51 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/23 23:38:51 App: TestEventingRebOutWithOps got un-deployed
2021/12/23 23:38:51 No eventing-con process running
2021/12/23 23:38:51 Function: TestEventingRebOutWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebOutWithOps not found"
}
2021/12/23 23:38:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:38:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:38:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:39:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:39:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:39:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:39:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:39:10 Deploying app: TestEventingRebOutWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/23 23:39:11 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithOps stored in temp store"
}
2021/12/23 23:39:16 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/23 23:39:21 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/23 23:39:26 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/23 23:39:31 Waiting for app: TestEventingRebOutWithOps to get deployed
2021/12/23 23:39:31 App: TestEventingRebOutWithOps got deployed
2021/12/23 23:39:31 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 23:39:31 Starting bucket ops to source bucket
2021/12/23 23:39:36 Rebalance progress: 12.5
2021/12/23 23:39:41 Rebalance progress: 12.5
2021/12/23 23:39:46 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:39:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:39:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:39:46 Waiting for src bucket item count to get to: 200000 curr count: 12410
2021/12/23 23:39:51 Waiting for src bucket item count to get to: 200000 curr count: 28751
2021/12/23 23:39:56 Waiting for src bucket item count to get to: 200000 curr count: 28751
2021/12/23 23:40:01 Waiting for src bucket item count to get to: 200000 curr count: 45413
2021/12/23 23:40:06 Waiting for src bucket item count to get to: 200000 curr count: 45413
2021/12/23 23:40:11 Waiting for src bucket item count to get to: 200000 curr count: 61611
2021/12/23 23:40:16 Waiting for src bucket item count to get to: 200000 curr count: 61611
2021/12/23 23:40:21 Waiting for src bucket item count to get to: 200000 curr count: 61611
2021/12/23 23:40:26 Waiting for src bucket item count to get to: 200000 curr count: 77175
2021/12/23 23:40:31 Waiting for src bucket item count to get to: 200000 curr count: 77175
2021/12/23 23:40:36 Waiting for src bucket item count to get to: 200000 curr count: 93333
2021/12/23 23:40:41 Waiting for src bucket item count to get to: 200000 curr count: 93333
2021/12/23 23:40:46 Waiting for src bucket item count to get to: 200000 curr count: 109855
2021/12/23 23:40:51 Waiting for src bucket item count to get to: 200000 curr count: 109855
2021/12/23 23:40:56 Waiting for src bucket item count to get to: 200000 curr count: 126410
2021/12/23 23:41:01 Waiting for src bucket item count to get to: 200000 curr count: 126410
2021/12/23 23:41:06 Waiting for src bucket item count to get to: 200000 curr count: 142873
2021/12/23 23:41:11 Waiting for src bucket item count to get to: 200000 curr count: 142873
2021/12/23 23:41:16 Waiting for src bucket item count to get to: 200000 curr count: 159356
2021/12/23 23:41:21 Waiting for src bucket item count to get to: 200000 curr count: 159356
2021/12/23 23:41:26 Waiting for src bucket item count to get to: 200000 curr count: 174806
2021/12/23 23:41:31 Waiting for src bucket item count to get to: 200000 curr count: 174806
2021/12/23 23:41:36 Waiting for src bucket item count to get to: 200000 curr count: 191084
2021/12/23 23:41:41 Waiting for src bucket item count to get to: 200000 curr count: 191084
2021/12/23 23:41:46 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/23 23:41:46 Post SET ops. Expected item count: 200000 got 200000
2021/12/23 23:41:46 Starting bucket ops to source bucket
2021/12/23 23:45:32 Waiting for dst bucket item count to get to: 0 curr count: 14107
2021/12/23 23:45:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:45:32 Post DELETE ops. Expected item count: 0 got 0
2021/12/23 23:45:37 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/23 23:45:42 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/23 23:45:47 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/23 23:45:52 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2021/12/23 23:45:52 App: TestEventingRebOutWithOps got un-deployed
2021/12/23 23:45:52 No eventing-con process running
2021/12/23 23:45:52 Function: TestEventingRebOutWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithOps deleting in background"
}
2021/12/23 23:45:54 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:45:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:45:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:46:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:46:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:46:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebOutWithOps (449.74s)
=== RUN   TestEventingSwapRebWithOps
2021/12/23 23:46:16 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/23 23:46:16 App: TestEventingSwapRebWithOps got un-deployed
2021/12/23 23:46:16 No eventing-con process running
2021/12/23 23:46:16 Function: TestEventingSwapRebWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebWithOps not found"
}
2021/12/23 23:46:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:46:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:46:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:46:24 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:46:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:46:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:46:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:46:34 Deploying app: TestEventingSwapRebWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/23 23:46:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithOps stored in temp store"
}
2021/12/23 23:46:40 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/23 23:46:45 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/23 23:46:50 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/23 23:46:55 Waiting for app: TestEventingSwapRebWithOps to get deployed
2021/12/23 23:46:55 App: TestEventingSwapRebWithOps got deployed
2021/12/23 23:46:55 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/23 23:46:55 Starting bucket ops to source bucket
2021/12/23 23:46:56 Removing node(s): [] from the cluster
2021/12/23 23:47:01 Rebalance progress: 12.5
2021/12/23 23:47:06 Rebalance progress: 12.5
2021/12/23 23:47:11 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:47:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:47:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:47:11 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/23 23:47:11 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 23:47:17 Rebalance progress: 12.5
2021/12/23 23:47:22 Rebalance progress: 12.5
2021/12/23 23:47:27 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:47:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:47:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:47:27 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/23 23:47:32 Rebalance progress: 12.5
2021/12/23 23:47:37 Rebalance progress: 12.5
2021/12/23 23:47:42 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:47:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:47:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:47:42 Waiting for src bucket item count to get to: 200000 curr count: 67621
2021/12/23 23:47:47 Waiting for src bucket item count to get to: 200000 curr count: 67621
2021/12/23 23:47:52 Waiting for src bucket item count to get to: 200000 curr count: 81909
2021/12/23 23:47:57 Waiting for src bucket item count to get to: 200000 curr count: 81909
2021/12/23 23:48:02 Waiting for src bucket item count to get to: 200000 curr count: 98099
2021/12/23 23:48:07 Waiting for src bucket item count to get to: 200000 curr count: 98099
2021/12/23 23:48:12 Waiting for src bucket item count to get to: 200000 curr count: 114455
2021/12/23 23:48:17 Waiting for src bucket item count to get to: 200000 curr count: 114455
2021/12/23 23:48:22 Waiting for src bucket item count to get to: 200000 curr count: 130843
2021/12/23 23:48:27 Waiting for src bucket item count to get to: 200000 curr count: 130843
2021/12/23 23:48:32 Waiting for src bucket item count to get to: 200000 curr count: 147522
2021/12/23 23:48:37 Waiting for src bucket item count to get to: 200000 curr count: 147522
2021/12/23 23:48:42 Waiting for src bucket item count to get to: 200000 curr count: 163991
2021/12/23 23:48:47 Waiting for src bucket item count to get to: 200000 curr count: 163991
2021/12/23 23:48:52 Waiting for src bucket item count to get to: 200000 curr count: 179155
2021/12/23 23:48:57 Waiting for src bucket item count to get to: 200000 curr count: 179155
2021/12/23 23:49:02 Waiting for src bucket item count to get to: 200000 curr count: 179155
2021/12/23 23:49:07 Waiting for src bucket item count to get to: 200000 curr count: 195631
2021/12/23 23:49:12 Waiting for src bucket item count to get to: 200000 curr count: 195631
2021/12/23 23:49:17 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/23 23:49:17 Post SET ops. Expected item count: 200000 got 200000
2021/12/23 23:49:17 Starting bucket ops to source bucket
2021/12/23 23:53:02 Waiting for dst bucket item count to get to: 0 curr count: 14328
2021/12/23 23:53:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:53:02 Post DELETE ops. Expected item count: 0 got 0
2021/12/23 23:53:07 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/23 23:53:12 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/23 23:53:17 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/23 23:53:22 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2021/12/23 23:53:22 App: TestEventingSwapRebWithOps got un-deployed
2021/12/23 23:53:22 No eventing-con process running
2021/12/23 23:53:22 Function: TestEventingSwapRebWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithOps deleting in background"
}
2021/12/23 23:53:24 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:53:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:53:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:53:31 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:53:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:53:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebWithOps (449.96s)
=== RUN   TestKVRebInWithOps
2021/12/23 23:53:46 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/23 23:53:46 App: TestKVRebInWithOps got un-deployed
2021/12/23 23:53:46 No eventing-con process running
2021/12/23 23:53:46 Function: TestKVRebInWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebInWithOps not found"
}
2021/12/23 23:53:47 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:53:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:53:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/23 23:53:54 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:53:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:53:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:54:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/23 23:54:04 Deploying app: TestKVRebInWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/23 23:54:05 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithOps stored in temp store"
}
2021/12/23 23:54:10 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/23 23:54:15 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/23 23:54:20 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/23 23:54:25 Waiting for app: TestKVRebInWithOps to get deployed
2021/12/23 23:54:25 App: TestKVRebInWithOps got deployed
2021/12/23 23:54:25 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/23 23:54:25 Starting bucket ops to source bucket
2021/12/23 23:54:26 Removing node(s): [] from the cluster
2021/12/23 23:54:31 Rebalance progress: 12.5
2021/12/23 23:54:36 Rebalance progress: 12.5
2021/12/23 23:54:41 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:54:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:54:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:54:41 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/23 23:54:46 Rebalance progress: 12.5
2021/12/23 23:54:51 Rebalance progress: 12.5
2021/12/23 23:54:56 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:54:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/23 23:54:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/23 23:54:56 Waiting for src bucket item count to get to: 200000 curr count: 36760
2021/12/23 23:55:01 Waiting for src bucket item count to get to: 200000 curr count: 52953
2021/12/23 23:55:06 Waiting for src bucket item count to get to: 200000 curr count: 52953
2021/12/23 23:55:11 Waiting for src bucket item count to get to: 200000 curr count: 68939
2021/12/23 23:55:16 Waiting for src bucket item count to get to: 200000 curr count: 68939
2021/12/23 23:55:21 Waiting for src bucket item count to get to: 200000 curr count: 83806
2021/12/23 23:55:26 Waiting for src bucket item count to get to: 200000 curr count: 83806
2021/12/23 23:55:31 Waiting for src bucket item count to get to: 200000 curr count: 99854
2021/12/23 23:55:36 Waiting for src bucket item count to get to: 200000 curr count: 99854
2021/12/23 23:55:41 Waiting for src bucket item count to get to: 200000 curr count: 115909
2021/12/23 23:55:46 Waiting for src bucket item count to get to: 200000 curr count: 115909
2021/12/23 23:55:51 Waiting for src bucket item count to get to: 200000 curr count: 131879
2021/12/23 23:55:56 Waiting for src bucket item count to get to: 200000 curr count: 131879
2021/12/23 23:56:01 Waiting for src bucket item count to get to: 200000 curr count: 148199
2021/12/23 23:56:06 Waiting for src bucket item count to get to: 200000 curr count: 148199
2021/12/23 23:56:11 Waiting for src bucket item count to get to: 200000 curr count: 148199
2021/12/23 23:56:16 Waiting for src bucket item count to get to: 200000 curr count: 164325
2021/12/23 23:56:21 Waiting for src bucket item count to get to: 200000 curr count: 164325
2021/12/23 23:56:26 Waiting for src bucket item count to get to: 200000 curr count: 179151
2021/12/23 23:56:31 Waiting for src bucket item count to get to: 200000 curr count: 179151
2021/12/23 23:56:36 Waiting for src bucket item count to get to: 200000 curr count: 195312
2021/12/23 23:56:41 Waiting for src bucket item count to get to: 200000 curr count: 195312
2021/12/23 23:56:46 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/23 23:56:46 Post SET ops. Expected item count: 200000 got 200000
2021/12/23 23:56:46 Starting bucket ops to source bucket
2021/12/24 00:00:32 Waiting for dst bucket item count to get to: 0 curr count: 14894
2021/12/24 00:00:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:00:32 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 00:00:37 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/24 00:00:42 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/24 00:00:47 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/24 00:00:52 Waiting for app: TestKVRebInWithOps to get un-deployed
2021/12/24 00:00:52 App: TestKVRebInWithOps got un-deployed
2021/12/24 00:00:52 No eventing-con process running
2021/12/24 00:00:53 Function: TestKVRebInWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithOps deleting in background"
}
2021/12/24 00:00:54 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:00:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:00:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:01:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:01:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:01:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebInWithOps (450.33s)
=== RUN   TestKVRebOutWithOps
2021/12/24 00:01:11 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 00:01:11 Removing node(s): [] from the cluster
2021/12/24 00:01:16 Rebalance progress: 100
2021/12/24 00:01:21 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/24 00:01:21 App: TestKVRebOutWithOps got un-deployed
2021/12/24 00:01:21 No eventing-con process running
2021/12/24 00:01:21 Function: TestKVRebOutWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebOutWithOps not found"
}
2021/12/24 00:01:23 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:01:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:01:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:01:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:01:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:01:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:01:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:01:40 Deploying app: TestKVRebOutWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 00:01:41 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithOps stored in temp store"
}
2021/12/24 00:01:46 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/24 00:01:51 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/24 00:01:56 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/24 00:02:01 Waiting for app: TestKVRebOutWithOps to get deployed
2021/12/24 00:02:01 App: TestKVRebOutWithOps got deployed
2021/12/24 00:02:01 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 00:02:01 Starting bucket ops to source bucket
2021/12/24 00:02:06 Rebalance progress: 12.5
2021/12/24 00:02:11 Rebalance progress: 12.5
2021/12/24 00:02:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:02:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:02:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:02:16 Waiting for src bucket item count to get to: 200000 curr count: 12195
2021/12/24 00:02:21 Waiting for src bucket item count to get to: 200000 curr count: 28477
2021/12/24 00:02:26 Waiting for src bucket item count to get to: 200000 curr count: 28477
2021/12/24 00:02:31 Waiting for src bucket item count to get to: 200000 curr count: 44893
2021/12/24 00:02:36 Waiting for src bucket item count to get to: 200000 curr count: 44893
2021/12/24 00:02:41 Waiting for src bucket item count to get to: 200000 curr count: 61447
2021/12/24 00:02:46 Waiting for src bucket item count to get to: 200000 curr count: 61447
2021/12/24 00:02:51 Waiting for src bucket item count to get to: 200000 curr count: 61447
2021/12/24 00:02:56 Waiting for src bucket item count to get to: 200000 curr count: 76810
2021/12/24 00:03:01 Waiting for src bucket item count to get to: 200000 curr count: 76810
2021/12/24 00:03:06 Waiting for src bucket item count to get to: 200000 curr count: 92879
2021/12/24 00:03:11 Waiting for src bucket item count to get to: 200000 curr count: 92879
2021/12/24 00:03:16 Waiting for src bucket item count to get to: 200000 curr count: 109461
2021/12/24 00:03:21 Waiting for src bucket item count to get to: 200000 curr count: 109461
2021/12/24 00:03:26 Waiting for src bucket item count to get to: 200000 curr count: 125937
2021/12/24 00:03:31 Waiting for src bucket item count to get to: 200000 curr count: 125937
2021/12/24 00:03:36 Waiting for src bucket item count to get to: 200000 curr count: 142366
2021/12/24 00:03:41 Waiting for src bucket item count to get to: 200000 curr count: 142366
2021/12/24 00:03:46 Waiting for src bucket item count to get to: 200000 curr count: 158948
2021/12/24 00:03:51 Waiting for src bucket item count to get to: 200000 curr count: 158948
2021/12/24 00:03:56 Waiting for src bucket item count to get to: 200000 curr count: 174239
2021/12/24 00:04:01 Waiting for src bucket item count to get to: 200000 curr count: 174239
2021/12/24 00:04:06 Waiting for src bucket item count to get to: 200000 curr count: 190365
2021/12/24 00:04:11 Waiting for src bucket item count to get to: 200000 curr count: 190365
2021/12/24 00:04:16 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 00:04:16 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 00:04:16 Starting bucket ops to source bucket
2021/12/24 00:08:03 Waiting for dst bucket item count to get to: 0 curr count: 15055
2021/12/24 00:08:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:08:03 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 00:08:08 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/24 00:08:13 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/24 00:08:18 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/24 00:08:23 Waiting for app: TestKVRebOutWithOps to get un-deployed
2021/12/24 00:08:23 App: TestKVRebOutWithOps got un-deployed
2021/12/24 00:08:23 No eventing-con process running
2021/12/24 00:08:23 Function: TestKVRebOutWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithOps deleting in background"
}
2021/12/24 00:08:25 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:08:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:08:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:08:31 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:08:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:08:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOutWithOps (450.28s)
=== RUN   TestKVSwapRebWithOps
2021/12/24 00:08:46 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/24 00:08:46 App: TestKVSwapRebWithOps got un-deployed
2021/12/24 00:08:46 No eventing-con process running
2021/12/24 00:08:46 Function: TestKVSwapRebWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVSwapRebWithOps not found"
}
2021/12/24 00:08:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:08:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:08:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:08:55 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:09:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:09:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:09:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:09:05 Deploying app: TestKVSwapRebWithOps. Item count src bucket: 0 dst bucket: 0
2021/12/24 00:09:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithOps stored in temp store"
}
2021/12/24 00:09:11 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/24 00:09:16 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/24 00:09:21 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/24 00:09:26 Waiting for app: TestKVSwapRebWithOps to get deployed
2021/12/24 00:09:26 App: TestKVSwapRebWithOps got deployed
2021/12/24 00:09:26 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 00:09:26 Starting bucket ops to source bucket
2021/12/24 00:09:26 Removing node(s): [] from the cluster
2021/12/24 00:09:31 Rebalance progress: 12.5
2021/12/24 00:09:36 Rebalance progress: 12.5
2021/12/24 00:09:41 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:09:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:09:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:09:41 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 00:09:42 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 00:09:47 Rebalance progress: 12.5
2021/12/24 00:09:52 Rebalance progress: 12.5
2021/12/24 00:09:57 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:09:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:09:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:09:57 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 00:10:02 Rebalance progress: 12.5
2021/12/24 00:10:07 Rebalance progress: 12.5
2021/12/24 00:10:12 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:10:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:10:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:10:12 Waiting for src bucket item count to get to: 200000 curr count: 67191
2021/12/24 00:10:17 Waiting for src bucket item count to get to: 200000 curr count: 67191
2021/12/24 00:10:22 Waiting for src bucket item count to get to: 200000 curr count: 82048
2021/12/24 00:10:27 Waiting for src bucket item count to get to: 200000 curr count: 82048
2021/12/24 00:10:32 Waiting for src bucket item count to get to: 200000 curr count: 98531
2021/12/24 00:10:37 Waiting for src bucket item count to get to: 200000 curr count: 98531
2021/12/24 00:10:42 Waiting for src bucket item count to get to: 200000 curr count: 114673
2021/12/24 00:10:47 Waiting for src bucket item count to get to: 200000 curr count: 114673
2021/12/24 00:10:52 Waiting for src bucket item count to get to: 200000 curr count: 130953
2021/12/24 00:10:57 Waiting for src bucket item count to get to: 200000 curr count: 130953
2021/12/24 00:11:02 Waiting for src bucket item count to get to: 200000 curr count: 147147
2021/12/24 00:11:07 Waiting for src bucket item count to get to: 200000 curr count: 147147
2021/12/24 00:11:12 Waiting for src bucket item count to get to: 200000 curr count: 163300
2021/12/24 00:11:17 Waiting for src bucket item count to get to: 200000 curr count: 163300
2021/12/24 00:11:22 Waiting for src bucket item count to get to: 200000 curr count: 177979
2021/12/24 00:11:27 Waiting for src bucket item count to get to: 200000 curr count: 177979
2021/12/24 00:11:32 Waiting for src bucket item count to get to: 200000 curr count: 177979
2021/12/24 00:11:37 Waiting for src bucket item count to get to: 200000 curr count: 194094
2021/12/24 00:11:42 Waiting for src bucket item count to get to: 200000 curr count: 194094
2021/12/24 00:11:47 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2021/12/24 00:11:47 Post SET ops. Expected item count: 200000 got 200000
2021/12/24 00:11:47 Starting bucket ops to source bucket
2021/12/24 00:15:33 Waiting for dst bucket item count to get to: 0 curr count: 16851
2021/12/24 00:15:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:15:33 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 00:15:38 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/24 00:15:44 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/24 00:15:49 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/24 00:15:54 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2021/12/24 00:15:54 App: TestKVSwapRebWithOps got un-deployed
2021/12/24 00:15:54 No eventing-con process running
2021/12/24 00:15:54 Function: TestKVSwapRebWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithOps deleting in background"
}
2021/12/24 00:15:55 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:16:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:16:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:16:02 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:16:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:16:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebWithOps (450.90s)
=== RUN   TestEventingRebInWithTimers
2021/12/24 00:16:17 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/24 00:16:17 App: TestEventingRebInWithTimers got un-deployed
2021/12/24 00:16:17 No eventing-con process running
2021/12/24 00:16:17 Function: TestEventingRebInWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebInWithTimers not found"
}
2021/12/24 00:16:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:16:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:16:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:16:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:16:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:16:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:16:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:16:36 Deploying app: TestEventingRebInWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/24 00:16:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithTimers stored in temp store"
}
2021/12/24 00:16:42 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/24 00:16:47 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/24 00:16:52 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/24 00:16:57 Waiting for app: TestEventingRebInWithTimers to get deployed
2021/12/24 00:16:57 App: TestEventingRebInWithTimers got deployed
2021/12/24 00:16:57 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 00:16:57 Starting bucket ops to source bucket
2021/12/24 00:16:57 Removing node(s): [] from the cluster
2021/12/24 00:17:02 Rebalance progress: 12.5
2021/12/24 00:17:07 Rebalance progress: 12.5
2021/12/24 00:17:12 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:17:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:17:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:17:12 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 00:17:18 Rebalance progress: 12.5
2021/12/24 00:17:23 Rebalance progress: 12.5
2021/12/24 00:17:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:17:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:17:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:17:28 Waiting for src bucket item count to get to: 50000 curr count: 28124
2021/12/24 00:17:33 Waiting for src bucket item count to get to: 50000 curr count: 39041
2021/12/24 00:17:38 Waiting for src bucket item count to get to: 50000 curr count: 39041
2021/12/24 00:17:48 Waiting for dst bucket item count to get to: 50000 curr count: 34443
2021/12/24 00:17:53 Waiting for dst bucket item count to get to: 50000 curr count: 34443
2021/12/24 00:17:58 Waiting for dst bucket item count to get to: 50000 curr count: 46011
2021/12/24 00:18:03 Waiting for dst bucket item count to get to: 50000 curr count: 46011
2021/12/24 00:18:03 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 00:18:03 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 00:18:03 Starting bucket ops to source bucket
2021/12/24 00:19:12 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:19:17 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:19:22 Waiting for dst bucket item count to get to: 0 curr count: 49522
2021/12/24 00:19:27 Waiting for dst bucket item count to get to: 0 curr count: 49522
2021/12/24 00:19:32 Waiting for dst bucket item count to get to: 0 curr count: 39902
2021/12/24 00:19:37 Waiting for dst bucket item count to get to: 0 curr count: 39902
2021/12/24 00:19:42 Waiting for dst bucket item count to get to: 0 curr count: 30836
2021/12/24 00:19:47 Waiting for dst bucket item count to get to: 0 curr count: 30836
2021/12/24 00:19:52 Waiting for dst bucket item count to get to: 0 curr count: 8290
2021/12/24 00:19:57 Waiting for dst bucket item count to get to: 0 curr count: 8290
2021/12/24 00:19:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:19:57 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 00:20:02 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/24 00:20:08 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/24 00:20:13 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/24 00:20:18 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2021/12/24 00:20:18 App: TestEventingRebInWithTimers got un-deployed
2021/12/24 00:20:18 No eventing-con process running
2021/12/24 00:20:18 Function: TestEventingRebInWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithTimers deleting in background"
}
2021/12/24 00:20:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:20:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:20:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:20:26 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:20:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:20:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebInWithTimers (263.93s)
=== RUN   TestEventingRebOutWithTimers
2021/12/24 00:20:36 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 00:20:36 Removing node(s): [] from the cluster
2021/12/24 00:20:41 Rebalance progress: 100
2021/12/24 00:20:46 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/24 00:20:46 App: TestEventingRebOutWithTimers got un-deployed
2021/12/24 00:20:46 No eventing-con process running
2021/12/24 00:20:46 Function: TestEventingRebOutWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebOutWithTimers not found"
}
2021/12/24 00:20:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:20:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:20:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:20:55 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:21:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:21:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:21:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:21:05 Deploying app: TestEventingRebOutWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/24 00:21:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithTimers stored in temp store"
}
2021/12/24 00:21:11 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/24 00:21:16 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/24 00:21:21 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/24 00:21:26 Waiting for app: TestEventingRebOutWithTimers to get deployed
2021/12/24 00:21:26 App: TestEventingRebOutWithTimers got deployed
2021/12/24 00:21:26 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 00:21:26 Starting bucket ops to source bucket
2021/12/24 00:21:31 Rebalance progress: 12.5
2021/12/24 00:21:36 Rebalance progress: 12.5
2021/12/24 00:21:41 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:21:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:21:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:21:41 Waiting for src bucket item count to get to: 50000 curr count: 18719
2021/12/24 00:21:46 Waiting for src bucket item count to get to: 50000 curr count: 18719
2021/12/24 00:21:51 Waiting for src bucket item count to get to: 50000 curr count: 30800
2021/12/24 00:21:56 Waiting for src bucket item count to get to: 50000 curr count: 30800
2021/12/24 00:22:01 Waiting for src bucket item count to get to: 50000 curr count: 42148
2021/12/24 00:22:06 Waiting for src bucket item count to get to: 50000 curr count: 42148
2021/12/24 00:22:16 Waiting for dst bucket item count to get to: 50000 curr count: 36169
2021/12/24 00:22:21 Waiting for dst bucket item count to get to: 50000 curr count: 36169
2021/12/24 00:22:26 Waiting for dst bucket item count to get to: 50000 curr count: 36169
2021/12/24 00:22:31 Waiting for dst bucket item count to get to: 50000 curr count: 43588
2021/12/24 00:22:36 Waiting for dst bucket item count to get to: 50000 curr count: 43588
2021/12/24 00:22:36 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 00:22:36 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 00:22:36 Starting bucket ops to source bucket
2021/12/24 00:23:45 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:23:50 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:23:55 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:24:00 Waiting for dst bucket item count to get to: 0 curr count: 48678
2021/12/24 00:24:05 Waiting for dst bucket item count to get to: 0 curr count: 48678
2021/12/24 00:24:10 Waiting for dst bucket item count to get to: 0 curr count: 38223
2021/12/24 00:24:15 Waiting for dst bucket item count to get to: 0 curr count: 38223
2021/12/24 00:24:20 Waiting for dst bucket item count to get to: 0 curr count: 17229
2021/12/24 00:24:25 Waiting for dst bucket item count to get to: 0 curr count: 17229
2021/12/24 00:24:30 Waiting for dst bucket item count to get to: 0 curr count: 5030
2021/12/24 00:24:35 Waiting for dst bucket item count to get to: 0 curr count: 5030
2021/12/24 00:24:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:24:35 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 00:24:41 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/24 00:24:46 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/24 00:24:51 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/24 00:24:56 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2021/12/24 00:24:56 App: TestEventingRebOutWithTimers got un-deployed
2021/12/24 00:24:56 No eventing-con process running
2021/12/24 00:24:56 Function: TestEventingRebOutWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithTimers deleting in background"
}
2021/12/24 00:24:58 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:25:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:25:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:25:04 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:25:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:25:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebOutWithTimers (278.17s)
=== RUN   TestEventingSwapRebWithTimers
2021/12/24 00:25:19 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/24 00:25:19 App: TestEventingSwapRebWithTimers got un-deployed
2021/12/24 00:25:19 No eventing-con process running
2021/12/24 00:25:19 Function: TestEventingSwapRebWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebWithTimers not found"
}
2021/12/24 00:25:21 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:25:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:25:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:25:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:25:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:25:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:25:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:25:38 Deploying app: TestEventingSwapRebWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/24 00:25:39 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithTimers stored in temp store"
}
2021/12/24 00:25:44 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/24 00:25:49 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/24 00:25:54 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/24 00:25:59 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2021/12/24 00:25:59 App: TestEventingSwapRebWithTimers got deployed
2021/12/24 00:25:59 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 00:25:59 Starting bucket ops to source bucket
2021/12/24 00:25:59 Removing node(s): [] from the cluster
2021/12/24 00:26:05 Rebalance progress: 12.5
2021/12/24 00:26:10 Rebalance progress: 12.5
2021/12/24 00:26:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:26:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:26:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:26:15 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 00:26:15 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 00:26:20 Rebalance progress: 12.5
2021/12/24 00:26:25 Rebalance progress: 12.5
2021/12/24 00:26:30 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:26:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:26:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:26:30 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 00:26:35 Rebalance progress: 12.5
2021/12/24 00:26:40 Rebalance progress: 12.5
2021/12/24 00:26:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:26:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:26:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:26:45 Waiting for src bucket item count to get to: 50000 curr count: 48007
2021/12/24 00:26:50 Waiting for src bucket item count to get to: 50000 curr count: 48007
2021/12/24 00:27:00 Waiting for dst bucket item count to get to: 50000 curr count: 43331
2021/12/24 00:27:05 Waiting for dst bucket item count to get to: 50000 curr count: 43331
2021/12/24 00:27:10 Waiting for dst bucket item count to get to: 50000 curr count: 49710
2021/12/24 00:27:15 Waiting for dst bucket item count to get to: 50000 curr count: 49710
2021/12/24 00:27:15 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 00:27:15 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 00:27:15 Starting bucket ops to source bucket
2021/12/24 00:28:24 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:28:29 Waiting for dst bucket item count to get to: 0 curr count: 49392
2021/12/24 00:28:34 Waiting for dst bucket item count to get to: 0 curr count: 49392
2021/12/24 00:28:39 Waiting for dst bucket item count to get to: 0 curr count: 44991
2021/12/24 00:28:44 Waiting for dst bucket item count to get to: 0 curr count: 44991
2021/12/24 00:28:49 Waiting for dst bucket item count to get to: 0 curr count: 34472
2021/12/24 00:28:54 Waiting for dst bucket item count to get to: 0 curr count: 34472
2021/12/24 00:28:59 Waiting for dst bucket item count to get to: 0 curr count: 12022
2021/12/24 00:29:04 Waiting for dst bucket item count to get to: 0 curr count: 12022
2021/12/24 00:29:09 Waiting for dst bucket item count to get to: 0 curr count: 2042
2021/12/24 00:29:14 Waiting for dst bucket item count to get to: 0 curr count: 2042
2021/12/24 00:29:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:29:14 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 00:29:19 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/24 00:29:24 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/24 00:29:29 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/24 00:29:34 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2021/12/24 00:29:34 App: TestEventingSwapRebWithTimers got un-deployed
2021/12/24 00:29:35 No eventing-con process running
2021/12/24 00:29:35 Function: TestEventingSwapRebWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithTimers deleting in background"
}
2021/12/24 00:29:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:29:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:29:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:29:43 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:29:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:29:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebWithTimers (278.69s)
=== RUN   TestKVRebInWithTimers
2021/12/24 00:29:58 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/24 00:29:58 App: TestKVRebInWithTimers got un-deployed
2021/12/24 00:29:58 No eventing-con process running
2021/12/24 00:29:58 Function: TestKVRebInWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebInWithTimers not found"
}
2021/12/24 00:30:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:30:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:30:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:30:06 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:30:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:30:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:30:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:30:16 Deploying app: TestKVRebInWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/24 00:30:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithTimers stored in temp store"
}
2021/12/24 00:30:23 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/24 00:30:28 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/24 00:30:33 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/24 00:30:38 Waiting for app: TestKVRebInWithTimers to get deployed
2021/12/24 00:30:38 App: TestKVRebInWithTimers got deployed
2021/12/24 00:30:38 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 00:30:38 Starting bucket ops to source bucket
2021/12/24 00:30:38 Removing node(s): [] from the cluster
2021/12/24 00:30:43 Rebalance progress: 12.5
2021/12/24 00:30:48 Rebalance progress: 12.5
2021/12/24 00:30:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:30:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:30:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:30:53 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 00:30:58 Rebalance progress: 12.5
2021/12/24 00:31:03 Rebalance progress: 12.5
2021/12/24 00:31:08 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:31:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:31:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:31:08 Waiting for src bucket item count to get to: 50000 curr count: 28346
2021/12/24 00:31:13 Waiting for src bucket item count to get to: 50000 curr count: 38147
2021/12/24 00:31:18 Waiting for src bucket item count to get to: 50000 curr count: 38147
2021/12/24 00:31:28 Waiting for dst bucket item count to get to: 50000 curr count: 28851
2021/12/24 00:31:33 Waiting for dst bucket item count to get to: 50000 curr count: 28851
2021/12/24 00:31:38 Waiting for dst bucket item count to get to: 50000 curr count: 44066
2021/12/24 00:31:43 Waiting for dst bucket item count to get to: 50000 curr count: 44066
2021/12/24 00:31:43 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 00:31:43 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 00:31:43 Starting bucket ops to source bucket
2021/12/24 00:32:53 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:32:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:33:03 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:33:08 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:33:13 Waiting for dst bucket item count to get to: 0 curr count: 40252
2021/12/24 00:33:18 Waiting for dst bucket item count to get to: 0 curr count: 40252
2021/12/24 00:33:23 Waiting for dst bucket item count to get to: 0 curr count: 30253
2021/12/24 00:33:28 Waiting for dst bucket item count to get to: 0 curr count: 13668
2021/12/24 00:33:33 Waiting for dst bucket item count to get to: 0 curr count: 13668
2021/12/24 00:33:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:33:33 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 00:33:38 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/24 00:33:43 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/24 00:33:48 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/24 00:33:53 Waiting for app: TestKVRebInWithTimers to get un-deployed
2021/12/24 00:33:53 App: TestKVRebInWithTimers got un-deployed
2021/12/24 00:33:53 No eventing-con process running
2021/12/24 00:33:53 Function: TestKVRebInWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithTimers deleting in background"
}
2021/12/24 00:33:55 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:34:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:34:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:34:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:34:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:34:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebInWithTimers (258.49s)
=== RUN   TestKVRebOutWithTimers
2021/12/24 00:34:11 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 00:34:12 Removing node(s): [] from the cluster
2021/12/24 00:34:17 Rebalance progress: 100
2021/12/24 00:34:22 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/24 00:34:22 App: TestKVRebOutWithTimers got un-deployed
2021/12/24 00:34:22 No eventing-con process running
2021/12/24 00:34:22 Function: TestKVRebOutWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebOutWithTimers not found"
}
2021/12/24 00:34:23 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:34:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:34:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:34:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:34:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:34:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:34:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:34:40 Deploying app: TestKVRebOutWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/24 00:34:41 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithTimers stored in temp store"
}
2021/12/24 00:34:46 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/24 00:34:51 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/24 00:34:56 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/24 00:35:01 Waiting for app: TestKVRebOutWithTimers to get deployed
2021/12/24 00:35:01 App: TestKVRebOutWithTimers got deployed
2021/12/24 00:35:01 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 00:35:01 Starting bucket ops to source bucket
2021/12/24 00:35:06 Rebalance progress: 12.5
2021/12/24 00:35:11 Rebalance progress: 12.5
2021/12/24 00:35:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:35:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:35:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:35:17 Waiting for src bucket item count to get to: 50000 curr count: 10589
2021/12/24 00:35:22 Waiting for src bucket item count to get to: 50000 curr count: 23667
2021/12/24 00:35:27 Waiting for src bucket item count to get to: 50000 curr count: 23667
2021/12/24 00:35:32 Waiting for src bucket item count to get to: 50000 curr count: 35067
2021/12/24 00:35:37 Waiting for src bucket item count to get to: 50000 curr count: 35067
2021/12/24 00:35:42 Waiting for src bucket item count to get to: 50000 curr count: 45453
2021/12/24 00:35:47 Waiting for src bucket item count to get to: 50000 curr count: 45453
2021/12/24 00:35:52 Waiting for src bucket item count to get to: 50000 curr count: 45453
2021/12/24 00:36:02 Waiting for dst bucket item count to get to: 50000 curr count: 39114
2021/12/24 00:36:07 Waiting for dst bucket item count to get to: 50000 curr count: 39114
2021/12/24 00:36:07 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 00:36:07 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 00:36:07 Starting bucket ops to source bucket
2021/12/24 00:37:16 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:37:21 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:37:26 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:37:31 Waiting for dst bucket item count to get to: 0 curr count: 47559
2021/12/24 00:37:36 Waiting for dst bucket item count to get to: 0 curr count: 47559
2021/12/24 00:37:41 Waiting for dst bucket item count to get to: 0 curr count: 32938
2021/12/24 00:37:46 Waiting for dst bucket item count to get to: 0 curr count: 32938
2021/12/24 00:37:51 Waiting for dst bucket item count to get to: 0 curr count: 15120
2021/12/24 00:37:56 Waiting for dst bucket item count to get to: 0 curr count: 15120
2021/12/24 00:38:01 Waiting for dst bucket item count to get to: 0 curr count: 570
2021/12/24 00:38:06 Waiting for dst bucket item count to get to: 0 curr count: 570
2021/12/24 00:38:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:38:06 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 00:38:11 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/24 00:38:17 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/24 00:38:22 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/24 00:38:27 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2021/12/24 00:38:27 App: TestKVRebOutWithTimers got un-deployed
2021/12/24 00:38:27 No eventing-con process running
2021/12/24 00:38:27 Function: TestKVRebOutWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithTimers deleting in background"
}
2021/12/24 00:38:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:38:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:38:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:38:35 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:38:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:38:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOutWithTimers (273.71s)
=== RUN   TestKVSwapRebWithTimers
2021/12/24 00:38:50 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/24 00:38:50 App: TestKVSwapRebWithTimers got un-deployed
2021/12/24 00:38:50 No eventing-con process running
2021/12/24 00:38:50 Function: TestKVSwapRebWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVSwapRebWithTimers not found"
}
2021/12/24 00:38:52 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:38:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:38:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:38:59 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:39:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:39:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:39:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:39:09 Deploying app: TestKVSwapRebWithTimers. Item count src bucket: 0 dst bucket: 0
2021/12/24 00:39:10 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithTimers stored in temp store"
}
2021/12/24 00:39:15 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/24 00:39:20 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/24 00:39:25 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/24 00:39:30 Waiting for app: TestKVSwapRebWithTimers to get deployed
2021/12/24 00:39:30 App: TestKVSwapRebWithTimers got deployed
2021/12/24 00:39:30 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 00:39:30 Starting bucket ops to source bucket
2021/12/24 00:39:30 Removing node(s): [] from the cluster
2021/12/24 00:39:35 Rebalance progress: 12.5
2021/12/24 00:39:40 Rebalance progress: 12.5
2021/12/24 00:39:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:39:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:39:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:39:45 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 00:39:46 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 00:39:51 Rebalance progress: 12.5
2021/12/24 00:39:56 Rebalance progress: 12.5
2021/12/24 00:40:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:40:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:40:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:40:01 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 00:40:06 Rebalance progress: 12.5
2021/12/24 00:40:11 Rebalance progress: 12.5
2021/12/24 00:40:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:40:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:40:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:40:16 Waiting for src bucket item count to get to: 50000 curr count: 47407
2021/12/24 00:40:26 Waiting for dst bucket item count to get to: 50000 curr count: 39654
2021/12/24 00:40:31 Waiting for dst bucket item count to get to: 50000 curr count: 39654
2021/12/24 00:40:31 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 00:40:31 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 00:40:31 Starting bucket ops to source bucket
2021/12/24 00:41:40 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:41:45 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:41:50 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:41:55 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:42:00 Waiting for dst bucket item count to get to: 0 curr count: 42886
2021/12/24 00:42:05 Waiting for dst bucket item count to get to: 0 curr count: 42886
2021/12/24 00:42:10 Waiting for dst bucket item count to get to: 0 curr count: 23623
2021/12/24 00:42:15 Waiting for dst bucket item count to get to: 0 curr count: 23623
2021/12/24 00:42:20 Waiting for dst bucket item count to get to: 0 curr count: 11802
2021/12/24 00:42:25 Waiting for dst bucket item count to get to: 0 curr count: 11802
2021/12/24 00:42:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:42:25 Post DELETE ops. Expected item count: 0 got 0
2021/12/24 00:42:30 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/24 00:42:36 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/24 00:42:41 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/24 00:42:46 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/24 00:42:51 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2021/12/24 00:42:51 App: TestKVSwapRebWithTimers got un-deployed
2021/12/24 00:42:51 No eventing-con process running
2021/12/24 00:42:51 Function: TestKVSwapRebWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithTimers deleting in background"
}
2021/12/24 00:42:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:42:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:42:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:42:59 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:43:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:43:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebWithTimers (264.14s)
=== RUN   TestDuplicateTimerCreationEventingRebIn
2021/12/24 00:43:14 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/24 00:43:14 App: TestDuplicateTimerCreationEventingRebIn got un-deployed
2021/12/24 00:43:14 No eventing-con process running
2021/12/24 00:43:14 Function: TestDuplicateTimerCreationEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingRebIn not found"
}
2021/12/24 00:43:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:43:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:43:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:43:23 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:43:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:43:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:43:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:43:33 Deploying app: TestDuplicateTimerCreationEventingRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/24 00:43:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebIn stored in temp store"
}
2021/12/24 00:43:39 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/24 00:43:44 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/24 00:43:49 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/24 00:43:54 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2021/12/24 00:43:54 App: TestDuplicateTimerCreationEventingRebIn got deployed
2021/12/24 00:43:54 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 00:43:54 Starting bucket ops to source bucket
2021/12/24 00:43:55 Removing node(s): [] from the cluster
2021/12/24 00:44:00 Rebalance progress: 12.5
2021/12/24 00:44:05 Rebalance progress: 12.5
2021/12/24 00:44:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:44:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:44:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:44:10 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 00:44:15 Rebalance progress: 12.5
2021/12/24 00:44:20 Rebalance progress: 12.5
2021/12/24 00:44:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:44:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:44:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:44:25 Waiting for src bucket item count to get to: 50000 curr count: 32348
2021/12/24 00:44:30 Waiting for src bucket item count to get to: 50000 curr count: 32348
2021/12/24 00:44:35 Waiting for src bucket item count to get to: 50000 curr count: 42679
2021/12/24 00:44:40 Waiting for src bucket item count to get to: 50000 curr count: 42679
2021/12/24 00:44:50 Waiting for dst bucket item count to get to: 50000 curr count: 29779
2021/12/24 00:44:55 Waiting for dst bucket item count to get to: 50000 curr count: 29779
2021/12/24 00:45:00 Waiting for dst bucket item count to get to: 50000 curr count: 35469
2021/12/24 00:45:05 Waiting for dst bucket item count to get to: 50000 curr count: 35469
2021/12/24 00:45:05 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 00:45:05 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 00:45:10 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/24 00:45:15 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/24 00:45:20 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/24 00:45:26 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/24 00:45:31 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2021/12/24 00:45:31 App: TestDuplicateTimerCreationEventingRebIn got un-deployed
2021/12/24 00:45:31 No eventing-con process running
2021/12/24 00:45:31 Function: TestDuplicateTimerCreationEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebIn deleting in background"
}
2021/12/24 00:45:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:45:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:45:42 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:45:47 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:45:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:45:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:45:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:45:59 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:45:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingRebIn (174.87s)
=== RUN   TestDuplicateTimerCreationEventingRebOut
2021/12/24 00:46:04 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 00:46:04 Removing node(s): [] from the cluster
2021/12/24 00:46:09 Rebalance progress: 100
2021/12/24 00:46:14 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/24 00:46:14 App: TestDuplicateTimerCreationEventingRebOut got un-deployed
2021/12/24 00:46:14 No eventing-con process running
2021/12/24 00:46:14 Function: TestDuplicateTimerCreationEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingRebOut not found"
}
2021/12/24 00:46:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:46:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:46:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:46:23 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:46:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:46:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:46:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:46:33 Deploying app: TestDuplicateTimerCreationEventingRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/24 00:46:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebOut stored in temp store"
}
2021/12/24 00:46:39 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2021/12/24 00:46:44 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2021/12/24 00:46:49 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2021/12/24 00:46:54 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2021/12/24 00:46:54 App: TestDuplicateTimerCreationEventingRebOut got deployed
2021/12/24 00:46:54 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 00:46:54 Starting bucket ops to source bucket
2021/12/24 00:46:59 Rebalance progress: 12.5
2021/12/24 00:47:04 Rebalance progress: 12.5
2021/12/24 00:47:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:47:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:47:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:47:09 Waiting for src bucket item count to get to: 50000 curr count: 6280
2021/12/24 00:47:14 Waiting for src bucket item count to get to: 50000 curr count: 20147
2021/12/24 00:47:19 Waiting for src bucket item count to get to: 50000 curr count: 20147
2021/12/24 00:47:24 Waiting for src bucket item count to get to: 50000 curr count: 32462
2021/12/24 00:47:29 Waiting for src bucket item count to get to: 50000 curr count: 32462
2021/12/24 00:47:34 Waiting for src bucket item count to get to: 50000 curr count: 42939
2021/12/24 00:47:39 Waiting for src bucket item count to get to: 50000 curr count: 42939
2021/12/24 00:47:49 Waiting for dst bucket item count to get to: 50000 curr count: 32703
2021/12/24 00:47:54 Waiting for dst bucket item count to get to: 50000 curr count: 32703
2021/12/24 00:47:59 Waiting for dst bucket item count to get to: 50000 curr count: 32703
2021/12/24 00:48:04 Waiting for dst bucket item count to get to: 50000 curr count: 39721
2021/12/24 00:48:09 Waiting for dst bucket item count to get to: 50000 curr count: 39721
2021/12/24 00:48:09 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 00:48:09 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 00:48:14 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/24 00:48:20 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/24 00:48:25 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/24 00:48:30 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/24 00:48:35 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2021/12/24 00:48:35 App: TestDuplicateTimerCreationEventingRebOut got un-deployed
2021/12/24 00:48:35 No eventing-con process running
2021/12/24 00:48:35 Function: TestDuplicateTimerCreationEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebOut deleting in background"
}
2021/12/24 00:48:37 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:48:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:48:47 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:48:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:48:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:48:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:48:59 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:48:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingRebOut (179.36s)
=== RUN   TestDuplicateTimerCreationEventingSwapReb
2021/12/24 00:49:09 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/24 00:49:09 App: TestDuplicateTimerCreationEventingSwapReb got un-deployed
2021/12/24 00:49:09 No eventing-con process running
2021/12/24 00:49:09 Function: TestDuplicateTimerCreationEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingSwapReb not found"
}
2021/12/24 00:49:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:49:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:49:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:49:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:49:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:49:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:49:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:49:27 Deploying app: TestDuplicateTimerCreationEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/24 00:49:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingSwapReb stored in temp store"
}
2021/12/24 00:49:33 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/24 00:49:38 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/24 00:49:43 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/24 00:49:48 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2021/12/24 00:49:48 App: TestDuplicateTimerCreationEventingSwapReb got deployed
2021/12/24 00:49:48 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 00:49:48 Starting bucket ops to source bucket
2021/12/24 00:49:49 Removing node(s): [] from the cluster
2021/12/24 00:49:54 Rebalance progress: 12.5
2021/12/24 00:49:59 Rebalance progress: 12.5
2021/12/24 00:50:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:50:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:50:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:50:04 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 00:50:05 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 00:50:10 Rebalance progress: 12.5
2021/12/24 00:50:15 Rebalance progress: 12.5
2021/12/24 00:50:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:50:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:50:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:50:20 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 00:50:25 Rebalance progress: 12.5
2021/12/24 00:50:30 Rebalance progress: 12.5
2021/12/24 00:50:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:50:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:50:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:50:35 Waiting for src bucket item count to get to: 50000 curr count: 46751
2021/12/24 00:50:40 Waiting for src bucket item count to get to: 50000 curr count: 46751
2021/12/24 00:50:50 Waiting for dst bucket item count to get to: 50000 curr count: 38317
2021/12/24 00:50:55 Waiting for dst bucket item count to get to: 50000 curr count: 38317
2021/12/24 00:51:00 Waiting for dst bucket item count to get to: 50000 curr count: 45529
2021/12/24 00:51:05 Waiting for dst bucket item count to get to: 50000 curr count: 45529
2021/12/24 00:51:05 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 00:51:05 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 00:51:10 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/24 00:51:15 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/24 00:51:20 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/24 00:51:25 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/24 00:51:30 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2021/12/24 00:51:30 App: TestDuplicateTimerCreationEventingSwapReb got un-deployed
2021/12/24 00:51:30 No eventing-con process running
2021/12/24 00:51:31 Function: TestDuplicateTimerCreationEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingSwapReb deleting in background"
}
2021/12/24 00:51:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:51:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:51:42 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:51:47 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:51:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:51:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:51:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:51:59 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:51:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingSwapReb (180.47s)
=== RUN   TestDuplicateTimerCreationKVRebIn
2021/12/24 00:52:09 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/24 00:52:09 App: TestDuplicateTimerCreationKVRebIn got un-deployed
2021/12/24 00:52:09 No eventing-con process running
2021/12/24 00:52:09 Function: TestDuplicateTimerCreationKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVRebIn not found"
}
2021/12/24 00:52:11 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:52:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:52:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:52:18 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:52:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:52:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:52:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:52:28 Deploying app: TestDuplicateTimerCreationKVRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/24 00:52:29 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebIn stored in temp store"
}
2021/12/24 00:52:34 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/24 00:52:39 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/24 00:52:44 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/24 00:52:49 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2021/12/24 00:52:49 App: TestDuplicateTimerCreationKVRebIn got deployed
2021/12/24 00:52:49 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 00:52:49 Starting bucket ops to source bucket
2021/12/24 00:52:49 Removing node(s): [] from the cluster
2021/12/24 00:52:54 Rebalance progress: 12.5
2021/12/24 00:52:59 Rebalance progress: 12.5
2021/12/24 00:53:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:53:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:53:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:53:04 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 00:53:09 Rebalance progress: 12.5
2021/12/24 00:53:14 Rebalance progress: 12.5
2021/12/24 00:53:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:53:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:53:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:53:19 Waiting for src bucket item count to get to: 50000 curr count: 26738
2021/12/24 00:53:24 Waiting for src bucket item count to get to: 50000 curr count: 38573
2021/12/24 00:53:29 Waiting for src bucket item count to get to: 50000 curr count: 38573
2021/12/24 00:53:34 Waiting for src bucket item count to get to: 50000 curr count: 49638
2021/12/24 00:53:39 Waiting for src bucket item count to get to: 50000 curr count: 49638
2021/12/24 00:53:49 Waiting for dst bucket item count to get to: 50000 curr count: 35614
2021/12/24 00:53:54 Waiting for dst bucket item count to get to: 50000 curr count: 35614
2021/12/24 00:53:59 Waiting for dst bucket item count to get to: 50000 curr count: 43614
2021/12/24 00:54:04 Waiting for dst bucket item count to get to: 50000 curr count: 43614
2021/12/24 00:54:04 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 00:54:04 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 00:54:10 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/24 00:54:15 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/24 00:54:20 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/24 00:54:25 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/24 00:54:30 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2021/12/24 00:54:30 App: TestDuplicateTimerCreationKVRebIn got un-deployed
2021/12/24 00:54:30 No eventing-con process running
2021/12/24 00:54:30 Function: TestDuplicateTimerCreationKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebIn deleting in background"
}
2021/12/24 00:54:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:54:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:54:42 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:54:47 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:54:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:54:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:54:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:54:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:54:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVRebIn (179.32s)
=== RUN   TestDuplicateTimerCreationKVRebOut
2021/12/24 00:55:03 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 00:55:04 Removing node(s): [] from the cluster
2021/12/24 00:55:09 Rebalance progress: 100
2021/12/24 00:55:14 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/24 00:55:14 App: TestDuplicateTimerCreationKVRebOut got un-deployed
2021/12/24 00:55:14 No eventing-con process running
2021/12/24 00:55:14 Function: TestDuplicateTimerCreationKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVRebOut not found"
}
2021/12/24 00:55:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:55:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:55:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:55:22 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:55:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:55:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:55:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:55:32 Deploying app: TestDuplicateTimerCreationKVRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/24 00:55:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebOut stored in temp store"
}
2021/12/24 00:55:38 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/24 00:55:43 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/24 00:55:48 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/24 00:55:53 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2021/12/24 00:55:54 App: TestDuplicateTimerCreationKVRebOut got deployed
2021/12/24 00:55:54 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 00:55:54 Starting bucket ops to source bucket
2021/12/24 00:55:59 Rebalance progress: 12.5
2021/12/24 00:56:04 Rebalance progress: 12.5
2021/12/24 00:56:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:56:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:56:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:56:09 Waiting for src bucket item count to get to: 50000 curr count: 6973
2021/12/24 00:56:14 Waiting for src bucket item count to get to: 50000 curr count: 20527
2021/12/24 00:56:19 Waiting for src bucket item count to get to: 50000 curr count: 20527
2021/12/24 00:56:24 Waiting for src bucket item count to get to: 50000 curr count: 33111
2021/12/24 00:56:29 Waiting for src bucket item count to get to: 50000 curr count: 33111
2021/12/24 00:56:34 Waiting for src bucket item count to get to: 50000 curr count: 43071
2021/12/24 00:56:39 Waiting for src bucket item count to get to: 50000 curr count: 43071
2021/12/24 00:56:44 Waiting for src bucket item count to get to: 50000 curr count: 43071
2021/12/24 00:56:54 Waiting for dst bucket item count to get to: 50000 curr count: 31980
2021/12/24 00:56:59 Waiting for dst bucket item count to get to: 50000 curr count: 31980
2021/12/24 00:57:04 Waiting for dst bucket item count to get to: 50000 curr count: 41015
2021/12/24 00:57:09 Waiting for dst bucket item count to get to: 50000 curr count: 41015
2021/12/24 00:57:09 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 00:57:09 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 00:57:14 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/24 00:57:19 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/24 00:57:24 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/24 00:57:29 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/24 00:57:34 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2021/12/24 00:57:34 App: TestDuplicateTimerCreationKVRebOut got un-deployed
2021/12/24 00:57:34 No eventing-con process running
2021/12/24 00:57:34 Function: TestDuplicateTimerCreationKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebOut deleting in background"
}
2021/12/24 00:57:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:57:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:57:46 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:57:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:57:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:57:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:57:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 00:57:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVRebOut (179.54s)
=== RUN   TestDuplicateTimerCreationKVSwapReb
2021/12/24 00:58:08 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/24 00:58:08 App: TestDuplicateTimerCreationKVSwapReb got un-deployed
2021/12/24 00:58:08 No eventing-con process running
2021/12/24 00:58:08 Function: TestDuplicateTimerCreationKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVSwapReb not found"
}
2021/12/24 00:58:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:58:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:58:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 00:58:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:58:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:58:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:58:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 00:58:26 Deploying app: TestDuplicateTimerCreationKVSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/24 00:58:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVSwapReb stored in temp store"
}
2021/12/24 00:58:33 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/24 00:58:38 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/24 00:58:43 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/24 00:58:48 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2021/12/24 00:58:48 App: TestDuplicateTimerCreationKVSwapReb got deployed
2021/12/24 00:58:48 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 00:58:48 Starting bucket ops to source bucket
2021/12/24 00:58:48 Removing node(s): [] from the cluster
2021/12/24 00:58:53 Rebalance progress: 12.5
2021/12/24 00:58:58 Rebalance progress: 12.5
2021/12/24 00:59:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:59:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:59:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:59:03 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 00:59:04 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 00:59:09 Rebalance progress: 12.5
2021/12/24 00:59:14 Rebalance progress: 12.5
2021/12/24 00:59:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:59:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:59:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:59:19 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 00:59:24 Rebalance progress: 12.5
2021/12/24 00:59:29 Rebalance progress: 12.5
2021/12/24 00:59:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:59:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 00:59:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 00:59:34 Waiting for src bucket item count to get to: 50000 curr count: 47761
2021/12/24 00:59:39 Waiting for src bucket item count to get to: 50000 curr count: 47761
2021/12/24 00:59:49 Waiting for dst bucket item count to get to: 50000 curr count: 38334
2021/12/24 00:59:54 Waiting for dst bucket item count to get to: 50000 curr count: 38334
2021/12/24 00:59:59 Waiting for dst bucket item count to get to: 50000 curr count: 45424
2021/12/24 01:00:04 Waiting for dst bucket item count to get to: 50000 curr count: 45424
2021/12/24 01:00:04 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 01:00:04 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 01:00:09 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/24 01:00:14 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/24 01:00:20 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/24 01:00:25 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/24 01:00:30 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2021/12/24 01:00:30 App: TestDuplicateTimerCreationKVSwapReb got un-deployed
2021/12/24 01:00:30 No eventing-con process running
2021/12/24 01:00:30 Function: TestDuplicateTimerCreationKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVSwapReb deleting in background"
}
2021/12/24 01:00:31 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:00:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:00:41 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 01:00:46 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 01:00:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:00:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:00:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:00:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 01:00:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVSwapReb (180.36s)
=== RUN   TestDuplicateTimerFiringEventingRebIn
2021/12/24 01:01:08 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/24 01:01:08 App: TestDuplicateTimerFiringEventingRebIn got un-deployed
2021/12/24 01:01:08 No eventing-con process running
2021/12/24 01:01:08 Function: TestDuplicateTimerFiringEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingRebIn not found"
}
2021/12/24 01:01:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:01:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:01:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:01:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:01:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:01:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:01:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:01:27 Deploying app: TestDuplicateTimerFiringEventingRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/24 01:01:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebIn stored in temp store"
}
2021/12/24 01:01:33 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/24 01:01:38 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/24 01:01:43 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/24 01:01:48 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2021/12/24 01:01:48 App: TestDuplicateTimerFiringEventingRebIn got deployed
2021/12/24 01:01:48 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 01:01:48 Starting bucket ops to source bucket
2021/12/24 01:01:49 Removing node(s): [] from the cluster
2021/12/24 01:01:54 Rebalance progress: 12.5
2021/12/24 01:01:59 Rebalance progress: 12.5
2021/12/24 01:02:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:02:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:02:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:02:04 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 01:02:09 Rebalance progress: 12.5
2021/12/24 01:02:14 Rebalance progress: 12.5
2021/12/24 01:02:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:02:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:02:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:02:19 Waiting for src bucket item count to get to: 50000 curr count: 28018
2021/12/24 01:02:24 Waiting for src bucket item count to get to: 50000 curr count: 37620
2021/12/24 01:02:29 Waiting for src bucket item count to get to: 50000 curr count: 37620
2021/12/24 01:02:34 Waiting for src bucket item count to get to: 50000 curr count: 49899
2021/12/24 01:02:39 Waiting for src bucket item count to get to: 50000 curr count: 49899
2021/12/24 01:02:49 Waiting for dst bucket item count to get to: 50000 curr count: 42564
2021/12/24 01:02:54 Waiting for dst bucket item count to get to: 50000 curr count: 42564
2021/12/24 01:02:59 Waiting for dst bucket item count to get to: 50000 curr count: 49885
2021/12/24 01:03:04 Waiting for dst bucket item count to get to: 50000 curr count: 49885
2021/12/24 01:03:04 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 01:03:04 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 01:03:09 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/24 01:03:14 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/24 01:03:20 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/24 01:03:25 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/24 01:03:30 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2021/12/24 01:03:30 App: TestDuplicateTimerFiringEventingRebIn got un-deployed
2021/12/24 01:03:30 No eventing-con process running
2021/12/24 01:03:30 Function: TestDuplicateTimerFiringEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebIn deleting in background"
}
2021/12/24 01:03:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:03:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:03:42 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 01:03:47 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 01:03:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:03:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:03:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:03:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 01:03:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingRebIn (180.12s)
=== RUN   TestDuplicateTimerFiringEventingRebOut
2021/12/24 01:04:03 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 01:04:04 Removing node(s): [] from the cluster
2021/12/24 01:04:09 Rebalance progress: 100
2021/12/24 01:04:14 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/24 01:04:14 App: TestDuplicateTimerFiringEventingRebOut got un-deployed
2021/12/24 01:04:14 No eventing-con process running
2021/12/24 01:04:14 Function: TestDuplicateTimerFiringEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingRebOut not found"
}
2021/12/24 01:04:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:04:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:04:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:04:22 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:04:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:04:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:04:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:04:32 Deploying app: TestDuplicateTimerFiringEventingRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/24 01:04:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebOut stored in temp store"
}
2021/12/24 01:04:38 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/24 01:04:43 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/24 01:04:49 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/24 01:04:54 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2021/12/24 01:04:54 App: TestDuplicateTimerFiringEventingRebOut got deployed
2021/12/24 01:04:54 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 01:04:54 Starting bucket ops to source bucket
2021/12/24 01:04:59 Rebalance progress: 12.5
2021/12/24 01:05:04 Rebalance progress: 12.5
2021/12/24 01:05:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:05:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:05:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:05:09 Waiting for src bucket item count to get to: 50000 curr count: 7223
2021/12/24 01:05:14 Waiting for src bucket item count to get to: 50000 curr count: 20219
2021/12/24 01:05:19 Waiting for src bucket item count to get to: 50000 curr count: 20219
2021/12/24 01:05:24 Waiting for src bucket item count to get to: 50000 curr count: 31779
2021/12/24 01:05:29 Waiting for src bucket item count to get to: 50000 curr count: 31779
2021/12/24 01:05:34 Waiting for src bucket item count to get to: 50000 curr count: 42383
2021/12/24 01:05:39 Waiting for src bucket item count to get to: 50000 curr count: 42383
2021/12/24 01:05:49 Waiting for dst bucket item count to get to: 50000 curr count: 38042
2021/12/24 01:05:54 Waiting for dst bucket item count to get to: 50000 curr count: 38042
2021/12/24 01:05:59 Waiting for dst bucket item count to get to: 50000 curr count: 38042
2021/12/24 01:06:04 Waiting for dst bucket item count to get to: 50000 curr count: 48111
2021/12/24 01:06:09 Waiting for dst bucket item count to get to: 50000 curr count: 48111
2021/12/24 01:06:09 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 01:06:09 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 01:06:14 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/24 01:06:19 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/24 01:06:24 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/24 01:06:29 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/24 01:06:34 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2021/12/24 01:06:34 App: TestDuplicateTimerFiringEventingRebOut got un-deployed
2021/12/24 01:06:34 No eventing-con process running
2021/12/24 01:06:34 Function: TestDuplicateTimerFiringEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebOut deleting in background"
}
2021/12/24 01:06:36 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:06:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:06:46 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 01:06:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:06:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:06:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:06:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 01:06:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingRebOut (179.49s)
=== RUN   TestDuplicateTimerFiringEventingSwapReb
2021/12/24 01:07:08 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/24 01:07:08 App: TestDuplicateTimerFiringEventingSwapReb got un-deployed
2021/12/24 01:07:08 No eventing-con process running
2021/12/24 01:07:08 Function: TestDuplicateTimerFiringEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingSwapReb not found"
}
2021/12/24 01:07:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:07:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:07:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:07:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:07:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:07:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:07:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:07:26 Deploying app: TestDuplicateTimerFiringEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/24 01:07:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingSwapReb stored in temp store"
}
2021/12/24 01:07:33 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/24 01:07:38 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/24 01:07:43 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/24 01:07:48 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2021/12/24 01:07:48 App: TestDuplicateTimerFiringEventingSwapReb got deployed
2021/12/24 01:07:48 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2021/12/24 01:07:48 Starting bucket ops to source bucket
2021/12/24 01:07:48 Removing node(s): [] from the cluster
2021/12/24 01:07:53 Rebalance progress: 12.5
2021/12/24 01:07:58 Rebalance progress: 12.5
2021/12/24 01:08:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:08:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:08:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:08:03 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 01:08:04 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 01:08:09 Rebalance progress: 12.5
2021/12/24 01:08:14 Rebalance progress: 12.5
2021/12/24 01:08:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:08:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:08:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:08:19 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 01:08:25 Rebalance progress: 12.5
2021/12/24 01:08:30 Rebalance progress: 12.5
2021/12/24 01:08:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:08:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:08:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:08:35 Waiting for src bucket item count to get to: 50000 curr count: 47542
2021/12/24 01:08:40 Waiting for src bucket item count to get to: 50000 curr count: 47542
2021/12/24 01:08:50 Waiting for dst bucket item count to get to: 50000 curr count: 45206
2021/12/24 01:08:55 Waiting for dst bucket item count to get to: 50000 curr count: 45206
2021/12/24 01:08:55 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 01:08:55 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 01:09:00 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/24 01:09:05 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/24 01:09:10 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/24 01:09:15 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/24 01:09:20 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2021/12/24 01:09:20 App: TestDuplicateTimerFiringEventingSwapReb got un-deployed
2021/12/24 01:09:20 No eventing-con process running
2021/12/24 01:09:20 Function: TestDuplicateTimerFiringEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingSwapReb deleting in background"
}
2021/12/24 01:09:22 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:09:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:09:32 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 01:09:37 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 01:09:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:09:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:09:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:09:49 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 01:09:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingSwapReb (170.76s)
=== RUN   TestDuplicateTimerFiringKVRebIn
2021/12/24 01:09:59 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/24 01:09:59 App: TestDuplicateTimerFiringKVRebIn got un-deployed
2021/12/24 01:09:59 No eventing-con process running
2021/12/24 01:09:59 Function: TestDuplicateTimerFiringKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVRebIn not found"
}
2021/12/24 01:10:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:10:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:10:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:10:07 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:10:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:10:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:10:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:10:17 Deploying app: TestDuplicateTimerFiringKVRebIn. Item count src bucket: 0 dst bucket: 0
2021/12/24 01:10:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebIn stored in temp store"
}
2021/12/24 01:10:23 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/24 01:10:28 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/24 01:10:33 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/24 01:10:38 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2021/12/24 01:10:38 App: TestDuplicateTimerFiringKVRebIn got deployed
2021/12/24 01:10:38 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 01:10:38 Starting bucket ops to source bucket
2021/12/24 01:10:39 Removing node(s): [] from the cluster
2021/12/24 01:10:44 Rebalance progress: 12.5
2021/12/24 01:10:49 Rebalance progress: 12.5
2021/12/24 01:10:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:10:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:10:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:10:54 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 01:10:59 Rebalance progress: 12.5
2021/12/24 01:11:04 Rebalance progress: 12.5
2021/12/24 01:11:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:11:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:11:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:11:09 Waiting for src bucket item count to get to: 50000 curr count: 27944
2021/12/24 01:11:14 Waiting for src bucket item count to get to: 50000 curr count: 36993
2021/12/24 01:11:19 Waiting for src bucket item count to get to: 50000 curr count: 36993
2021/12/24 01:11:24 Waiting for src bucket item count to get to: 50000 curr count: 49563
2021/12/24 01:11:29 Waiting for src bucket item count to get to: 50000 curr count: 49563
2021/12/24 01:11:39 Waiting for dst bucket item count to get to: 50000 curr count: 44066
2021/12/24 01:11:44 Waiting for dst bucket item count to get to: 50000 curr count: 44066
2021/12/24 01:11:44 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 01:11:44 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 01:11:49 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/24 01:11:54 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/24 01:11:59 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/24 01:12:05 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/24 01:12:10 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2021/12/24 01:12:10 App: TestDuplicateTimerFiringKVRebIn got un-deployed
2021/12/24 01:12:10 No eventing-con process running
2021/12/24 01:12:10 Function: TestDuplicateTimerFiringKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebIn deleting in background"
}
2021/12/24 01:12:11 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:12:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:12:21 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 01:12:26 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 01:12:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:12:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:12:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:12:38 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 01:12:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVRebIn (169.61s)
=== RUN   TestDuplicateTimerFiringKVRebOut
2021/12/24 01:12:43 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 01:12:43 Removing node(s): [] from the cluster
2021/12/24 01:12:48 Rebalance progress: 100
2021/12/24 01:12:53 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/24 01:12:53 App: TestDuplicateTimerFiringKVRebOut got un-deployed
2021/12/24 01:12:53 No eventing-con process running
2021/12/24 01:12:53 Function: TestDuplicateTimerFiringKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVRebOut not found"
}
2021/12/24 01:12:55 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:13:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:13:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:13:02 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:13:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:13:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:13:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:13:12 Deploying app: TestDuplicateTimerFiringKVRebOut. Item count src bucket: 0 dst bucket: 0
2021/12/24 01:13:13 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebOut stored in temp store"
}
2021/12/24 01:13:18 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/24 01:13:23 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/24 01:13:28 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/24 01:13:33 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2021/12/24 01:13:33 App: TestDuplicateTimerFiringKVRebOut got deployed
2021/12/24 01:13:33 Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 01:13:33 Starting bucket ops to source bucket
2021/12/24 01:13:38 Rebalance progress: 12.5
2021/12/24 01:13:43 Rebalance progress: 12.5
2021/12/24 01:13:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:13:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:13:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:13:48 Waiting for src bucket item count to get to: 50000 curr count: 8075
2021/12/24 01:13:53 Waiting for src bucket item count to get to: 50000 curr count: 21796
2021/12/24 01:13:58 Waiting for src bucket item count to get to: 50000 curr count: 21796
2021/12/24 01:14:03 Waiting for src bucket item count to get to: 50000 curr count: 33223
2021/12/24 01:14:08 Waiting for src bucket item count to get to: 50000 curr count: 33223
2021/12/24 01:14:13 Waiting for src bucket item count to get to: 50000 curr count: 43700
2021/12/24 01:14:18 Waiting for src bucket item count to get to: 50000 curr count: 43700
2021/12/24 01:14:23 Waiting for src bucket item count to get to: 50000 curr count: 43700
2021/12/24 01:14:33 Waiting for dst bucket item count to get to: 50000 curr count: 35315
2021/12/24 01:14:38 Waiting for dst bucket item count to get to: 50000 curr count: 35315
2021/12/24 01:14:43 Waiting for dst bucket item count to get to: 50000 curr count: 48541
2021/12/24 01:14:48 Waiting for dst bucket item count to get to: 50000 curr count: 48541
2021/12/24 01:14:48 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 01:14:48 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 01:14:53 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/24 01:14:58 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/24 01:15:04 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/24 01:15:09 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/24 01:15:14 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/24 01:15:19 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2021/12/24 01:15:19 App: TestDuplicateTimerFiringKVRebOut got un-deployed
2021/12/24 01:15:19 No eventing-con process running
2021/12/24 01:15:19 Function: TestDuplicateTimerFiringKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebOut deleting in background"
}
2021/12/24 01:15:21 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:15:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:15:31 Waiting for dst bucket item count to get to: 0 curr count: 39509
2021/12/24 01:15:36 Waiting for dst bucket item count to get to: 0 curr count: 39509
2021/12/24 01:15:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:15:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:15:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:15:48 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 01:15:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVRebOut (189.35s)
=== RUN   TestDuplicateTimerFiringKVSwapReb
2021/12/24 01:15:58 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/24 01:15:58 App: TestDuplicateTimerFiringKVSwapReb got un-deployed
2021/12/24 01:15:58 No eventing-con process running
2021/12/24 01:15:58 Function: TestDuplicateTimerFiringKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVSwapReb not found"
}
2021/12/24 01:15:59 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:16:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:16:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:16:06 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:16:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:16:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:16:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:16:16 Deploying app: TestDuplicateTimerFiringKVSwapReb. Item count src bucket: 0 dst bucket: 0
2021/12/24 01:16:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVSwapReb stored in temp store"
}
2021/12/24 01:16:22 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/24 01:16:27 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/24 01:16:32 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/24 01:16:37 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2021/12/24 01:16:37 App: TestDuplicateTimerFiringKVSwapReb got deployed
2021/12/24 01:16:37 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 01:16:37 Starting bucket ops to source bucket
2021/12/24 01:16:38 Removing node(s): [] from the cluster
2021/12/24 01:16:43 Rebalance progress: 12.5
2021/12/24 01:16:48 Rebalance progress: 12.5
2021/12/24 01:16:53 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:16:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:16:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:16:53 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 01:16:54 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 01:16:59 Rebalance progress: 12.5
2021/12/24 01:17:04 Rebalance progress: 12.5
2021/12/24 01:17:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:17:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:17:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:17:09 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 01:17:14 Rebalance progress: 12.5
2021/12/24 01:17:19 Rebalance progress: 12.5
2021/12/24 01:17:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:17:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:17:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:17:24 Waiting for src bucket item count to get to: 50000 curr count: 47807
2021/12/24 01:17:29 Waiting for src bucket item count to get to: 50000 curr count: 47807
2021/12/24 01:17:39 Waiting for dst bucket item count to get to: 50000 curr count: 45822
2021/12/24 01:17:44 Waiting for dst bucket item count to get to: 50000 curr count: 45822
2021/12/24 01:17:49 Waiting for dst bucket item count to get to: 50000 curr count: 49525
2021/12/24 01:17:54 Waiting for dst bucket item count to get to: 50000 curr count: 49525
2021/12/24 01:17:54 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2021/12/24 01:17:54 Post SET ops. Expected item count: 50000 got 50000
2021/12/24 01:17:59 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/24 01:18:05 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/24 01:18:10 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/24 01:18:15 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/24 01:18:20 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2021/12/24 01:18:20 App: TestDuplicateTimerFiringKVSwapReb got un-deployed
2021/12/24 01:18:20 No eventing-con process running
2021/12/24 01:18:20 Function: TestDuplicateTimerFiringKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVSwapReb deleting in background"
}
2021/12/24 01:18:22 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:18:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:18:32 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 01:18:37 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 01:18:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:18:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:18:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:18:48 Waiting for dst bucket item count to get to: 0 curr count: 50000
2021/12/24 01:18:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVSwapReb (180.89s)
=== RUN   TestKVRebOnUpdateBucketOpOneByOne
2021/12/24 01:18:58 Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:18:58 App: bucket_op_on_update got un-deployed
2021/12/24 01:18:58 No eventing-con process running
2021/12/24 01:18:58 Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 01:19:00 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:19:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:19:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:19:07 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:19:12 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:19:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:19:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:19:17 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 01:19:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/24 01:19:23 Starting bucket ops to source bucket
2021/12/24 01:19:28 Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:19:33 Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:19:38 Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:19:38 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:19:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:19:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:19:38 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 01:19:38 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 01:19:44 Rebalance progress: 12.5
2021/12/24 01:19:49 Rebalance progress: 12.5
2021/12/24 01:19:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:19:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:19:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:19:54 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 01:19:54 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 01:19:59 Rebalance progress: 12.5
2021/12/24 01:20:04 Rebalance progress: 12.5
2021/12/24 01:20:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:20:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:20:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:20:09 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/24 01:20:09 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 01:20:14 Rebalance progress: 12.5
2021/12/24 01:20:19 Rebalance progress: 12.5
2021/12/24 01:20:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:20:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:20:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:20:24 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 01:20:30 Rebalance progress: 12.5
2021/12/24 01:20:35 Rebalance progress: 12.5
2021/12/24 01:20:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:20:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:20:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:20:40 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 01:20:45 Rebalance progress: 12.5
2021/12/24 01:20:50 Rebalance progress: 12.5
2021/12/24 01:20:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:20:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:20:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:20:55 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/24 01:21:00 Rebalance progress: 12.5
2021/12/24 01:21:05 Rebalance progress: 12.5
2021/12/24 01:21:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:21:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:21:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:21:15 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:21:20 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:21:25 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:21:30 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:21:35 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:21:35 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 01:21:35 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:21:35 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 01:21:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:21:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:21:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10648
2021/12/24 01:21:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:21:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:21:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:21:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10648
2021/12/24 01:21:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOnUpdateBucketOpOneByOne (190.43s)
=== RUN   TestKVForceFailover
2021/12/24 01:22:14 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:22:14 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 01:22:14 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:22:14 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 01:22:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:22:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:22:21 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:22:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:22:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:22:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:22:27 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 01:22:28 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 01:22:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:22:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:22:33 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 01:22:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/24 01:22:34 Starting bucket ops to source bucket
2021/12/24 01:22:39 Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:22:44 Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:22:49 Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:22:54 Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:22:54 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:22:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:22:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:22:54 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
2021/12/24 01:23:14 clusterSetup.go:237: Kicking off failover recovery, type: full
2021/12/24 01:23:14 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2021/12/24 01:23:19 Rebalance progress: 12.5
2021/12/24 01:23:24 Rebalance progress: 12.5
2021/12/24 01:23:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:23:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:23:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:23:30 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2021/12/24 01:23:35 Rebalance progress: 12.5
2021/12/24 01:23:40 Rebalance progress: 12.5
2021/12/24 01:23:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:23:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:23:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:23:50 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:23:55 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:24:00 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:24:05 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:24:10 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:24:10 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 01:24:10 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:24:10 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 01:24:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:24:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:24:22 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7051
2021/12/24 01:24:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7051
2021/12/24 01:24:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:24:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:24:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:24:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7051
2021/12/24 01:24:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVForceFailover (159.93s)
=== RUN   TestKVHardFailoverRecovery
2021/12/24 01:24:49 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:24:49 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 01:24:49 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:24:49 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 01:24:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:24:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:24:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:24:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:25:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:25:02 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:25:07 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:25:07 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 01:25:09 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/24 01:25:14 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 01:25:19 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:25:24 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:25:29 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:25:29 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:25:29 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:25:29 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:25:29 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 01:25:29 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 01:25:34 Rebalance progress: 12.5
2021/12/24 01:25:39 Rebalance progress: 12.5
2021/12/24 01:25:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:25:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:25:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:25:44 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
2021/12/24 01:26:44 clusterSetup.go:237: Kicking off failover recovery, type: full
2021/12/24 01:26:49 Rebalance progress: 12.5
2021/12/24 01:26:54 Rebalance progress: 12.5
2021/12/24 01:26:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:26:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:26:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:26:59 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 01:27:04 Rebalance progress: 12.5
2021/12/24 01:27:09 Rebalance progress: 12.5
2021/12/24 01:27:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:27:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:27:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:27:19 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:27:24 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:27:29 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:27:35 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:27:40 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:27:40 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 01:27:40 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:27:40 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 01:27:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:27:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:27:51 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12045
2021/12/24 01:27:56 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12045
2021/12/24 01:27:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:27:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:28:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:28:08 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12045
2021/12/24 01:28:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVHardFailoverRecovery (209.38s)
=== RUN   TestKVRebOnUpdateBucketOpAllAtOnce
2021/12/24 01:28:18 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:28:18 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 01:28:18 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:28:18 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 01:28:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:28:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:28:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:28:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:28:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:28:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:28:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:28:37 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 01:28:38 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/24 01:28:43 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 01:28:48 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:28:53 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:28:58 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:28:58 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:28:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:28:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:28:58 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 01:28:58 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 01:28:58 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/24 01:28:59 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 01:29:04 Rebalance progress: 12.5
2021/12/24 01:29:09 Rebalance progress: 12.5
2021/12/24 01:29:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:29:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:29:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:29:14 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2021/12/24 01:29:19 Rebalance progress: 12.5
2021/12/24 01:29:24 Rebalance progress: 12.5
2021/12/24 01:29:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:29:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:29:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:29:34 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:29:39 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:29:44 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:29:49 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:29:55 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:29:55 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 01:29:55 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:29:55 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 01:29:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:30:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:30:06 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4584
2021/12/24 01:30:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:30:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:30:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:30:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4584
2021/12/24 01:30:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOnUpdateBucketOpAllAtOnce (129.91s)
=== RUN   TestKVSwapRebOnUpdateBucketOp
2021/12/24 01:30:28 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:30:28 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 01:30:28 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:30:28 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 01:30:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:30:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:30:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:30:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:30:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:30:42 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:30:42 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:30:42 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 01:30:43 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/24 01:30:48 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 01:30:53 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:30:58 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:31:03 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:31:03 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:31:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:31:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:31:03 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 01:31:03 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 01:31:08 Rebalance progress: 12.5
2021/12/24 01:31:13 Rebalance progress: 12.5
2021/12/24 01:31:18 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:31:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:31:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:31:18 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 01:31:19 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 01:31:24 Rebalance progress: 12.5
2021/12/24 01:31:29 Rebalance progress: 12.5
2021/12/24 01:31:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:31:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:31:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:31:34 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 01:31:39 Rebalance progress: 12.5
2021/12/24 01:31:44 Rebalance progress: 12.5
2021/12/24 01:31:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:31:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:31:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:31:54 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:31:59 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:32:04 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:32:09 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:32:14 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:32:14 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 01:32:14 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:32:14 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 01:32:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:32:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:32:26 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6087
2021/12/24 01:32:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:32:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:32:33 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:32:38 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6087
2021/12/24 01:32:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:32:43 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:32:43 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 01:32:43 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:32:43 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 01:32:45 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:32:50 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:32:50 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:32:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:32:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:32:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebOnUpdateBucketOp (158.41s)
=== RUN   TestKVRebalanceWithMultipleHandlers
2021/12/24 01:33:07 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:33:07 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 01:33:07 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:33:07 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 01:33:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:33:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:33:13 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:33:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:33:20 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:33:20 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:33:25 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 01:33:25 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/24 01:33:25 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:33:25 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: sys_test_bucket_op not found"
}
2021/12/24 01:33:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:33:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:33:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:33:33 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:33:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:33:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:33:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:33:38 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 01:33:40 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:33:40 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:33:40 eventingSetup.go:125: Deploying app: sys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/24 01:33:41 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op stored in temp store"
}
2021/12/24 01:33:46 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 01:33:51 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:33:56 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:34:01 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:34:01 clusterSetup.go:354: App: bucket_op_on_update got deployed
2021/12/24 01:34:06 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/24 01:34:11 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/24 01:34:16 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/24 01:34:16 clusterSetup.go:354: App: sys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:34:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:34:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:34:16 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 01:34:16 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 01:34:21 Rebalance progress: 12.5
2021/12/24 01:34:26 Rebalance progress: 12.5
2021/12/24 01:34:31 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:34:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:34:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:34:32 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 01:34:32 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 01:34:37 Rebalance progress: 12.5
2021/12/24 01:34:42 Rebalance progress: 12.5
2021/12/24 01:34:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:34:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:34:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:34:47 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2021/12/24 01:34:47 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 01:34:52 Rebalance progress: 12.5
2021/12/24 01:34:57 Rebalance progress: 12.5
2021/12/24 01:35:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:35:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:35:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:35:02 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 01:35:07 Rebalance progress: 12.5
2021/12/24 01:35:12 Rebalance progress: 12.5
2021/12/24 01:35:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:35:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:35:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:35:17 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 01:35:22 Rebalance progress: 12.5
2021/12/24 01:35:27 Rebalance progress: 12.5
2021/12/24 01:35:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:35:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:35:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:35:32 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2021/12/24 01:35:37 Rebalance progress: 12.5
2021/12/24 01:35:42 Rebalance progress: 12.5
2021/12/24 01:35:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:35:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:35:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:35:53 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:35:58 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:36:03 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:36:08 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:36:13 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:36:18 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:36:23 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:36:23 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 01:36:23 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:36:23 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 01:36:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:36:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:36:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12158
2021/12/24 01:36:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:36:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:36:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:36:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12158
2021/12/24 01:36:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:36:54 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 01:36:59 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 01:37:04 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 01:37:09 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 01:37:14 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 01:37:14 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/24 01:37:14 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:37:14 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op deleting in background"
}
2021/12/24 01:37:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:37:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:37:21 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:37:23 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:37:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:37:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebalanceWithMultipleHandlers (271.51s)
=== RUN   TestKVSwapRebalanceWithMultipleHandlers
2021/12/24 01:37:38 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:37:38 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 01:37:38 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:37:38 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 01:37:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:37:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:37:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:37:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:37:52 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:37:52 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:37:57 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 01:37:57 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/24 01:37:57 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:37:57 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: sys_test_bucket_op not found"
}
2021/12/24 01:37:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:38:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:38:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:38:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:38:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:38:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:38:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:38:10 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 01:38:11 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:38:11 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:38:11 eventingSetup.go:125: Deploying app: sys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2021/12/24 01:38:12 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op stored in temp store"
}
2021/12/24 01:38:17 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 01:38:22 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:38:27 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:38:32 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:38:33 clusterSetup.go:354: App: bucket_op_on_update got deployed
2021/12/24 01:38:38 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/24 01:38:43 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/24 01:38:48 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2021/12/24 01:38:48 clusterSetup.go:354: App: sys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:38:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:38:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:38:48 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 01:38:48 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 01:38:53 Rebalance progress: 12.5
2021/12/24 01:38:58 Rebalance progress: 12.5
2021/12/24 01:39:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:39:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:39:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:39:03 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 01:39:03 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 01:39:09 Rebalance progress: 12.5
2021/12/24 01:39:14 Rebalance progress: 12.5
2021/12/24 01:39:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:39:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:39:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:39:19 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 01:39:24 Rebalance progress: 12.5
2021/12/24 01:39:29 Rebalance progress: 12.5
2021/12/24 01:39:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:39:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:39:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:39:39 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:39:44 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:39:49 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:39:54 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:39:59 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:39:59 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 01:39:59 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:39:59 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 01:40:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:40:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:40:13 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7618
2021/12/24 01:40:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7618
2021/12/24 01:40:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:40:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:40:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:40:30 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2589
2021/12/24 01:40:35 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2589
2021/12/24 01:40:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:40:40 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 01:40:46 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 01:40:51 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 01:40:56 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 01:41:01 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2021/12/24 01:41:01 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2021/12/24 01:41:01 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:41:01 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op deleting in background"
}
2021/12/24 01:41:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:41:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:41:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:41:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:41:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:41:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebalanceWithMultipleHandlers (226.66s)
=== RUN   TestKVRebStopStartKVOpsOnUpdateBucketOpOneByOne
2021/12/24 01:41:25 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:41:25 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 01:41:25 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:41:25 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 01:41:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:41:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:41:31 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:41:33 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:41:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:41:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:41:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:41:43 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 01:41:44 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/24 01:41:49 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 01:41:54 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:41:59 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:42:04 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:42:04 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:42:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:42:04 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:42:04 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 01:42:05 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 01:42:25 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:42:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:42:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:42:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:42:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:42:35 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 01:42:40 Rebalance progress: 12.5
2021/12/24 01:42:45 Rebalance progress: 12.5
2021/12/24 01:42:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:42:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:42:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:42:50 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 01:42:51 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 01:42:56 Rebalance progress: 12.5
2021/12/24 01:43:01 Rebalance progress: 12.5
2021/12/24 01:43:06 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:43:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:43:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:43:06 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 01:43:11 Rebalance progress: 12.5
2021/12/24 01:43:16 Rebalance progress: 12.5
2021/12/24 01:43:21 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:43:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:43:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:43:26 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:43:31 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:43:36 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:43:41 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:43:47 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:43:47 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 01:43:47 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:43:47 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 01:43:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:43:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:43:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9152
2021/12/24 01:43:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:44:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:44:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:44:10 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2598
2021/12/24 01:44:15 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2598
2021/12/24 01:44:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebStopStartKVOpsOnUpdateBucketOpOneByOne (180.53s)
=== RUN   TestKVFailoverOnUpdateBucketOp
2021/12/24 01:44:25 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:44:25 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 01:44:25 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:44:25 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2021/12/24 01:44:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:44:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:44:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:44:34 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:44:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:44:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:44:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:44:44 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 01:44:45 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/24 01:44:50 bucketOps.go:157: Starting bucket ops to source bucket
2021/12/24 01:44:55 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:45:00 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:45:05 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:45:05 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:45:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:45:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:45:05 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 01:45:05 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 01:45:10 Rebalance progress: 12.5
2021/12/24 01:45:15 Rebalance progress: 12.5
2021/12/24 01:45:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:45:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:45:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:45:20 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:45:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:45:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:45:30 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 01:45:36 Rebalance progress: 12.5
2021/12/24 01:45:41 Rebalance progress: 12.5
2021/12/24 01:45:46 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:45:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:45:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:45:46 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2021/12/24 01:45:46 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2021/12/24 01:45:51 Rebalance progress: 12.5
2021/12/24 01:45:56 Rebalance progress: 12.5
2021/12/24 01:46:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:46:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:46:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:46:01 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2021/12/24 01:46:06 Rebalance progress: 12.5
2021/12/24 01:46:11 Rebalance progress: 12.5
2021/12/24 01:46:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:46:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:46:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:46:21 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:46:26 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:46:31 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:46:37 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:46:42 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:46:42 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 01:46:42 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:46:42 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 01:46:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:46:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:46:54 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8602
2021/12/24 01:46:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8602
2021/12/24 01:46:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:47:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:47:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:47:10 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3470
2021/12/24 01:47:15 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3470
2021/12/24 01:47:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVFailoverOnUpdateBucketOp (180.12s)
=== RUN   TestBootstrapAfterKVHardFailover
2021/12/24 01:47:20 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2021/12/24 01:47:21 clusterSetup.go:253: Removing node(s): [] from the cluster
2021/12/24 01:47:26 Rebalance progress: 100
2021/12/24 01:47:26 Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:47:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:47:56 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2021/12/24 01:47:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2021/12/24 01:48:02 Removing node(s): [] from the cluster
2021/12/24 01:48:02 Starting bucket ops to source bucket
2021/12/24 01:48:07 Rebalance failed. See logs for detailed reason. You can try again.
2021/12/24 01:48:12 Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:48:17 Waiting for app: bucket_op_on_update to get deployed
2021/12/24 01:48:17 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:48:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:48:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2021/12/24 01:48:22 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:48:27 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:48:32 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:48:38 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:48:43 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2021/12/24 01:48:43 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2021/12/24 01:48:43 eventingSetup.go:46: No eventing-con process running
2021/12/24 01:48:43 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2021/12/24 01:48:45 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:48:50 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:48:55 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1510
2021/12/24 01:48:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2021/12/24 01:48:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2021/12/24 01:49:01 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2021/12/24 01:49:06 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1510
2021/12/24 01:49:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBootstrapAfterKVHardFailover (110.96s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	12013.104s

Rebalance tests took 3 hours, 20 minutes and 15 seconds.

Testing Succeeded


Version: versions-23.12.2021-18.11.cfg
Build Log: make-23.12.2021-18.11.log
Server Log: logs-23.12.2021-18.11.tar.gz

Finished