Building

Started building at 2022/01/03 16:46:52
Calculating base
Updating mirror
Basing run on 7.1.0-1987 748111abb
Updating tree for run 03.01.2022-16.46
gocb is at 635fa6c, changes since last good build: none
libcouchbase is at f6822fc, changes since last good build: none
indexing is at 5311754, changes since last good build: 
 5311754f Merge remote-tracking branch 'couchbase/unstable' into HEAD
 ead092b7 MB-49356 Part 1: (7.1.0 1910) Fix Planner constraint violation check
 9ad72e5a MB-37052: Use zero as a default value for plasma.LSSSegmentFileSize
kv_engine is at cda4d73, changes since last good build: none
ns_server is at fadbef1, changes since last good build: none
couchstore is at 0bf3a4b, changes since last good build: none
couchdb is at fca2e6b, changes since last good build: none
testrunner is at a23e488, changes since last good build: none
Switching eventing to unstable
eventing is at ee5930d, changes since last good build: none
Switching eventing-ee to unstable
eventing-ee is at 80089ff, changes since last good build: none
Pulling in uncommitted change 160397 at refs/changes/97/160397/3
Total 23 (delta 15), reused 17 (delta 15)
[unstable 594e6421] MB-100 : Do not fail n1ql timeout test if we are catching timeout exceptions successfully
 Author: abhijpes 
 Date: Mon Aug 30 08:24:38 2021 +0530
 1 file changed, 2 insertions(+), 2 deletions(-)
Pulling in uncommitted change 163449 at refs/changes/49/163449/1
Total 48 (delta 27), reused 39 (delta 27)
[unstable 2f2c8248] MB-100: collect data when test fails
 Author: AnkitPrabhu 
 Date: Tue Oct 12 14:02:31 2021 +0530
 1 file changed, 2 insertions(+)
Pulling in uncommitted change 166698 at refs/changes/98/166698/3
Total 4 (delta 3), reused 4 (delta 3)
[unstable bad349c6] MB-48334 : Fail rebalance unless all functions deployed on current encryption level
 Author: abhijpes 
 Date: Wed Dec 1 14:51:29 2021 +0530
 1 file changed, 9 insertions(+)
Pulling in uncommitted change 168134 at refs/changes/34/168134/1
Total 4 (delta 3), reused 4 (delta 3)
[unstable 8ac1b467] MB-50216: Refresh cluster info cache when validation fails
 Author: AnkitPrabhu 
 Date: Mon Jan 3 11:10:17 2022 +0530
 1 file changed, 1 insertion(+), 1 deletion(-)
Building cmakefiles and deps
Building main product

Testing

Started testing at 2022/01/03 17:04:31
Testing mode: rebalance,n1ql,functional
Starting server
Starting server: attempt 1

Functional tests

2022/01/03 17:06:03 Started functional
2022/01/03 17:06:11 Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2022/01/03 17:06:17 Error in adding nodes : , response: {"otpNode":"n_1@127.0.0.1"}
2022/01/03 17:06:17 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 17:06:22 Removing node(s): [] from the cluster
2022/01/03 17:06:27 Rebalance progress: 0
2022/01/03 17:06:33 Rebalance progress: 0
2022/01/03 17:06:37 Rebalance progress: 4.62962962962963
2022/01/03 17:06:42 Rebalance progress: 9.25925925925926
2022/01/03 17:06:47 Rebalance progress: 12.74956597222222
2022/01/03 17:06:52 Rebalance progress: 17.59620949074074
2022/01/03 17:06:57 Rebalance progress: 20.86950231481481
2022/01/03 17:07:02 Rebalance progress: 25.58955439814815
2022/01/03 17:07:07 Rebalance progress: 100
2022/01/03 17:07:10 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/03 17:07:25 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/03 17:07:40 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/03 17:07:55 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/03 17:08:10 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/03 17:08:25 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/03 17:08:40 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/03 17:08:55 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/03 17:09:10 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/03 17:09:25 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/03 17:09:40 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
2022/01/03 17:09:55 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:0}]
=== RUN   TestAdvancedGetOps
2022/01/03 17:10:13 Deploying app: TestAdvancedGetOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:10:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedGetOps stored in temp store"
}
2022/01/03 17:10:19 Waiting for app: TestAdvancedGetOps to get deployed
2022/01/03 17:10:24 Waiting for app: TestAdvancedGetOps to get deployed
2022/01/03 17:10:29 Waiting for app: TestAdvancedGetOps to get deployed
2022/01/03 17:10:34 Waiting for app: TestAdvancedGetOps to get deployed
2022/01/03 17:10:34 App: TestAdvancedGetOps got deployed
2022/01/03 17:10:34 Starting bucket ops to source bucket
2022/01/03 17:10:39 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 17:10:44 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 17:10:44 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 17:10:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:10:44 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:10:50 Waiting for app: TestAdvancedGetOps to get un-deployed
2022/01/03 17:10:55 Waiting for app: TestAdvancedGetOps to get un-deployed
2022/01/03 17:11:00 Waiting for app: TestAdvancedGetOps to get un-deployed
2022/01/03 17:11:05 Waiting for app: TestAdvancedGetOps to get un-deployed
2022/01/03 17:11:05 App: TestAdvancedGetOps got un-deployed
2022/01/03 17:11:05 No eventing-con process running
2022/01/03 17:11:05 Function: TestAdvancedGetOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedGetOps deleting in background"
}
2022/01/03 17:11:06 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:11:16 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:11:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:11:18 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:11:28 Waiting for dst bucket item count to get to: 0 curr count: 70
2022/01/03 17:11:33 Waiting for dst bucket item count to get to: 0 curr count: 20
2022/01/03 17:11:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedGetOps (80.12s)
=== RUN   TestAdvancedInsertOps
2022/01/03 17:11:33 Deploying app: TestAdvancedInsertOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:11:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps stored in temp store"
}
2022/01/03 17:11:39 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/03 17:11:44 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/03 17:11:49 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/03 17:11:54 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/03 17:11:54 App: TestAdvancedInsertOps got deployed
2022/01/03 17:11:54 Starting bucket ops to source bucket
2022/01/03 17:12:00 Waiting for dst bucket item count to get to: 1024 curr count: 0
2022/01/03 17:12:05 Waiting for dst bucket item count to get to: 1024 curr count: 512
2022/01/03 17:12:05 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2022/01/03 17:12:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:12:05 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:12:10 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/03 17:12:15 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/03 17:12:20 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/03 17:12:25 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/03 17:12:25 App: TestAdvancedInsertOps got un-deployed
2022/01/03 17:12:25 No eventing-con process running
2022/01/03 17:12:25 Function: TestAdvancedInsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps deleting in background"
}
2022/01/03 17:12:27 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:12:37 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/03 17:12:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:12:39 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:12:49 Waiting for dst bucket item count to get to: 0 curr count: 1002
2022/01/03 17:12:54 Waiting for dst bucket item count to get to: 0 curr count: 490
2022/01/03 17:12:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:12:54 Testing insert operation on source bucket
2022/01/03 17:12:54 Deploying app: TestAdvancedInsertOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:12:55 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps stored in temp store"
}
2022/01/03 17:13:00 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/03 17:13:05 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/03 17:13:10 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/03 17:13:15 Waiting for app: TestAdvancedInsertOps to get deployed
2022/01/03 17:13:15 App: TestAdvancedInsertOps got deployed
2022/01/03 17:13:15 Starting bucket ops to source bucket
2022/01/03 17:13:21 Waiting for dst bucket item count to get to: 2048 curr count: 0
2022/01/03 17:13:21 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2022/01/03 17:13:21 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:13:21 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:13:26 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/03 17:13:31 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/03 17:13:36 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/03 17:13:41 Waiting for app: TestAdvancedInsertOps to get un-deployed
2022/01/03 17:13:41 App: TestAdvancedInsertOps got un-deployed
2022/01/03 17:13:41 No eventing-con process running
2022/01/03 17:13:41 Function: TestAdvancedInsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertOps deleting in background"
}
2022/01/03 17:13:43 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:13:53 Waiting for dst bucket item count to get to: 0 curr count: 2048
2022/01/03 17:13:58 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/03 17:13:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:14:00 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:14:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedInsertOps (151.68s)
=== RUN   TestAdvancedUpsertOps
2022/01/03 17:14:05 Starting bucket ops to source bucket
2022/01/03 17:14:05 Deploying app: TestAdvancedUpsertOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:14:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps stored in temp store"
}
2022/01/03 17:14:12 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/03 17:14:17 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/03 17:14:22 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/03 17:14:27 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/03 17:14:27 App: TestAdvancedUpsertOps got deployed
2022/01/03 17:14:27 Starting bucket ops to source bucket
2022/01/03 17:14:33 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/03 17:14:38 Waiting for dst bucket item count to get to: 0 curr count: 204
2022/01/03 17:14:43 Waiting for dst bucket item count to get to: 0 curr count: 204
2022/01/03 17:14:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:14:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:14:43 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:14:48 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/03 17:14:53 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/03 17:14:58 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/03 17:15:03 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/03 17:15:03 App: TestAdvancedUpsertOps got un-deployed
2022/01/03 17:15:03 No eventing-con process running
2022/01/03 17:15:03 Function: TestAdvancedUpsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps deleting in background"
}
2022/01/03 17:15:04 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:15:14 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/03 17:15:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:15:16 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:15:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:15:21 Testing upsert operation on source bucket
2022/01/03 17:15:21 Deploying app: TestAdvancedUpsertOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:15:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps stored in temp store"
}
2022/01/03 17:15:28 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/03 17:15:33 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/03 17:15:38 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/03 17:15:43 Waiting for app: TestAdvancedUpsertOps to get deployed
2022/01/03 17:15:43 App: TestAdvancedUpsertOps got deployed
2022/01/03 17:15:43 Starting bucket ops to source bucket
2022/01/03 17:15:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:15:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:15:44 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:15:49 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/03 17:15:54 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/03 17:15:59 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/03 17:16:04 Waiting for app: TestAdvancedUpsertOps to get un-deployed
2022/01/03 17:16:04 App: TestAdvancedUpsertOps got un-deployed
2022/01/03 17:16:04 No eventing-con process running
2022/01/03 17:16:04 Function: TestAdvancedUpsertOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedUpsertOps deleting in background"
}
2022/01/03 17:16:05 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:16:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:16:13 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:16:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedUpsertOps (133.09s)
=== RUN   TestAdvancedReplaceOps
2022/01/03 17:16:18 Starting bucket ops to source bucket
2022/01/03 17:16:19 Deploying app: TestAdvancedReplaceOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:16:20 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps stored in temp store"
}
2022/01/03 17:16:25 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/03 17:16:30 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/03 17:16:35 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/03 17:16:40 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/03 17:16:40 App: TestAdvancedReplaceOps got deployed
2022/01/03 17:16:40 Starting bucket ops to source bucket
2022/01/03 17:16:46 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/03 17:16:51 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/03 17:16:56 Waiting for dst bucket item count to get to: 0 curr count: 512
2022/01/03 17:16:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:16:56 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:16:56 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:17:01 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/03 17:17:06 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/03 17:17:11 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/03 17:17:16 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/03 17:17:16 App: TestAdvancedReplaceOps got un-deployed
2022/01/03 17:17:16 No eventing-con process running
2022/01/03 17:17:16 Function: TestAdvancedReplaceOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps deleting in background"
}
2022/01/03 17:17:18 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:17:28 Waiting for dst bucket item count to get to: 0 curr count: 617
2022/01/03 17:17:33 Waiting for dst bucket item count to get to: 0 curr count: 105
2022/01/03 17:17:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:17:35 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:17:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:17:40 Testing upsert operation on source bucket
2022/01/03 17:17:40 Deploying app: TestAdvancedReplaceOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:17:41 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps stored in temp store"
}
2022/01/03 17:17:46 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/03 17:17:51 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/03 17:17:56 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/03 17:18:01 Waiting for app: TestAdvancedReplaceOps to get deployed
2022/01/03 17:18:01 App: TestAdvancedReplaceOps got deployed
2022/01/03 17:18:01 Starting bucket ops to source bucket
2022/01/03 17:18:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:18:02 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:18:02 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:18:07 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/03 17:18:12 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/03 17:18:17 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/03 17:18:22 Waiting for app: TestAdvancedReplaceOps to get un-deployed
2022/01/03 17:18:22 App: TestAdvancedReplaceOps got un-deployed
2022/01/03 17:18:22 No eventing-con process running
2022/01/03 17:18:22 Function: TestAdvancedReplaceOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedReplaceOps deleting in background"
}
2022/01/03 17:18:24 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:18:34 Waiting for dst bucket item count to get to: 0 curr count: 400
2022/01/03 17:18:39 Waiting for dst bucket item count to get to: 0 curr count: 201
2022/01/03 17:18:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:18:40 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:18:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedReplaceOps (147.60s)
=== RUN   TestAdvancedDeleteOps
2022/01/03 17:18:45 Starting bucket ops to source bucket
2022/01/03 17:18:46 Deploying app: TestAdvancedDeleteOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:18:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps stored in temp store"
}
2022/01/03 17:18:52 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/03 17:18:57 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/03 17:19:02 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/03 17:19:07 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/03 17:19:07 App: TestAdvancedDeleteOps got deployed
2022/01/03 17:19:07 Starting bucket ops to source bucket
2022/01/03 17:19:12 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:19:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:19:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:19:12 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:19:17 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/03 17:19:22 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/03 17:19:27 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/03 17:19:32 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/03 17:19:32 App: TestAdvancedDeleteOps got un-deployed
2022/01/03 17:19:32 No eventing-con process running
2022/01/03 17:19:32 Function: TestAdvancedDeleteOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps deleting in background"
}
2022/01/03 17:19:34 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:19:44 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:19:49 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 17:19:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:19:50 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:19:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:19:55 Testing delete operation on source bucket
2022/01/03 17:19:55 Deploying app: TestAdvancedDeleteOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:19:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps stored in temp store"
}
2022/01/03 17:20:02 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/03 17:20:07 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/03 17:20:12 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/03 17:20:17 Waiting for app: TestAdvancedDeleteOps to get deployed
2022/01/03 17:20:17 App: TestAdvancedDeleteOps got deployed
2022/01/03 17:20:17 Starting bucket ops to source bucket
2022/01/03 17:20:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:20:17 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:20:17 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:20:22 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/03 17:20:27 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/03 17:20:32 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/03 17:20:37 Waiting for app: TestAdvancedDeleteOps to get un-deployed
2022/01/03 17:20:37 App: TestAdvancedDeleteOps got un-deployed
2022/01/03 17:20:37 No eventing-con process running
2022/01/03 17:20:37 Function: TestAdvancedDeleteOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedDeleteOps deleting in background"
}
2022/01/03 17:20:39 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:20:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:20:46 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:20:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedDeleteOps (125.56s)
=== RUN   TestEnoentAdvancedGet
2022/01/03 17:20:51 Deploying app: TestEnoentAdvancedGet. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:20:52 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet stored in temp store"
}
2022/01/03 17:20:57 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/03 17:21:02 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/03 17:21:07 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/03 17:21:12 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/03 17:21:12 App: TestEnoentAdvancedGet got deployed
2022/01/03 17:21:12 Starting bucket ops to source bucket
2022/01/03 17:21:17 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 17:21:22 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 17:21:22 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 17:21:22 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:21:22 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:21:27 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/03 17:21:33 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/03 17:21:38 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/03 17:21:43 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/03 17:21:43 App: TestEnoentAdvancedGet got un-deployed
2022/01/03 17:21:43 No eventing-con process running
2022/01/03 17:21:43 Function: TestEnoentAdvancedGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet deleting in background"
}
2022/01/03 17:21:44 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:21:54 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:21:59 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 17:21:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:22:01 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:22:11 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:22:16 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:22:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:22:16 Testing get enoent operation on source bucket
2022/01/03 17:22:16 Deploying app: TestEnoentAdvancedGet. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:22:17 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet stored in temp store"
}
2022/01/03 17:22:22 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/03 17:22:27 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/03 17:22:32 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/03 17:22:37 Waiting for app: TestEnoentAdvancedGet to get deployed
2022/01/03 17:22:37 App: TestEnoentAdvancedGet got deployed
2022/01/03 17:22:37 Starting bucket ops to source bucket
2022/01/03 17:22:42 Waiting for dst bucket item count to get to: 200 curr count: 0
2022/01/03 17:22:47 Waiting for dst bucket item count to get to: 200 curr count: 100
2022/01/03 17:22:52 Waiting for dst bucket item count to get to: 200 curr count: 100
2022/01/03 17:22:52 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2022/01/03 17:22:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:22:52 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:22:57 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/03 17:23:03 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/03 17:23:08 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/03 17:23:13 Waiting for app: TestEnoentAdvancedGet to get un-deployed
2022/01/03 17:23:13 App: TestEnoentAdvancedGet got un-deployed
2022/01/03 17:23:13 No eventing-con process running
2022/01/03 17:23:13 Function: TestEnoentAdvancedGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedGet deleting in background"
}
2022/01/03 17:23:14 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:23:24 Waiting for dst bucket item count to get to: 0 curr count: 200
2022/01/03 17:23:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:23:26 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:23:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedGet (160.02s)
=== RUN   TestEnoentAdvancedReplace
2022/01/03 17:23:31 Deploying app: TestEnoentAdvancedReplace. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:23:32 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace stored in temp store"
}
2022/01/03 17:23:37 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/03 17:23:42 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/03 17:23:47 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/03 17:23:52 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/03 17:23:52 App: TestEnoentAdvancedReplace got deployed
2022/01/03 17:23:52 Starting bucket ops to source bucket
2022/01/03 17:23:57 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 17:24:02 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 17:24:02 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 17:24:02 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:24:02 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:24:07 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/03 17:24:12 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/03 17:24:17 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/03 17:24:22 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/03 17:24:22 App: TestEnoentAdvancedReplace got un-deployed
2022/01/03 17:24:22 No eventing-con process running
2022/01/03 17:24:23 Function: TestEnoentAdvancedReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace deleting in background"
}
2022/01/03 17:24:24 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:24:34 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:24:39 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 17:24:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:24:41 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:24:51 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:24:56 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:24:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:24:56 Testing get enoent operation on source bucket
2022/01/03 17:24:56 Deploying app: TestEnoentAdvancedReplace. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:24:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace stored in temp store"
}
2022/01/03 17:25:02 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/03 17:25:07 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/03 17:25:12 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/03 17:25:17 Waiting for app: TestEnoentAdvancedReplace to get deployed
2022/01/03 17:25:17 App: TestEnoentAdvancedReplace got deployed
2022/01/03 17:25:17 Starting bucket ops to source bucket
2022/01/03 17:25:23 Waiting for dst bucket item count to get to: 200 curr count: 0
2022/01/03 17:25:28 Waiting for dst bucket item count to get to: 200 curr count: 100
2022/01/03 17:25:33 Waiting for dst bucket item count to get to: 200 curr count: 100
2022/01/03 17:25:33 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2022/01/03 17:25:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:25:33 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:25:38 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/03 17:25:43 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/03 17:25:48 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/03 17:25:53 Waiting for app: TestEnoentAdvancedReplace to get un-deployed
2022/01/03 17:25:53 App: TestEnoentAdvancedReplace got un-deployed
2022/01/03 17:25:53 No eventing-con process running
2022/01/03 17:25:53 Function: TestEnoentAdvancedReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedReplace deleting in background"
}
2022/01/03 17:25:54 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:26:04 Waiting for dst bucket item count to get to: 0 curr count: 200
2022/01/03 17:26:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:26:06 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:26:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedReplace (160.20s)
=== RUN   TestEnoentAdvancedDelete
2022/01/03 17:26:11 Deploying app: TestEnoentAdvancedDelete. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:26:12 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete stored in temp store"
}
2022/01/03 17:26:17 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/03 17:26:22 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/03 17:26:27 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/03 17:26:32 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/03 17:26:32 App: TestEnoentAdvancedDelete got deployed
2022/01/03 17:26:32 Starting bucket ops to source bucket
2022/01/03 17:26:38 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 17:26:43 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 17:26:43 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 17:26:43 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:26:43 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:26:48 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/03 17:26:53 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/03 17:26:58 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/03 17:27:03 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/03 17:27:03 App: TestEnoentAdvancedDelete got un-deployed
2022/01/03 17:27:03 No eventing-con process running
2022/01/03 17:27:03 Function: TestEnoentAdvancedDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete deleting in background"
}
2022/01/03 17:27:04 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:27:14 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:27:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:27:16 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:27:26 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:27:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:27:26 Testing get enoent operation on source bucket
2022/01/03 17:27:26 Deploying app: TestEnoentAdvancedDelete. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:27:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete stored in temp store"
}
2022/01/03 17:27:32 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/03 17:27:37 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/03 17:27:42 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/03 17:27:47 Waiting for app: TestEnoentAdvancedDelete to get deployed
2022/01/03 17:27:47 App: TestEnoentAdvancedDelete got deployed
2022/01/03 17:27:47 Starting bucket ops to source bucket
2022/01/03 17:27:53 Waiting for dst bucket item count to get to: 200 curr count: 0
2022/01/03 17:27:58 Waiting for dst bucket item count to get to: 200 curr count: 100
2022/01/03 17:28:03 Waiting for dst bucket item count to get to: 200 curr count: 100
2022/01/03 17:28:03 src & dst bucket item count matched up. src bucket count: 200 dst bucket count: 200
2022/01/03 17:28:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:28:03 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:28:08 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/03 17:28:13 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/03 17:28:18 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/03 17:28:23 Waiting for app: TestEnoentAdvancedDelete to get un-deployed
2022/01/03 17:28:23 App: TestEnoentAdvancedDelete got un-deployed
2022/01/03 17:28:23 No eventing-con process running
2022/01/03 17:28:23 Function: TestEnoentAdvancedDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentAdvancedDelete deleting in background"
}
2022/01/03 17:28:24 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:28:34 Waiting for dst bucket item count to get to: 0 curr count: 200
2022/01/03 17:28:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:28:36 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:28:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentAdvancedDelete (150.02s)
=== RUN   TestAdvancedInsertKeyExist
2022/01/03 17:28:41 Deploying app: TestAdvancedInsertKeyExist. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:28:42 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist stored in temp store"
}
2022/01/03 17:28:47 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/03 17:28:52 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/03 17:28:57 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/03 17:29:02 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/03 17:29:02 App: TestAdvancedInsertKeyExist got deployed
2022/01/03 17:29:02 Starting bucket ops to source bucket
2022/01/03 17:29:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:29:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:29:03 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:29:08 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/03 17:29:13 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/03 17:29:18 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/03 17:29:23 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/03 17:29:23 App: TestAdvancedInsertKeyExist got un-deployed
2022/01/03 17:29:23 No eventing-con process running
2022/01/03 17:29:23 Function: TestAdvancedInsertKeyExist delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist deleting in background"
}
2022/01/03 17:29:25 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:29:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:29:32 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:29:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:29:37 Pumping document in the destination bucket
2022/01/03 17:29:37 Starting bucket ops to source bucket
2022/01/03 17:29:37 Deploying app: TestAdvancedInsertKeyExist. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:29:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist stored in temp store"
}
2022/01/03 17:29:43 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/03 17:29:48 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/03 17:29:53 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/03 17:29:58 Waiting for app: TestAdvancedInsertKeyExist to get deployed
2022/01/03 17:29:58 App: TestAdvancedInsertKeyExist got deployed
2022/01/03 17:29:58 Starting bucket ops to source bucket
2022/01/03 17:30:03 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:30:08 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 17:30:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:30:08 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:30:08 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:30:13 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/03 17:30:18 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/03 17:30:23 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/03 17:30:28 Waiting for app: TestAdvancedInsertKeyExist to get un-deployed
2022/01/03 17:30:28 App: TestAdvancedInsertKeyExist got un-deployed
2022/01/03 17:30:28 No eventing-con process running
2022/01/03 17:30:29 Function: TestAdvancedInsertKeyExist delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAdvancedInsertKeyExist deleting in background"
}
2022/01/03 17:30:30 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:30:40 Waiting for dst bucket item count to get to: 0 curr count: 71
2022/01/03 17:30:45 Waiting for dst bucket item count to get to: 0 curr count: 71
2022/01/03 17:30:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:30:47 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:30:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAdvancedInsertKeyExist (130.72s)
=== RUN   TestExipryGet
2022/01/03 17:30:52 Deploying app: TestExipryGet. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:30:53 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet stored in temp store"
}
2022/01/03 17:30:58 Waiting for app: TestExipryGet to get deployed
2022/01/03 17:31:03 Waiting for app: TestExipryGet to get deployed
2022/01/03 17:31:08 Waiting for app: TestExipryGet to get deployed
2022/01/03 17:31:13 Waiting for app: TestExipryGet to get deployed
2022/01/03 17:31:13 App: TestExipryGet got deployed
2022/01/03 17:31:13 Starting bucket ops to source bucket
2022/01/03 17:31:58 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:32:03 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 17:32:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:32:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:32:03 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:32:09 Waiting for app: TestExipryGet to get un-deployed
2022/01/03 17:32:14 Waiting for app: TestExipryGet to get un-deployed
2022/01/03 17:32:19 Waiting for app: TestExipryGet to get un-deployed
2022/01/03 17:32:24 Waiting for app: TestExipryGet to get un-deployed
2022/01/03 17:32:24 App: TestExipryGet got un-deployed
2022/01/03 17:32:24 No eventing-con process running
2022/01/03 17:32:24 Function: TestExipryGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet deleting in background"
}
2022/01/03 17:32:25 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:32:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:32:33 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:32:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:32:38 Pumping document in the destination bucket for expiry get
2022/01/03 17:32:38 Starting bucket ops to source bucket
2022/01/03 17:32:38 Deploying app: TestExipryGet. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:32:39 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet stored in temp store"
}
2022/01/03 17:32:44 Waiting for app: TestExipryGet to get deployed
2022/01/03 17:32:49 Waiting for app: TestExipryGet to get deployed
2022/01/03 17:32:54 Waiting for app: TestExipryGet to get deployed
2022/01/03 17:32:59 Waiting for app: TestExipryGet to get deployed
2022/01/03 17:32:59 App: TestExipryGet got deployed
2022/01/03 17:32:59 Starting bucket ops to source bucket
2022/01/03 17:33:44 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:33:49 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 17:33:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:33:49 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:33:49 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:33:54 Waiting for app: TestExipryGet to get un-deployed
2022/01/03 17:33:59 Waiting for app: TestExipryGet to get un-deployed
2022/01/03 17:34:04 Waiting for app: TestExipryGet to get un-deployed
2022/01/03 17:34:09 Waiting for app: TestExipryGet to get un-deployed
2022/01/03 17:34:09 App: TestExipryGet got un-deployed
2022/01/03 17:34:09 No eventing-con process running
2022/01/03 17:34:09 Function: TestExipryGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryGet deleting in background"
}
2022/01/03 17:34:11 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:34:21 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:34:26 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:34:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:34:28 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:34:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryGet (220.90s)
=== RUN   TestExipryInsert
2022/01/03 17:34:33 Deploying app: TestExipryInsert. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:34:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert stored in temp store"
}
2022/01/03 17:34:39 Waiting for app: TestExipryInsert to get deployed
2022/01/03 17:34:44 Waiting for app: TestExipryInsert to get deployed
2022/01/03 17:34:49 Waiting for app: TestExipryInsert to get deployed
2022/01/03 17:34:54 Waiting for app: TestExipryInsert to get deployed
2022/01/03 17:34:54 App: TestExipryInsert got deployed
2022/01/03 17:34:54 Starting bucket ops to source bucket
2022/01/03 17:35:39 Waiting for dst bucket item count to get to: 0 curr count: 200
2022/01/03 17:35:44 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:35:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:35:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:35:44 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:35:49 Waiting for app: TestExipryInsert to get un-deployed
2022/01/03 17:35:54 Waiting for app: TestExipryInsert to get un-deployed
2022/01/03 17:35:59 Waiting for app: TestExipryInsert to get un-deployed
2022/01/03 17:36:04 Waiting for app: TestExipryInsert to get un-deployed
2022/01/03 17:36:04 App: TestExipryInsert got un-deployed
2022/01/03 17:36:04 No eventing-con process running
2022/01/03 17:36:04 Function: TestExipryInsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert deleting in background"
}
2022/01/03 17:36:06 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:36:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:36:13 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:36:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:36:18 Testing on the destination bucket for expiry insert
2022/01/03 17:36:19 Deploying app: TestExipryInsert. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:36:20 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert stored in temp store"
}
2022/01/03 17:36:25 Waiting for app: TestExipryInsert to get deployed
2022/01/03 17:36:30 Waiting for app: TestExipryInsert to get deployed
2022/01/03 17:36:35 Waiting for app: TestExipryInsert to get deployed
2022/01/03 17:36:40 Waiting for app: TestExipryInsert to get deployed
2022/01/03 17:36:40 App: TestExipryInsert got deployed
2022/01/03 17:36:40 Starting bucket ops to source bucket
2022/01/03 17:37:25 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 17:37:30 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 17:37:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:37:30 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:37:30 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:37:35 Waiting for app: TestExipryInsert to get un-deployed
2022/01/03 17:37:40 Waiting for app: TestExipryInsert to get un-deployed
2022/01/03 17:37:45 Waiting for app: TestExipryInsert to get un-deployed
2022/01/03 17:37:50 Waiting for app: TestExipryInsert to get un-deployed
2022/01/03 17:37:50 App: TestExipryInsert got un-deployed
2022/01/03 17:37:50 No eventing-con process running
2022/01/03 17:37:50 Function: TestExipryInsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryInsert deleting in background"
}
2022/01/03 17:37:52 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:38:02 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:38:07 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:38:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:38:08 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:38:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryInsert (220.57s)
=== RUN   TestExipryReplace
2022/01/03 17:38:13 Deploying app: TestExipryReplace. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:38:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace stored in temp store"
}
2022/01/03 17:38:20 Waiting for app: TestExipryReplace to get deployed
2022/01/03 17:38:25 Waiting for app: TestExipryReplace to get deployed
2022/01/03 17:38:30 Waiting for app: TestExipryReplace to get deployed
2022/01/03 17:38:35 Waiting for app: TestExipryReplace to get deployed
2022/01/03 17:38:35 App: TestExipryReplace got deployed
2022/01/03 17:38:35 Starting bucket ops to source bucket
2022/01/03 17:39:20 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:39:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:39:20 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:39:20 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:39:25 Waiting for app: TestExipryReplace to get un-deployed
2022/01/03 17:39:30 Waiting for app: TestExipryReplace to get un-deployed
2022/01/03 17:39:35 Waiting for app: TestExipryReplace to get un-deployed
2022/01/03 17:39:40 Waiting for app: TestExipryReplace to get un-deployed
2022/01/03 17:39:40 App: TestExipryReplace got un-deployed
2022/01/03 17:39:40 No eventing-con process running
2022/01/03 17:39:40 Function: TestExipryReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace deleting in background"
}
2022/01/03 17:39:42 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:39:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:39:49 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:39:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:39:54 Testing on the destination bucket for expiry insert
2022/01/03 17:39:54 Deploying app: TestExipryReplace. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:39:55 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace stored in temp store"
}
2022/01/03 17:40:00 Waiting for app: TestExipryReplace to get deployed
2022/01/03 17:40:05 Waiting for app: TestExipryReplace to get deployed
2022/01/03 17:40:10 Waiting for app: TestExipryReplace to get deployed
2022/01/03 17:40:15 Waiting for app: TestExipryReplace to get deployed
2022/01/03 17:40:15 App: TestExipryReplace got deployed
2022/01/03 17:40:15 Starting bucket ops to source bucket
2022/01/03 17:41:00 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:41:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:41:00 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:41:00 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:41:05 Waiting for app: TestExipryReplace to get un-deployed
2022/01/03 17:41:10 Waiting for app: TestExipryReplace to get un-deployed
2022/01/03 17:41:15 Waiting for app: TestExipryReplace to get un-deployed
2022/01/03 17:41:20 Waiting for app: TestExipryReplace to get un-deployed
2022/01/03 17:41:20 App: TestExipryReplace got un-deployed
2022/01/03 17:41:20 No eventing-con process running
2022/01/03 17:41:20 Function: TestExipryReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryReplace deleting in background"
}
2022/01/03 17:41:22 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:41:32 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:41:37 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:41:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:41:39 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:41:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryReplace (210.48s)
=== RUN   TestExipryUpsert
2022/01/03 17:41:44 Deploying app: TestExipryUpsert. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:41:45 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert stored in temp store"
}
2022/01/03 17:41:50 Waiting for app: TestExipryUpsert to get deployed
2022/01/03 17:41:55 Waiting for app: TestExipryUpsert to get deployed
2022/01/03 17:42:00 Waiting for app: TestExipryUpsert to get deployed
2022/01/03 17:42:05 Waiting for app: TestExipryUpsert to get deployed
2022/01/03 17:42:05 App: TestExipryUpsert got deployed
2022/01/03 17:42:05 Starting bucket ops to source bucket
2022/01/03 17:42:50 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:42:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:42:50 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:42:50 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:42:55 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/03 17:43:00 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/03 17:43:05 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/03 17:43:10 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/03 17:43:10 App: TestExipryUpsert got un-deployed
2022/01/03 17:43:10 No eventing-con process running
2022/01/03 17:43:11 Function: TestExipryUpsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert deleting in background"
}
2022/01/03 17:43:12 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:43:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:43:19 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:43:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:43:24 Testing on the destination bucket for expiry insert
2022/01/03 17:43:24 Deploying app: TestExipryUpsert. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:43:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert stored in temp store"
}
2022/01/03 17:43:31 Waiting for app: TestExipryUpsert to get deployed
2022/01/03 17:43:36 Waiting for app: TestExipryUpsert to get deployed
2022/01/03 17:43:41 Waiting for app: TestExipryUpsert to get deployed
2022/01/03 17:43:46 Waiting for app: TestExipryUpsert to get deployed
2022/01/03 17:43:46 App: TestExipryUpsert got deployed
2022/01/03 17:43:46 Starting bucket ops to source bucket
2022/01/03 17:44:31 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:44:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:44:31 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:44:31 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:44:36 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/03 17:44:41 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/03 17:44:46 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/03 17:44:51 Waiting for app: TestExipryUpsert to get un-deployed
2022/01/03 17:44:51 App: TestExipryUpsert got un-deployed
2022/01/03 17:44:51 No eventing-con process running
2022/01/03 17:44:51 Function: TestExipryUpsert delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestExipryUpsert deleting in background"
}
2022/01/03 17:44:53 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:45:03 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:45:08 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 17:45:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:45:09 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:45:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestExipryUpsert (210.46s)
=== RUN   TestCasReplace
2022/01/03 17:45:14 Deploying app: TestCasReplace. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:45:16 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace stored in temp store"
}
2022/01/03 17:45:21 Waiting for app: TestCasReplace to get deployed
2022/01/03 17:45:26 Waiting for app: TestCasReplace to get deployed
2022/01/03 17:45:31 Waiting for app: TestCasReplace to get deployed
2022/01/03 17:45:36 Waiting for app: TestCasReplace to get deployed
2022/01/03 17:45:36 App: TestCasReplace got deployed
2022/01/03 17:45:36 Starting bucket ops to source bucket
2022/01/03 17:45:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:45:36 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:45:36 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:45:41 Waiting for app: TestCasReplace to get un-deployed
2022/01/03 17:45:46 Waiting for app: TestCasReplace to get un-deployed
2022/01/03 17:45:51 Waiting for app: TestCasReplace to get un-deployed
2022/01/03 17:45:56 Waiting for app: TestCasReplace to get un-deployed
2022/01/03 17:45:56 App: TestCasReplace got un-deployed
2022/01/03 17:45:56 No eventing-con process running
2022/01/03 17:45:56 Function: TestCasReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace deleting in background"
}
2022/01/03 17:45:58 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:46:08 Waiting for dst bucket item count to get to: 0 curr count: 7
2022/01/03 17:46:13 Waiting for dst bucket item count to get to: 0 curr count: 2
2022/01/03 17:46:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:46:14 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:46:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:46:19 Testing on the destination bucket for upsert with cas
2022/01/03 17:46:19 Starting bucket ops to source bucket
2022/01/03 17:46:20 Deploying app: TestCasReplace. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:46:21 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace stored in temp store"
}
2022/01/03 17:46:26 Waiting for app: TestCasReplace to get deployed
2022/01/03 17:46:31 Waiting for app: TestCasReplace to get deployed
2022/01/03 17:46:36 Waiting for app: TestCasReplace to get deployed
2022/01/03 17:46:41 Waiting for app: TestCasReplace to get deployed
2022/01/03 17:46:41 App: TestCasReplace got deployed
2022/01/03 17:46:41 Starting bucket ops to source bucket
2022/01/03 17:46:46 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:46:51 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:46:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:46:51 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:46:51 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:46:56 Waiting for app: TestCasReplace to get un-deployed
2022/01/03 17:47:01 Waiting for app: TestCasReplace to get un-deployed
2022/01/03 17:47:06 Waiting for app: TestCasReplace to get un-deployed
2022/01/03 17:47:11 Waiting for app: TestCasReplace to get un-deployed
2022/01/03 17:47:11 App: TestCasReplace got un-deployed
2022/01/03 17:47:11 No eventing-con process running
2022/01/03 17:47:11 Function: TestCasReplace delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasReplace deleting in background"
}
2022/01/03 17:47:13 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:47:23 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:47:28 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 17:47:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:47:30 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:47:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCasReplace (140.17s)
=== RUN   TestCasDelete
2022/01/03 17:47:35 Deploying app: TestCasDelete. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:47:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete stored in temp store"
}
2022/01/03 17:47:41 Waiting for app: TestCasDelete to get deployed
2022/01/03 17:47:46 Waiting for app: TestCasDelete to get deployed
2022/01/03 17:47:51 Waiting for app: TestCasDelete to get deployed
2022/01/03 17:47:56 Waiting for app: TestCasDelete to get deployed
2022/01/03 17:47:56 App: TestCasDelete got deployed
2022/01/03 17:47:56 Starting bucket ops to source bucket
2022/01/03 17:47:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:47:56 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:47:56 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:48:01 Waiting for app: TestCasDelete to get un-deployed
2022/01/03 17:48:06 Waiting for app: TestCasDelete to get un-deployed
2022/01/03 17:48:11 Waiting for app: TestCasDelete to get un-deployed
2022/01/03 17:48:16 Waiting for app: TestCasDelete to get un-deployed
2022/01/03 17:48:16 App: TestCasDelete got un-deployed
2022/01/03 17:48:16 No eventing-con process running
2022/01/03 17:48:16 Function: TestCasDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete deleting in background"
}
2022/01/03 17:48:18 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:48:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:48:25 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:48:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:48:30 Testing on the destination bucket for delete with cas
2022/01/03 17:48:30 Starting bucket ops to source bucket
2022/01/03 17:48:30 Deploying app: TestCasDelete. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:48:32 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete stored in temp store"
}
2022/01/03 17:48:37 Waiting for app: TestCasDelete to get deployed
2022/01/03 17:48:42 Waiting for app: TestCasDelete to get deployed
2022/01/03 17:48:47 Waiting for app: TestCasDelete to get deployed
2022/01/03 17:48:52 Waiting for app: TestCasDelete to get deployed
2022/01/03 17:48:52 App: TestCasDelete got deployed
2022/01/03 17:48:52 Starting bucket ops to source bucket
2022/01/03 17:48:57 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:49:02 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:49:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:49:02 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:49:02 http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 17:49:07 Waiting for app: TestCasDelete to get un-deployed
2022/01/03 17:49:12 Waiting for app: TestCasDelete to get un-deployed
2022/01/03 17:49:17 Waiting for app: TestCasDelete to get un-deployed
2022/01/03 17:49:22 Waiting for app: TestCasDelete to get un-deployed
2022/01/03 17:49:22 App: TestCasDelete got un-deployed
2022/01/03 17:49:22 No eventing-con process running
2022/01/03 17:49:22 Function: TestCasDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCasDelete deleting in background"
}
2022/01/03 17:49:24 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:49:34 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 17:49:39 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 17:49:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:49:40 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:49:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCasDelete (130.86s)
=== RUN   TestCountersIncrement
2022/01/03 17:49:45 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 17:49:51 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 17:49:51 Removing node(s): [] from the cluster
2022/01/03 17:49:56 Rebalance progress: 100
2022/01/03 17:49:57 Deploying app: TestCountersIncrement. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:49:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement stored in temp store"
}
2022/01/03 17:50:03 Waiting for app: TestCountersIncrement to get deployed
2022/01/03 17:50:08 Waiting for app: TestCountersIncrement to get deployed
2022/01/03 17:50:13 Waiting for app: TestCountersIncrement to get deployed
2022/01/03 17:50:18 Waiting for app: TestCountersIncrement to get deployed
2022/01/03 17:50:18 App: TestCountersIncrement got deployed
2022/01/03 17:50:18 Starting bucket ops to source bucket
2022/01/03 17:50:24 Waiting for dst bucket item count to get to: 1024 curr count: 0
2022/01/03 17:50:29 Waiting for dst bucket item count to get to: 1024 curr count: 512
2022/01/03 17:50:34 Waiting for dst bucket item count to get to: 1024 curr count: 512
2022/01/03 17:50:34 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2022/01/03 17:50:34 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:50:39 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/03 17:50:44 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/03 17:50:49 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/03 17:50:54 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/03 17:50:54 App: TestCountersIncrement got un-deployed
2022/01/03 17:50:54 No eventing-con process running
2022/01/03 17:50:54 Function: TestCountersIncrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement deleting in background"
}
2022/01/03 17:50:56 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:51:06 Waiting for dst bucket item count to get to: 0 curr count: 1025
2022/01/03 17:51:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:51:08 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:51:18 Waiting for dst bucket item count to get to: 0 curr count: 596
2022/01/03 17:51:23 Waiting for dst bucket item count to get to: 0 curr count: 84
2022/01/03 17:51:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:51:23 Deploying app: TestCountersIncrement. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:51:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement stored in temp store"
}
2022/01/03 17:51:29 Waiting for app: TestCountersIncrement to get deployed
2022/01/03 17:51:34 Waiting for app: TestCountersIncrement to get deployed
2022/01/03 17:51:39 Waiting for app: TestCountersIncrement to get deployed
2022/01/03 17:51:44 Waiting for app: TestCountersIncrement to get deployed
2022/01/03 17:51:44 App: TestCountersIncrement got deployed
2022/01/03 17:51:44 Starting bucket ops to source bucket
2022/01/03 17:51:50 Waiting for dst bucket item count to get to: 2048 curr count: 0
2022/01/03 17:51:55 Waiting for dst bucket item count to get to: 2048 curr count: 1024
2022/01/03 17:51:55 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2022/01/03 17:51:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:52:00 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/03 17:52:05 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/03 17:52:10 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/03 17:52:15 Waiting for app: TestCountersIncrement to get un-deployed
2022/01/03 17:52:15 App: TestCountersIncrement got un-deployed
2022/01/03 17:52:16 No eventing-con process running
2022/01/03 17:52:16 Function: TestCountersIncrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersIncrement deleting in background"
}
2022/01/03 17:52:17 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:52:27 Waiting for dst bucket item count to get to: 0 curr count: 2048
2022/01/03 17:52:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:52:29 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:52:39 Waiting for dst bucket item count to get to: 0 curr count: 1
2022/01/03 17:52:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:52:39 Removing node(s): [http://127.0.0.1:19002 http://127.0.0.1:19003] from the cluster
2022/01/03 17:52:44 Rebalance progress: 100
--- PASS: TestCountersIncrement (178.65s)
=== RUN   TestCountersDecrement
2022/01/03 17:52:44 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 17:52:44 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 17:52:45 Removing node(s): [] from the cluster
2022/01/03 17:52:50 Rebalance progress: 100
2022/01/03 17:52:50 Deploying app: TestCountersDecrement. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:52:51 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement stored in temp store"
}
2022/01/03 17:52:56 Waiting for app: TestCountersDecrement to get deployed
2022/01/03 17:53:01 Waiting for app: TestCountersDecrement to get deployed
2022/01/03 17:53:06 Waiting for app: TestCountersDecrement to get deployed
2022/01/03 17:53:11 Waiting for app: TestCountersDecrement to get deployed
2022/01/03 17:53:11 App: TestCountersDecrement got deployed
2022/01/03 17:53:11 Starting bucket ops to source bucket
2022/01/03 17:53:17 Waiting for dst bucket item count to get to: 1024 curr count: 0
2022/01/03 17:53:22 Waiting for dst bucket item count to get to: 1024 curr count: 0
2022/01/03 17:53:22 src & dst bucket item count matched up. src bucket count: 1024 dst bucket count: 1024
2022/01/03 17:53:22 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:53:27 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/03 17:53:33 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/03 17:53:38 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/03 17:53:43 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/03 17:53:43 App: TestCountersDecrement got un-deployed
2022/01/03 17:53:43 No eventing-con process running
2022/01/03 17:53:43 Function: TestCountersDecrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement deleting in background"
}
2022/01/03 17:53:44 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:53:54 Waiting for dst bucket item count to get to: 0 curr count: 1025
2022/01/03 17:53:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:53:56 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:54:06 Waiting for dst bucket item count to get to: 0 curr count: 1024
2022/01/03 17:54:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:54:06 Deploying app: TestCountersDecrement. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:54:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement stored in temp store"
}
2022/01/03 17:54:12 Waiting for app: TestCountersDecrement to get deployed
2022/01/03 17:54:17 Waiting for app: TestCountersDecrement to get deployed
2022/01/03 17:54:22 Waiting for app: TestCountersDecrement to get deployed
2022/01/03 17:54:27 Waiting for app: TestCountersDecrement to get deployed
2022/01/03 17:54:27 App: TestCountersDecrement got deployed
2022/01/03 17:54:27 Starting bucket ops to source bucket
2022/01/03 17:54:34 Waiting for dst bucket item count to get to: 2048 curr count: 0
2022/01/03 17:54:39 Waiting for dst bucket item count to get to: 2048 curr count: 1024
2022/01/03 17:54:44 Waiting for dst bucket item count to get to: 2048 curr count: 1024
2022/01/03 17:54:44 src & dst bucket item count matched up. src bucket count: 2048 dst bucket count: 2048
2022/01/03 17:54:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:54:49 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/03 17:54:54 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/03 17:54:59 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/03 17:55:04 Waiting for app: TestCountersDecrement to get un-deployed
2022/01/03 17:55:04 App: TestCountersDecrement got un-deployed
2022/01/03 17:55:04 No eventing-con process running
2022/01/03 17:55:04 Function: TestCountersDecrement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCountersDecrement deleting in background"
}
2022/01/03 17:55:06 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:55:16 Waiting for dst bucket item count to get to: 0 curr count: 2048
2022/01/03 17:55:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:55:17 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:55:27 Waiting for dst bucket item count to get to: 0 curr count: 1
2022/01/03 17:55:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:55:27 Removing node(s): [http://127.0.0.1:19002 http://127.0.0.1:19003] from the cluster
2022/01/03 17:55:32 Rebalance progress: 100
--- PASS: TestCountersDecrement (168.40s)
=== RUN   TestCacheGet
2022/01/03 17:55:32 Deploying app: TestCacheGet. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:55:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheGet stored in temp store"
}
2022/01/03 17:55:39 Waiting for app: TestCacheGet to get deployed
2022/01/03 17:55:44 Waiting for app: TestCacheGet to get deployed
2022/01/03 17:55:49 Waiting for app: TestCacheGet to get deployed
2022/01/03 17:55:54 Waiting for app: TestCacheGet to get deployed
2022/01/03 17:55:54 App: TestCacheGet got deployed
2022/01/03 17:55:54 Starting bucket ops to source bucket
2022/01/03 17:55:59 Waiting for dst bucket item count to get to: 20 curr count: 0
2022/01/03 17:56:04 Waiting for dst bucket item count to get to: 20 curr count: 0
2022/01/03 17:56:09 Waiting for dst bucket item count to get to: 20 curr count: 0
2022/01/03 17:56:14 Waiting for dst bucket item count to get to: 20 curr count: 8
2022/01/03 17:56:19 Waiting for dst bucket item count to get to: 20 curr count: 16
2022/01/03 17:56:24 Waiting for dst bucket item count to get to: 20 curr count: 18
2022/01/03 17:56:24 src & dst bucket item count matched up. src bucket count: 20 dst bucket count: 20
2022/01/03 17:56:24 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:56:29 Waiting for app: TestCacheGet to get un-deployed
2022/01/03 17:56:34 Waiting for app: TestCacheGet to get un-deployed
2022/01/03 17:56:39 Waiting for app: TestCacheGet to get un-deployed
2022/01/03 17:56:44 Waiting for app: TestCacheGet to get un-deployed
2022/01/03 17:56:44 App: TestCacheGet got un-deployed
2022/01/03 17:56:44 No eventing-con process running
2022/01/03 17:56:44 Function: TestCacheGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheGet deleting in background"
}
2022/01/03 17:56:46 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:56:56 Waiting for dst bucket item count to get to: 0 curr count: 20
2022/01/03 17:56:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:56:58 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:57:08 Waiting for dst bucket item count to get to: 0 curr count: 10
2022/01/03 17:57:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheGet (95.23s)
=== RUN   TestCacheRYOW
2022/01/03 17:57:08 Deploying app: TestCacheRYOW. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:57:09 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheRYOW stored in temp store"
}
2022/01/03 17:57:14 Waiting for app: TestCacheRYOW to get deployed
2022/01/03 17:57:19 Waiting for app: TestCacheRYOW to get deployed
2022/01/03 17:57:24 Waiting for app: TestCacheRYOW to get deployed
2022/01/03 17:57:29 Waiting for app: TestCacheRYOW to get deployed
2022/01/03 17:57:29 App: TestCacheRYOW got deployed
2022/01/03 17:57:29 Starting bucket ops to source bucket
2022/01/03 17:57:34 Waiting for dst bucket item count to get to: 50 curr count: 0
2022/01/03 17:57:39 Waiting for dst bucket item count to get to: 50 curr count: 25
2022/01/03 17:57:39 src & dst bucket item count matched up. src bucket count: 50 dst bucket count: 50
2022/01/03 17:57:39 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:57:44 Waiting for app: TestCacheRYOW to get un-deployed
2022/01/03 17:57:49 Waiting for app: TestCacheRYOW to get un-deployed
2022/01/03 17:57:54 Waiting for app: TestCacheRYOW to get un-deployed
2022/01/03 17:57:59 Waiting for app: TestCacheRYOW to get un-deployed
2022/01/03 17:57:59 App: TestCacheRYOW got un-deployed
2022/01/03 17:57:59 No eventing-con process running
2022/01/03 17:58:00 Function: TestCacheRYOW delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheRYOW deleting in background"
}
2022/01/03 17:58:01 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:58:11 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 17:58:16 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 17:58:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:58:18 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:58:28 Waiting for dst bucket item count to get to: 0 curr count: 34
2022/01/03 17:58:33 Waiting for dst bucket item count to get to: 0 curr count: 9
2022/01/03 17:58:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheRYOW (85.36s)
=== RUN   TestCacheExpiry
2022/01/03 17:58:33 Deploying app: TestCacheExpiry. Item count src bucket: 0 dst bucket: 0
2022/01/03 17:58:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiry stored in temp store"
}
2022/01/03 17:58:39 Waiting for app: TestCacheExpiry to get deployed
2022/01/03 17:58:44 Waiting for app: TestCacheExpiry to get deployed
2022/01/03 17:58:49 Waiting for app: TestCacheExpiry to get deployed
2022/01/03 17:58:54 Waiting for app: TestCacheExpiry to get deployed
2022/01/03 17:58:54 App: TestCacheExpiry got deployed
2022/01/03 17:58:54 Starting bucket ops to source bucket
2022/01/03 17:59:00 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 17:59:05 Waiting for dst bucket item count to get to: 100 curr count: 14
2022/01/03 17:59:10 Waiting for dst bucket item count to get to: 100 curr count: 37
2022/01/03 17:59:15 Waiting for dst bucket item count to get to: 100 curr count: 72
2022/01/03 17:59:20 Waiting for dst bucket item count to get to: 100 curr count: 99
2022/01/03 17:59:20 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 17:59:20 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 17:59:25 Waiting for app: TestCacheExpiry to get un-deployed
2022/01/03 17:59:30 Waiting for app: TestCacheExpiry to get un-deployed
2022/01/03 17:59:35 Waiting for app: TestCacheExpiry to get un-deployed
2022/01/03 17:59:40 Waiting for app: TestCacheExpiry to get un-deployed
2022/01/03 17:59:40 App: TestCacheExpiry got un-deployed
2022/01/03 17:59:40 No eventing-con process running
2022/01/03 17:59:40 Function: TestCacheExpiry delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiry deleting in background"
}
2022/01/03 17:59:42 Context: Bucket flush, response code: 200 dump: 
2022/01/03 17:59:52 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 17:59:57 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 17:59:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 17:59:58 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:00:08 Waiting for dst bucket item count to get to: 0 curr count: 79
2022/01/03 18:00:13 Waiting for dst bucket item count to get to: 0 curr count: 29
2022/01/03 18:00:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheExpiry (100.25s)
=== RUN   TestCacheExpiryCustom
2022/01/03 18:00:13 Deploying app: TestCacheExpiryCustom. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:00:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiryCustom stored in temp store"
}
2022/01/03 18:00:20 Waiting for app: TestCacheExpiryCustom to get deployed
2022/01/03 18:00:25 Waiting for app: TestCacheExpiryCustom to get deployed
2022/01/03 18:00:30 Waiting for app: TestCacheExpiryCustom to get deployed
2022/01/03 18:00:35 Waiting for app: TestCacheExpiryCustom to get deployed
2022/01/03 18:00:35 App: TestCacheExpiryCustom got deployed
2022/01/03 18:00:35 Starting bucket ops to source bucket
2022/01/03 18:00:40 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 18:00:45 Waiting for dst bucket item count to get to: 100 curr count: 14
2022/01/03 18:00:50 Waiting for dst bucket item count to get to: 100 curr count: 37
2022/01/03 18:00:55 Waiting for dst bucket item count to get to: 100 curr count: 72
2022/01/03 18:01:00 Waiting for dst bucket item count to get to: 100 curr count: 99
2022/01/03 18:01:00 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 18:01:00 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:01:05 Waiting for app: TestCacheExpiryCustom to get un-deployed
2022/01/03 18:01:10 Waiting for app: TestCacheExpiryCustom to get un-deployed
2022/01/03 18:01:15 Waiting for app: TestCacheExpiryCustom to get un-deployed
2022/01/03 18:01:20 Waiting for app: TestCacheExpiryCustom to get un-deployed
2022/01/03 18:01:20 App: TestCacheExpiryCustom got un-deployed
2022/01/03 18:01:20 No eventing-con process running
2022/01/03 18:01:20 Function: TestCacheExpiryCustom delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheExpiryCustom deleting in background"
}
2022/01/03 18:01:22 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:01:32 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 18:01:37 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 18:01:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:01:39 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:01:49 Waiting for dst bucket item count to get to: 0 curr count: 85
2022/01/03 18:01:54 Waiting for dst bucket item count to get to: 0 curr count: 35
2022/01/03 18:01:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheExpiryCustom (100.27s)
=== RUN   TestCacheOverflowCustom
2022/01/03 18:01:54 Deploying app: TestCacheOverflowCustom. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:01:55 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheOverflowCustom stored in temp store"
}
2022/01/03 18:02:00 Waiting for app: TestCacheOverflowCustom to get deployed
2022/01/03 18:02:05 Waiting for app: TestCacheOverflowCustom to get deployed
2022/01/03 18:02:10 Waiting for app: TestCacheOverflowCustom to get deployed
2022/01/03 18:02:15 Waiting for app: TestCacheOverflowCustom to get deployed
2022/01/03 18:02:15 App: TestCacheOverflowCustom got deployed
2022/01/03 18:02:15 Starting bucket ops to source bucket
2022/01/03 18:02:20 Waiting for dst bucket item count to get to: 35 curr count: 0
2022/01/03 18:02:25 Waiting for dst bucket item count to get to: 35 curr count: 6
2022/01/03 18:02:30 Waiting for dst bucket item count to get to: 35 curr count: 15
2022/01/03 18:02:35 Waiting for dst bucket item count to get to: 35 curr count: 23
2022/01/03 18:02:40 Waiting for dst bucket item count to get to: 35 curr count: 27
2022/01/03 18:02:40 src & dst bucket item count matched up. src bucket count: 35 dst bucket count: 35
2022/01/03 18:02:40 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:02:45 Waiting for app: TestCacheOverflowCustom to get un-deployed
2022/01/03 18:02:50 Waiting for app: TestCacheOverflowCustom to get un-deployed
2022/01/03 18:02:55 Waiting for app: TestCacheOverflowCustom to get un-deployed
2022/01/03 18:03:00 Waiting for app: TestCacheOverflowCustom to get un-deployed
2022/01/03 18:03:00 App: TestCacheOverflowCustom got un-deployed
2022/01/03 18:03:00 No eventing-con process running
2022/01/03 18:03:00 Function: TestCacheOverflowCustom delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCacheOverflowCustom deleting in background"
}
2022/01/03 18:03:02 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:03:12 Waiting for dst bucket item count to get to: 0 curr count: 5
2022/01/03 18:03:17 Waiting for dst bucket item count to get to: 0 curr count: 5
2022/01/03 18:03:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:03:19 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:03:29 Waiting for dst bucket item count to get to: 0 curr count: 34
2022/01/03 18:03:34 Waiting for dst bucket item count to get to: 0 curr count: 16
2022/01/03 18:03:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCacheOverflowCustom (100.35s)
=== RUN   TestStrictMode
2022/01/03 18:03:34 Deploying app: TestStrictMode. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:03:35 Context: Post to main store, response code: 422 dump: {
 "name": "ERR_HANDLER_COMPILATION",
 "code": 27,
 "description": {
  "area": "handlerCode",
  "column_number": 63,
  "compile_success": false,
  "description": "        destination[meta.id] = 00000000000000000000000000000101;\n                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\nSyntaxError: Octal literals are not allowed in strict mode.\n",
  "index": 132,
  "language": "JavaScript",
  "line_number": 4
 }
}
--- PASS: TestStrictMode (1.07s)
=== RUN   TestDataTypes
2022/01/03 18:03:35 Deploying app: TestDataTypes. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:03:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDataTypes stored in temp store"
}
2022/01/03 18:03:41 Waiting for app: TestDataTypes to get deployed
2022/01/03 18:03:46 Waiting for app: TestDataTypes to get deployed
2022/01/03 18:03:51 Waiting for app: TestDataTypes to get deployed
2022/01/03 18:03:56 Waiting for app: TestDataTypes to get deployed
2022/01/03 18:03:56 App: TestDataTypes got deployed
2022/01/03 18:03:56 Starting bucket ops to source bucket
2022/01/03 18:04:01 Waiting for dst bucket item count to get to: 18 curr count: 0
2022/01/03 18:04:01 src & dst bucket item count matched up. src bucket count: 18 dst bucket count: 18
2022/01/03 18:04:01 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:04:06 Waiting for app: TestDataTypes to get un-deployed
2022/01/03 18:04:11 Waiting for app: TestDataTypes to get un-deployed
2022/01/03 18:04:16 Waiting for app: TestDataTypes to get un-deployed
2022/01/03 18:04:21 Waiting for app: TestDataTypes to get un-deployed
2022/01/03 18:04:21 App: TestDataTypes got un-deployed
2022/01/03 18:04:21 No eventing-con process running
2022/01/03 18:04:22 Function: TestDataTypes delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDataTypes deleting in background"
}
2022/01/03 18:04:23 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:04:33 Waiting for dst bucket item count to get to: 0 curr count: 1
2022/01/03 18:04:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:04:35 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:04:45 Waiting for dst bucket item count to get to: 0 curr count: 18
2022/01/03 18:04:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDataTypes (70.10s)
=== RUN   TestEnoentGet
2022/01/03 18:04:45 Deploying app: TestEnoentGet. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:04:46 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet stored in temp store"
}
2022/01/03 18:04:51 Waiting for app: TestEnoentGet to get deployed
2022/01/03 18:04:56 Waiting for app: TestEnoentGet to get deployed
2022/01/03 18:05:01 Waiting for app: TestEnoentGet to get deployed
2022/01/03 18:05:06 Waiting for app: TestEnoentGet to get deployed
2022/01/03 18:05:06 App: TestEnoentGet got deployed
2022/01/03 18:05:06 Starting bucket ops to source bucket
2022/01/03 18:05:11 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 18:05:11 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 18:05:11 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:05:17 Waiting for app: TestEnoentGet to get un-deployed
2022/01/03 18:05:22 Waiting for app: TestEnoentGet to get un-deployed
2022/01/03 18:05:27 Waiting for app: TestEnoentGet to get un-deployed
2022/01/03 18:05:32 Waiting for app: TestEnoentGet to get un-deployed
2022/01/03 18:05:32 App: TestEnoentGet got un-deployed
2022/01/03 18:05:32 No eventing-con process running
2022/01/03 18:05:32 Function: TestEnoentGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet deleting in background"
}
2022/01/03 18:05:33 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:05:43 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 18:05:48 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 18:05:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:05:50 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:06:00 Waiting for dst bucket item count to get to: 0 curr count: 77
2022/01/03 18:06:05 Waiting for dst bucket item count to get to: 0 curr count: 77
2022/01/03 18:06:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:06:05 Deploying app: TestEnoentGet. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:06:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet stored in temp store"
}
2022/01/03 18:06:11 Waiting for app: TestEnoentGet to get deployed
2022/01/03 18:06:16 Waiting for app: TestEnoentGet to get deployed
2022/01/03 18:06:21 Waiting for app: TestEnoentGet to get deployed
2022/01/03 18:06:27 Waiting for app: TestEnoentGet to get deployed
2022/01/03 18:06:27 App: TestEnoentGet got deployed
2022/01/03 18:06:27 Starting bucket ops to source bucket
2022/01/03 18:06:32 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 18:06:32 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 18:06:32 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:06:37 Waiting for app: TestEnoentGet to get un-deployed
2022/01/03 18:06:42 Waiting for app: TestEnoentGet to get un-deployed
2022/01/03 18:06:47 Waiting for app: TestEnoentGet to get un-deployed
2022/01/03 18:06:52 Waiting for app: TestEnoentGet to get un-deployed
2022/01/03 18:06:52 App: TestEnoentGet got un-deployed
2022/01/03 18:06:52 No eventing-con process running
2022/01/03 18:06:52 Function: TestEnoentGet delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentGet deleting in background"
}
2022/01/03 18:06:54 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:07:04 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 18:07:09 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 18:07:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:07:11 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:07:21 Waiting for dst bucket item count to get to: 0 curr count: 82
2022/01/03 18:07:26 Waiting for dst bucket item count to get to: 0 curr count: 82
2022/01/03 18:07:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentGet (160.46s)
=== RUN   TestEnoentDelete
2022/01/03 18:07:26 Deploying app: TestEnoentDelete. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:07:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete stored in temp store"
}
2022/01/03 18:07:32 Waiting for app: TestEnoentDelete to get deployed
2022/01/03 18:07:37 Waiting for app: TestEnoentDelete to get deployed
2022/01/03 18:07:42 Waiting for app: TestEnoentDelete to get deployed
2022/01/03 18:07:47 Waiting for app: TestEnoentDelete to get deployed
2022/01/03 18:07:47 App: TestEnoentDelete got deployed
2022/01/03 18:07:47 Starting bucket ops to source bucket
2022/01/03 18:07:52 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 18:07:52 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 18:07:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:07:57 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/03 18:08:02 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/03 18:08:07 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/03 18:08:12 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/03 18:08:12 App: TestEnoentDelete got un-deployed
2022/01/03 18:08:12 No eventing-con process running
2022/01/03 18:08:12 Function: TestEnoentDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete deleting in background"
}
2022/01/03 18:08:14 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:08:24 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 18:08:29 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 18:08:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:08:31 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:08:41 Waiting for dst bucket item count to get to: 0 curr count: 89
2022/01/03 18:08:46 Waiting for dst bucket item count to get to: 0 curr count: 89
2022/01/03 18:08:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:08:46 Deploying app: TestEnoentDelete. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:08:47 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete stored in temp store"
}
2022/01/03 18:08:52 Waiting for app: TestEnoentDelete to get deployed
2022/01/03 18:08:57 Waiting for app: TestEnoentDelete to get deployed
2022/01/03 18:09:02 Waiting for app: TestEnoentDelete to get deployed
2022/01/03 18:09:07 Waiting for app: TestEnoentDelete to get deployed
2022/01/03 18:09:07 App: TestEnoentDelete got deployed
2022/01/03 18:09:07 Starting bucket ops to source bucket
2022/01/03 18:09:12 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 18:09:12 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 18:09:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:09:17 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/03 18:09:22 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/03 18:09:27 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/03 18:09:32 Waiting for app: TestEnoentDelete to get un-deployed
2022/01/03 18:09:32 App: TestEnoentDelete got un-deployed
2022/01/03 18:09:32 No eventing-con process running
2022/01/03 18:09:32 Function: TestEnoentDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEnoentDelete deleting in background"
}
2022/01/03 18:09:34 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:09:44 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 18:09:49 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 18:09:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:09:51 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:10:01 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 18:10:06 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 18:10:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEnoentDelete (160.43s)
=== RUN   TestError
2022/01/03 18:10:16 Waiting for app: TestError to get un-deployed
2022/01/03 18:10:16 App: TestError got un-deployed
2022/01/03 18:10:16 No eventing-con process running
2022/01/03 18:10:16 Function: TestError delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestError not found"
}
2022/01/03 18:10:18 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:10:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:10:25 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:10:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:10:30 Deploying app: TestError. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:10:31 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestError stored in temp store"
}
2022/01/03 18:10:36 Waiting for app: TestError to get deployed
2022/01/03 18:10:41 Waiting for app: TestError to get deployed
2022/01/03 18:10:46 Waiting for app: TestError to get deployed
2022/01/03 18:10:51 Waiting for app: TestError to get deployed
2022/01/03 18:10:51 App: TestError got deployed
2022/01/03 18:10:51 Starting bucket ops to source bucket
2022/01/03 18:10:56 Waiting for dst bucket item count to get to: 300 curr count: 0
2022/01/03 18:11:01 Waiting for dst bucket item count to get to: 300 curr count: 0
2022/01/03 18:11:01 src & dst bucket item count matched up. src bucket count: 300 dst bucket count: 300
2022/01/03 18:11:01 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:11:06 Waiting for app: TestError to get un-deployed
2022/01/03 18:11:11 Waiting for app: TestError to get un-deployed
2022/01/03 18:11:16 Waiting for app: TestError to get un-deployed
2022/01/03 18:11:21 Waiting for app: TestError to get un-deployed
2022/01/03 18:11:21 App: TestError got un-deployed
2022/01/03 18:11:21 No eventing-con process running
2022/01/03 18:11:21 Function: TestError delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestError deleting in background"
}
2022/01/03 18:11:23 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:11:33 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 18:11:38 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 18:11:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:11:40 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:11:50 Waiting for dst bucket item count to get to: 0 curr count: 166
2022/01/03 18:11:55 Waiting for dst bucket item count to get to: 0 curr count: 166
2022/01/03 18:11:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestError (108.87s)
=== RUN   TestCRLF
2022/01/03 18:12:05 Waiting for app: TestCRLF to get un-deployed
2022/01/03 18:12:05 App: TestCRLF got un-deployed
2022/01/03 18:12:05 No eventing-con process running
2022/01/03 18:12:05 Function: TestCRLF delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCRLF not found"
}
2022/01/03 18:12:07 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:12:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:12:13 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:12:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:12:18 Deploying app: TestCRLF. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:12:20 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCRLF stored in temp store"
}
2022/01/03 18:12:25 Waiting for app: TestCRLF to get deployed
2022/01/03 18:12:30 Waiting for app: TestCRLF to get deployed
2022/01/03 18:12:35 Waiting for app: TestCRLF to get deployed
2022/01/03 18:12:40 Waiting for app: TestCRLF to get deployed
2022/01/03 18:12:40 App: TestCRLF got deployed
2022/01/03 18:12:40 Starting bucket ops to source bucket
2022/01/03 18:12:45 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 18:12:50 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 18:12:55 Waiting for dst bucket item count to get to: 100 curr count: 41
2022/01/03 18:12:55 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 18:12:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:13:00 Waiting for app: TestCRLF to get un-deployed
2022/01/03 18:13:05 Waiting for app: TestCRLF to get un-deployed
2022/01/03 18:13:10 Waiting for app: TestCRLF to get un-deployed
2022/01/03 18:13:15 Waiting for app: TestCRLF to get un-deployed
2022/01/03 18:13:15 App: TestCRLF got un-deployed
2022/01/03 18:13:15 No eventing-con process running
2022/01/03 18:13:15 Function: TestCRLF delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCRLF deleting in background"
}
2022/01/03 18:13:17 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:13:27 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 18:13:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:13:29 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:13:39 Waiting for dst bucket item count to get to: 0 curr count: 94
2022/01/03 18:13:44 Waiting for dst bucket item count to get to: 0 curr count: 35
2022/01/03 18:13:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCRLF (108.93s)
=== RUN   TestImportExport
2022/01/03 18:13:54 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2022/01/03 18:13:54 App: TestImportExport_n1ql_insert_on_update got un-deployed
2022/01/03 18:13:54 No eventing-con process running
2022/01/03 18:13:54 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestImportExport_n1ql_insert_on_update not found"
}
2022/01/03 18:13:56 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:14:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:14:02 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:14:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:14:12 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2022/01/03 18:14:12 App: TestImportExport_bucket_op_on_update got un-deployed
2022/01/03 18:14:12 No eventing-con process running
2022/01/03 18:14:12 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestImportExport_bucket_op_on_update not found"
}
2022/01/03 18:14:14 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:14:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:14:21 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:14:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:14:26 Deploying app: TestImportExport_n1ql_insert_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:14:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update stored in temp store"
}
2022/01/03 18:14:27 Deploying app: TestImportExport_bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:14:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update stored in temp store"
}
2022/01/03 18:14:33 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2022/01/03 18:14:38 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2022/01/03 18:14:43 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2022/01/03 18:14:48 Waiting for app: TestImportExport_n1ql_insert_on_update to get deployed
2022/01/03 18:14:48 App: TestImportExport_n1ql_insert_on_update got deployed
2022/01/03 18:14:53 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2022/01/03 18:14:58 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2022/01/03 18:15:03 Waiting for app: TestImportExport_bucket_op_on_update to get deployed
2022/01/03 18:15:03 App: TestImportExport_bucket_op_on_update got deployed
2022/01/03 18:15:08 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2022/01/03 18:15:14 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2022/01/03 18:15:19 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2022/01/03 18:15:24 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2022/01/03 18:15:24 App: TestImportExport_n1ql_insert_on_update got un-deployed
2022/01/03 18:15:24 No eventing-con process running
2022/01/03 18:15:24 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update deleting in background"
}
2022/01/03 18:15:29 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2022/01/03 18:15:34 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2022/01/03 18:15:39 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2022/01/03 18:15:44 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2022/01/03 18:15:44 App: TestImportExport_bucket_op_on_update got un-deployed
2022/01/03 18:15:44 No eventing-con process running
2022/01/03 18:15:44 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update deleting in background"
}
2022/01/03 18:16:01 Waiting for app: TestImportExport_bucket_op_on_update to get un-deployed
2022/01/03 18:16:01 App: TestImportExport_bucket_op_on_update got un-deployed
2022/01/03 18:16:01 No eventing-con process running
2022/01/03 18:16:01 Function: TestImportExport_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_bucket_op_on_update deleting in background"
}
2022/01/03 18:16:03 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:16:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:16:10 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:16:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:16:20 Waiting for app: TestImportExport_n1ql_insert_on_update to get un-deployed
2022/01/03 18:16:20 App: TestImportExport_n1ql_insert_on_update got un-deployed
2022/01/03 18:16:20 No eventing-con process running
2022/01/03 18:16:20 Function: TestImportExport_n1ql_insert_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestImportExport_n1ql_insert_on_update deleting in background"
}
2022/01/03 18:16:22 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:16:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:16:28 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:16:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestImportExport (169.62s)
=== RUN   TestDeployUndeployLoopNonDefaultSettings
2022/01/03 18:16:43 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:16:43 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2022/01/03 18:16:43 No eventing-con process running
2022/01/03 18:16:43 Function: TestDeployUndeployLoopNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeployUndeployLoopNonDefaultSettings not found"
}
2022/01/03 18:16:45 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:16:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:16:52 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:16:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:16:57 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:16:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2022/01/03 18:16:58 Starting bucket ops to source bucket
2022/01/03 18:17:06 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:17:11 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:17:16 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:17:21 Waiting for dst bucket item count to get to: 5000 curr count: 12
2022/01/03 18:17:26 Waiting for dst bucket item count to get to: 5000 curr count: 12
2022/01/03 18:17:26 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:17:31 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2022/01/03 18:17:31 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2022/01/03 18:17:31 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:17:31 Undeploying app: bucket_op_on_update
2022/01/03 18:17:36 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:17:41 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:17:46 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:17:51 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:17:51 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2022/01/03 18:17:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:17:51 No eventing-con process running
2022/01/03 18:17:53 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:18:01 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:18:36 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:18:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2022/01/03 18:18:37 Starting bucket ops to source bucket
2022/01/03 18:18:44 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:18:50 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:18:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:19:00 Waiting for dst bucket item count to get to: 5000 curr count: 1943
2022/01/03 18:19:05 Waiting for dst bucket item count to get to: 5000 curr count: 1943
2022/01/03 18:19:05 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:19:10 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2022/01/03 18:19:10 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2022/01/03 18:19:10 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:19:10 Undeploying app: bucket_op_on_update
2022/01/03 18:19:15 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:19:20 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:19:25 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:19:30 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:19:30 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2022/01/03 18:19:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:19:30 No eventing-con process running
2022/01/03 18:19:32 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:19:39 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:20:14 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:20:15 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2022/01/03 18:20:15 Starting bucket ops to source bucket
2022/01/03 18:20:23 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:20:28 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:20:33 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:20:38 Waiting for dst bucket item count to get to: 5000 curr count: 3062
2022/01/03 18:20:43 Waiting for dst bucket item count to get to: 5000 curr count: 3062
2022/01/03 18:20:43 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:20:48 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2022/01/03 18:20:48 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2022/01/03 18:20:48 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:20:48 Undeploying app: bucket_op_on_update
2022/01/03 18:20:53 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:20:58 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:21:03 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:21:08 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:21:08 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2022/01/03 18:21:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:21:08 No eventing-con process running
2022/01/03 18:21:10 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:21:17 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:21:52 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:21:53 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2022/01/03 18:21:53 Starting bucket ops to source bucket
2022/01/03 18:22:01 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:22:06 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:22:11 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:22:16 Waiting for dst bucket item count to get to: 5000 curr count: 2481
2022/01/03 18:22:21 Waiting for dst bucket item count to get to: 5000 curr count: 4981
2022/01/03 18:22:21 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:22:26 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2022/01/03 18:22:26 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2022/01/03 18:22:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:22:26 Undeploying app: bucket_op_on_update
2022/01/03 18:22:31 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:22:36 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:22:41 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:22:46 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:22:46 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2022/01/03 18:22:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:22:47 No eventing-con process running
2022/01/03 18:22:48 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:22:56 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:23:31 Deploying app: TestDeployUndeployLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:23:32 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings stored in temp store"
}
2022/01/03 18:23:32 Starting bucket ops to source bucket
2022/01/03 18:23:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:23:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:23:50 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:23:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:23:55 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:24:00 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get deployed
2022/01/03 18:24:00 App: TestDeployUndeployLoopNonDefaultSettings got deployed
2022/01/03 18:24:00 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:24:00 Undeploying app: bucket_op_on_update
2022/01/03 18:24:05 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:24:10 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:24:15 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:24:20 Waiting for app: TestDeployUndeployLoopNonDefaultSettings to get un-deployed
2022/01/03 18:24:20 App: TestDeployUndeployLoopNonDefaultSettings got un-deployed
2022/01/03 18:24:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:24:20 No eventing-con process running
2022/01/03 18:24:22 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:24:29 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:25:04 Function: TestDeployUndeployLoopNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopNonDefaultSettings deleting in background"
}
--- PASS: TestDeployUndeployLoopNonDefaultSettings (510.51s)
=== RUN   TestOnUpdateN1QLOp
2022/01/03 18:25:14 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2022/01/03 18:25:14 App: TestOnUpdateN1QLOp got un-deployed
2022/01/03 18:25:14 No eventing-con process running
2022/01/03 18:25:14 Function: TestOnUpdateN1QLOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateN1QLOp not found"
}
2022/01/03 18:25:16 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:25:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:25:22 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:25:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:25:27 Deploying app: TestOnUpdateN1QLOp. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:25:29 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateN1QLOp stored in temp store"
}
2022/01/03 18:25:29 Starting bucket ops to source bucket
2022/01/03 18:25:37 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:25:42 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:25:47 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:25:52 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:25:57 Waiting for dst bucket item count to get to: 5000 curr count: 2537
2022/01/03 18:25:57 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:25:57 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:26:02 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2022/01/03 18:26:07 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2022/01/03 18:26:12 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2022/01/03 18:26:17 Waiting for app: TestOnUpdateN1QLOp to get un-deployed
2022/01/03 18:26:17 App: TestOnUpdateN1QLOp got un-deployed
2022/01/03 18:26:17 No eventing-con process running
2022/01/03 18:26:17 Function: TestOnUpdateN1QLOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateN1QLOp deleting in background"
}
2022/01/03 18:26:19 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:26:29 Waiting for dst bucket item count to get to: 0 curr count: 4619
2022/01/03 18:26:34 Waiting for dst bucket item count to get to: 0 curr count: 2119
2022/01/03 18:26:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:26:35 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:26:45 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 18:26:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateN1QLOp (101.58s)
=== RUN   TestOnUpdateBucketOpDefaultSettings
2022/01/03 18:26:55 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2022/01/03 18:26:56 App: TestOnUpdateBucketOpDefaultSettings got un-deployed
2022/01/03 18:26:56 No eventing-con process running
2022/01/03 18:26:56 Function: TestOnUpdateBucketOpDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings not found"
}
2022/01/03 18:26:57 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:27:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:27:04 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:27:09 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:27:09 Deploying app: TestOnUpdateBucketOpDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:27:10 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings stored in temp store"
}
2022/01/03 18:27:10 Starting bucket ops to source bucket
2022/01/03 18:27:18 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:27:23 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:27:28 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:27:33 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:27:33 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:27:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:27:38 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2022/01/03 18:27:43 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2022/01/03 18:27:48 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2022/01/03 18:27:53 Waiting for app: TestOnUpdateBucketOpDefaultSettings to get un-deployed
2022/01/03 18:27:53 App: TestOnUpdateBucketOpDefaultSettings got un-deployed
2022/01/03 18:27:53 No eventing-con process running
2022/01/03 18:27:53 Function: TestOnUpdateBucketOpDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings deleting in background"
}
2022/01/03 18:27:55 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:28:05 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 18:28:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:28:07 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:28:17 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 18:28:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings (91.44s)
=== RUN   TestOnUpdateBucketOpNonDefaultSettings
2022/01/03 18:28:27 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 18:28:27 App: TestOnUpdateBucketOpNonDefaultSettings got un-deployed
2022/01/03 18:28:27 No eventing-con process running
2022/01/03 18:28:27 Function: TestOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpNonDefaultSettings not found"
}
2022/01/03 18:28:29 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:28:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:28:36 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:28:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:28:41 Deploying app: TestOnUpdateBucketOpNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:28:42 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpNonDefaultSettings stored in temp store"
}
2022/01/03 18:28:42 Starting bucket ops to source bucket
2022/01/03 18:28:50 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:28:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:29:00 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:29:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:29:05 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:29:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:29:10 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 18:29:15 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 18:29:20 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 18:29:25 Waiting for app: TestOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 18:29:25 App: TestOnUpdateBucketOpNonDefaultSettings got un-deployed
2022/01/03 18:29:25 No eventing-con process running
2022/01/03 18:29:25 Function: TestOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpNonDefaultSettings deleting in background"
}
2022/01/03 18:29:27 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:29:37 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 18:29:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:29:38 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:29:49 Waiting for dst bucket item count to get to: 0 curr count: 4278
2022/01/03 18:29:54 Waiting for dst bucket item count to get to: 0 curr count: 1778
2022/01/03 18:29:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpNonDefaultSettings (96.58s)
=== RUN   TestOnUpdateBucketOpDefaultSettings10K
2022/01/03 18:30:04 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2022/01/03 18:30:04 App: TestOnUpdateBucketOpDefaultSettings10K got un-deployed
2022/01/03 18:30:04 No eventing-con process running
2022/01/03 18:30:04 Function: TestOnUpdateBucketOpDefaultSettings10K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings10K not found"
}
2022/01/03 18:30:05 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:30:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:30:12 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:30:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:30:17 Deploying app: TestOnUpdateBucketOpDefaultSettings10K. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:30:18 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings10K stored in temp store"
}
2022/01/03 18:30:18 Starting bucket ops to source bucket
2022/01/03 18:30:26 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:30:31 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:30:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:30:41 Waiting for dst bucket item count to get to: 5000 curr count: 10
2022/01/03 18:30:46 Waiting for dst bucket item count to get to: 5000 curr count: 2510
2022/01/03 18:30:46 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:30:46 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:30:51 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2022/01/03 18:30:56 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2022/01/03 18:31:01 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2022/01/03 18:31:06 Waiting for app: TestOnUpdateBucketOpDefaultSettings10K to get un-deployed
2022/01/03 18:31:06 App: TestOnUpdateBucketOpDefaultSettings10K got un-deployed
2022/01/03 18:31:06 No eventing-con process running
2022/01/03 18:31:07 Function: TestOnUpdateBucketOpDefaultSettings10K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings10K deleting in background"
}
2022/01/03 18:31:08 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:31:18 Waiting for dst bucket item count to get to: 0 curr count: 3779
2022/01/03 18:31:23 Waiting for dst bucket item count to get to: 0 curr count: 1279
2022/01/03 18:31:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:31:25 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:31:35 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 18:31:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings10K (101.58s)
=== RUN   TestOnUpdateBucketOpDefaultSettings100K
2022/01/03 18:31:45 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2022/01/03 18:31:45 App: TestOnUpdateBucketOpDefaultSettings100K got un-deployed
2022/01/03 18:31:45 No eventing-con process running
2022/01/03 18:31:45 Function: TestOnUpdateBucketOpDefaultSettings100K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateBucketOpDefaultSettings100K not found"
}
2022/01/03 18:31:47 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:31:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:31:54 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:31:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:31:59 Deploying app: TestOnUpdateBucketOpDefaultSettings100K. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:32:00 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings100K stored in temp store"
}
2022/01/03 18:32:00 Starting bucket ops to source bucket
2022/01/03 18:32:08 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:32:13 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:32:18 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:32:23 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:32:28 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2022/01/03 18:32:28 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:32:28 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:32:33 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2022/01/03 18:32:39 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2022/01/03 18:32:44 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2022/01/03 18:32:49 Waiting for app: TestOnUpdateBucketOpDefaultSettings100K to get un-deployed
2022/01/03 18:32:49 App: TestOnUpdateBucketOpDefaultSettings100K got un-deployed
2022/01/03 18:32:49 No eventing-con process running
2022/01/03 18:32:49 Function: TestOnUpdateBucketOpDefaultSettings100K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateBucketOpDefaultSettings100K deleting in background"
}
2022/01/03 18:32:50 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:33:00 Waiting for dst bucket item count to get to: 0 curr count: 3848
2022/01/03 18:33:05 Waiting for dst bucket item count to get to: 0 curr count: 3848
2022/01/03 18:33:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:33:07 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:33:17 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 18:33:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateBucketOpDefaultSettings100K (102.16s)
=== RUN   TestOnDeleteBucketOp
2022/01/03 18:33:27 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2022/01/03 18:33:27 App: TestOnDeleteBucketOp got un-deployed
2022/01/03 18:33:27 No eventing-con process running
2022/01/03 18:33:27 Function: TestOnDeleteBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteBucketOp not found"
}
2022/01/03 18:33:29 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:33:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:33:36 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:33:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:33:41 Deploying app: TestOnDeleteBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:33:42 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp stored in temp store"
}
2022/01/03 18:33:42 Starting bucket ops to source bucket
2022/01/03 18:33:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:33:58 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:34:03 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:34:03 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:34:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:34:08 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2022/01/03 18:34:13 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2022/01/03 18:34:18 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2022/01/03 18:34:23 Waiting for app: TestOnDeleteBucketOp to get un-deployed
2022/01/03 18:34:23 App: TestOnDeleteBucketOp got un-deployed
2022/01/03 18:34:23 No eventing-con process running
2022/01/03 18:34:23 Function: TestOnDeleteBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp deleting in background"
}
2022/01/03 18:34:25 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:34:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:34:32 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:34:42 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 18:34:47 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 18:34:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteBucketOp (89.77s)
=== RUN   TestOnDeleteBucketOp5K
2022/01/03 18:34:57 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2022/01/03 18:34:57 App: TestOnDeleteBucketOp5K got un-deployed
2022/01/03 18:34:57 No eventing-con process running
2022/01/03 18:34:57 Function: TestOnDeleteBucketOp5K delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteBucketOp5K not found"
}
2022/01/03 18:34:59 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:35:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:35:06 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:35:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:35:11 Deploying app: TestOnDeleteBucketOp5K. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:35:12 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp5K stored in temp store"
}
2022/01/03 18:35:12 Starting bucket ops to source bucket
2022/01/03 18:35:23 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:35:28 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:35:33 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:35:33 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:35:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:35:38 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2022/01/03 18:35:43 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2022/01/03 18:35:48 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2022/01/03 18:35:53 Waiting for app: TestOnDeleteBucketOp5K to get un-deployed
2022/01/03 18:35:53 App: TestOnDeleteBucketOp5K got un-deployed
2022/01/03 18:35:53 No eventing-con process running
2022/01/03 18:35:53 Function: TestOnDeleteBucketOp5K delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteBucketOp5K deleting in background"
}
2022/01/03 18:35:55 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:36:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:36:02 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:36:12 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 18:36:17 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 18:36:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteBucketOp5K (90.07s)
=== RUN   TestTimerBucketOp
2022/01/03 18:36:27 Waiting for app: TestTimerBucketOp to get un-deployed
2022/01/03 18:36:27 App: TestTimerBucketOp got un-deployed
2022/01/03 18:36:27 No eventing-con process running
2022/01/03 18:36:27 Function: TestTimerBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerBucketOp not found"
}
2022/01/03 18:36:29 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:36:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:36:36 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:36:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:36:41 Deploying app: TestTimerBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:36:42 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerBucketOp stored in temp store"
}
2022/01/03 18:36:42 Starting bucket ops to source bucket
2022/01/03 18:36:50 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:36:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:37:00 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:37:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:37:10 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:37:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:37:20 Waiting for dst bucket item count to get to: 5000 curr count: 1249
2022/01/03 18:37:25 Waiting for dst bucket item count to get to: 5000 curr count: 1249
2022/01/03 18:37:25 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:37:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:37:30 Waiting for app: TestTimerBucketOp to get un-deployed
2022/01/03 18:37:35 Waiting for app: TestTimerBucketOp to get un-deployed
2022/01/03 18:37:40 Waiting for app: TestTimerBucketOp to get un-deployed
2022/01/03 18:37:45 Waiting for app: TestTimerBucketOp to get un-deployed
2022/01/03 18:37:45 App: TestTimerBucketOp got un-deployed
2022/01/03 18:37:45 No eventing-con process running
2022/01/03 18:37:45 Function: TestTimerBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerBucketOp deleting in background"
}
2022/01/03 18:37:47 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:37:57 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 18:37:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:37:58 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:38:08 Waiting for dst bucket item count to get to: 0 curr count: 4471
2022/01/03 18:38:13 Waiting for dst bucket item count to get to: 0 curr count: 1971
2022/01/03 18:38:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerBucketOp (116.40s)
=== RUN   TestTimerInPastBucketOp
2022/01/03 18:38:24 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2022/01/03 18:38:24 App: TestTimerInPastBucketOp got un-deployed
2022/01/03 18:38:24 No eventing-con process running
2022/01/03 18:38:24 Function: TestTimerInPastBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerInPastBucketOp not found"
}
2022/01/03 18:38:25 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:38:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:38:32 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:38:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:38:37 Deploying app: TestTimerInPastBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:38:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerInPastBucketOp stored in temp store"
}
2022/01/03 18:38:38 Starting bucket ops to source bucket
2022/01/03 18:38:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:38:51 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:38:56 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:39:01 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:39:06 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:39:11 Waiting for dst bucket item count to get to: 5000 curr count: 1015
2022/01/03 18:39:16 Waiting for dst bucket item count to get to: 5000 curr count: 3153
2022/01/03 18:39:21 Waiting for dst bucket item count to get to: 5000 curr count: 4327
2022/01/03 18:39:26 Waiting for dst bucket item count to get to: 5000 curr count: 4689
2022/01/03 18:39:26 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:39:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:39:31 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2022/01/03 18:39:36 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2022/01/03 18:39:41 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2022/01/03 18:39:46 Waiting for app: TestTimerInPastBucketOp to get un-deployed
2022/01/03 18:39:46 App: TestTimerInPastBucketOp got un-deployed
2022/01/03 18:39:46 No eventing-con process running
2022/01/03 18:39:46 Function: TestTimerInPastBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerInPastBucketOp deleting in background"
}
2022/01/03 18:39:48 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:39:58 Waiting for dst bucket item count to get to: 0 curr count: 3807
2022/01/03 18:40:03 Waiting for dst bucket item count to get to: 0 curr count: 1307
2022/01/03 18:40:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:40:05 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:40:15 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 18:40:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerInPastBucketOp (121.45s)
=== RUN   TestDeployUndeployLoopTimer
2022/01/03 18:40:25 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:40:25 App: TestDeployUndeployLoopTimer got un-deployed
2022/01/03 18:40:25 No eventing-con process running
2022/01/03 18:40:25 Function: TestDeployUndeployLoopTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeployUndeployLoopTimer not found"
}
2022/01/03 18:40:27 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:40:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:40:34 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:40:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:40:39 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:40:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2022/01/03 18:40:40 Starting bucket ops to source bucket
2022/01/03 18:40:48 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:40:53 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:40:58 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:41:03 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:41:08 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:41:13 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:41:18 Waiting for dst bucket item count to get to: 5000 curr count: 1147
2022/01/03 18:41:23 Waiting for dst bucket item count to get to: 5000 curr count: 3647
2022/01/03 18:41:23 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:41:28 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2022/01/03 18:41:28 App: TestDeployUndeployLoopTimer got deployed
2022/01/03 18:41:28 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:41:28 Undeploying app: bucket_op_with_timer
2022/01/03 18:41:33 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:41:38 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:41:43 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:41:48 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:41:48 App: TestDeployUndeployLoopTimer got un-deployed
2022/01/03 18:41:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:41:48 No eventing-con process running
2022/01/03 18:41:49 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:41:57 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:42:32 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:42:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2022/01/03 18:42:33 Starting bucket ops to source bucket
2022/01/03 18:42:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:42:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:42:51 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:42:56 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:43:01 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:43:06 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:43:11 Waiting for dst bucket item count to get to: 5000 curr count: 132
2022/01/03 18:43:16 Waiting for dst bucket item count to get to: 5000 curr count: 2632
2022/01/03 18:43:16 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:43:21 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2022/01/03 18:43:21 App: TestDeployUndeployLoopTimer got deployed
2022/01/03 18:43:21 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:43:21 Undeploying app: bucket_op_with_timer
2022/01/03 18:43:26 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:43:31 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:43:36 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:43:41 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:43:41 App: TestDeployUndeployLoopTimer got un-deployed
2022/01/03 18:43:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:43:41 No eventing-con process running
2022/01/03 18:43:43 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:43:50 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:44:25 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:44:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2022/01/03 18:44:26 Starting bucket ops to source bucket
2022/01/03 18:44:34 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:44:39 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:44:44 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:44:49 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:44:54 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:44:59 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:45:04 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:45:04 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:45:09 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2022/01/03 18:45:09 App: TestDeployUndeployLoopTimer got deployed
2022/01/03 18:45:09 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:45:09 Undeploying app: bucket_op_with_timer
2022/01/03 18:45:14 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:45:19 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:45:24 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:45:29 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:45:29 App: TestDeployUndeployLoopTimer got un-deployed
2022/01/03 18:45:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:45:29 No eventing-con process running
2022/01/03 18:45:31 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:45:38 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:46:13 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:46:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2022/01/03 18:46:14 Starting bucket ops to source bucket
2022/01/03 18:46:22 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:46:27 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:46:32 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:46:37 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:46:42 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:46:47 Waiting for dst bucket item count to get to: 5000 curr count: 36
2022/01/03 18:46:53 Waiting for dst bucket item count to get to: 5000 curr count: 551
2022/01/03 18:46:58 Waiting for dst bucket item count to get to: 5000 curr count: 3015
2022/01/03 18:46:58 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:47:03 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2022/01/03 18:47:03 App: TestDeployUndeployLoopTimer got deployed
2022/01/03 18:47:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:47:03 Undeploying app: bucket_op_with_timer
2022/01/03 18:47:08 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:47:13 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:47:18 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:47:23 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:47:23 App: TestDeployUndeployLoopTimer got un-deployed
2022/01/03 18:47:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:47:23 No eventing-con process running
2022/01/03 18:47:25 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:47:32 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:48:07 Deploying app: TestDeployUndeployLoopTimer. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:48:08 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer stored in temp store"
}
2022/01/03 18:48:08 Starting bucket ops to source bucket
2022/01/03 18:48:16 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:48:21 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:48:26 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:48:31 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:48:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:48:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:48:46 Waiting for dst bucket item count to get to: 5000 curr count: 2500
2022/01/03 18:48:46 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:48:51 Waiting for app: TestDeployUndeployLoopTimer to get deployed
2022/01/03 18:48:51 App: TestDeployUndeployLoopTimer got deployed
2022/01/03 18:48:51 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:48:51 Undeploying app: bucket_op_with_timer
2022/01/03 18:48:56 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:49:01 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:49:06 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:49:11 Waiting for app: TestDeployUndeployLoopTimer to get un-deployed
2022/01/03 18:49:11 App: TestDeployUndeployLoopTimer got un-deployed
2022/01/03 18:49:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:49:11 No eventing-con process running
2022/01/03 18:49:13 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:49:20 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:49:55 Function: TestDeployUndeployLoopTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeployUndeployLoopTimer deleting in background"
}
--- PASS: TestDeployUndeployLoopTimer (580.18s)
=== RUN   TestMultipleHandlers
2022/01/03 18:50:05 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2022/01/03 18:50:05 App: TestMultipleHandlers_bucket_op_on_update got un-deployed
2022/01/03 18:50:05 No eventing-con process running
2022/01/03 18:50:05 Function: TestMultipleHandlers_bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMultipleHandlers_bucket_op_on_update not found"
}
2022/01/03 18:50:07 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:50:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:50:14 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:50:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:50:24 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2022/01/03 18:50:24 App: TestMultipleHandlers_bucket_op_on_delete got un-deployed
2022/01/03 18:50:24 No eventing-con process running
2022/01/03 18:50:24 Function: TestMultipleHandlers_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMultipleHandlers_bucket_op_on_delete not found"
}
2022/01/03 18:50:26 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:50:31 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:50:32 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:50:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:50:37 Deploying app: TestMultipleHandlers_bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:50:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_update stored in temp store"
}
2022/01/03 18:50:38 Deploying app: TestMultipleHandlers_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:50:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_delete stored in temp store"
}
2022/01/03 18:50:45 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2022/01/03 18:50:50 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2022/01/03 18:50:55 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2022/01/03 18:51:00 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get deployed
2022/01/03 18:51:00 App: TestMultipleHandlers_bucket_op_on_update got deployed
2022/01/03 18:51:05 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2022/01/03 18:51:10 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2022/01/03 18:51:15 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get deployed
2022/01/03 18:51:15 App: TestMultipleHandlers_bucket_op_on_delete got deployed
2022/01/03 18:51:15 Starting bucket ops to source bucket
2022/01/03 18:51:25 Waiting for dst bucket item count to get to: 5000 curr count: 1116
2022/01/03 18:51:30 Waiting for dst bucket item count to get to: 5000 curr count: 3307
2022/01/03 18:51:35 Waiting for dst bucket item count to get to: 5000 curr count: 4691
2022/01/03 18:51:35 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:51:35 Starting bucket ops to source bucket
2022/01/03 18:51:50 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 18:51:55 Waiting for dst bucket item count to get to: 10000 curr count: 7504
2022/01/03 18:51:55 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 18:51:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:51:55 Function: TestMultipleHandlers_bucket_op_on_update update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 18:51:55 Function: TestMultipleHandlers_bucket_op_on_delete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 18:52:00 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2022/01/03 18:52:05 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2022/01/03 18:52:10 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2022/01/03 18:52:15 Waiting for app: TestMultipleHandlers_bucket_op_on_update to get un-deployed
2022/01/03 18:52:15 App: TestMultipleHandlers_bucket_op_on_update got un-deployed
2022/01/03 18:52:15 No eventing-con process running
2022/01/03 18:52:15 Function: TestMultipleHandlers_bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_update deleting in background"
}
2022/01/03 18:52:17 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:52:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:52:24 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:52:34 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/03 18:52:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:52:39 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2022/01/03 18:52:45 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2022/01/03 18:52:50 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2022/01/03 18:52:55 Waiting for app: TestMultipleHandlers_bucket_op_on_delete to get un-deployed
2022/01/03 18:52:55 App: TestMultipleHandlers_bucket_op_on_delete got un-deployed
2022/01/03 18:52:55 No eventing-con process running
2022/01/03 18:52:55 Function: TestMultipleHandlers_bucket_op_on_delete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMultipleHandlers_bucket_op_on_delete deleting in background"
}
2022/01/03 18:52:56 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:53:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:53:03 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:53:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMultipleHandlers (193.10s)
=== RUN   TestPauseResumeLoopDefaultSettings
2022/01/03 18:53:18 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2022/01/03 18:53:18 App: TestPauseResumeLoopDefaultSettings got un-deployed
2022/01/03 18:53:18 No eventing-con process running
2022/01/03 18:53:18 Function: TestPauseResumeLoopDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeLoopDefaultSettings not found"
}
2022/01/03 18:53:20 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:53:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:53:27 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:53:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:53:32 Deploying app: TestPauseResumeLoopDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:53:33 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopDefaultSettings stored in temp store"
}
2022/01/03 18:53:33 Starting bucket ops to source bucket
2022/01/03 18:53:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:53:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:53:51 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:53:56 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:53:56 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:53:56 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:54:01 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2022/01/03 18:54:01 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2022/01/03 18:54:01 Pausing app: bucket_op_on_update
2022/01/03 18:54:01 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 18:54:06 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2022/01/03 18:54:06 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2022/01/03 18:54:06 Resuming app: bucket_op_on_update
2022/01/03 18:54:07 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 18:54:07 Starting bucket ops to source bucket
2022/01/03 18:54:15 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 18:54:20 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 18:54:25 Waiting for dst bucket item count to get to: 10000 curr count: 7500
2022/01/03 18:54:25 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 18:54:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:54:30 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2022/01/03 18:54:30 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2022/01/03 18:54:30 Pausing app: bucket_op_on_update
2022/01/03 18:54:30 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 18:54:35 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2022/01/03 18:54:35 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2022/01/03 18:54:35 Resuming app: bucket_op_on_update
2022/01/03 18:54:37 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 18:54:37 Starting bucket ops to source bucket
2022/01/03 18:54:44 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2022/01/03 18:54:49 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2022/01/03 18:54:54 Waiting for dst bucket item count to get to: 15000 curr count: 12500
2022/01/03 18:54:54 src & dst bucket item count matched up. src bucket count: 15000 dst bucket count: 15000
2022/01/03 18:54:54 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:54:59 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2022/01/03 18:54:59 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2022/01/03 18:54:59 Pausing app: bucket_op_on_update
2022/01/03 18:55:00 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 18:55:05 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2022/01/03 18:55:05 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2022/01/03 18:55:05 Resuming app: bucket_op_on_update
2022/01/03 18:55:06 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 18:55:06 Starting bucket ops to source bucket
2022/01/03 18:55:14 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/03 18:55:19 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/03 18:55:24 Waiting for dst bucket item count to get to: 20000 curr count: 17500
2022/01/03 18:55:29 Waiting for dst bucket item count to get to: 20000 curr count: 17500
2022/01/03 18:55:29 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2022/01/03 18:55:29 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:55:34 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2022/01/03 18:55:34 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2022/01/03 18:55:34 Pausing app: bucket_op_on_update
2022/01/03 18:55:34 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 18:55:39 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2022/01/03 18:55:39 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2022/01/03 18:55:39 Resuming app: bucket_op_on_update
2022/01/03 18:55:40 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 18:55:40 Starting bucket ops to source bucket
2022/01/03 18:55:48 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/03 18:55:53 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/03 18:55:58 Waiting for dst bucket item count to get to: 25000 curr count: 20353
2022/01/03 18:56:03 Waiting for dst bucket item count to get to: 25000 curr count: 22853
2022/01/03 18:56:03 src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2022/01/03 18:56:03 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:56:08 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to deployed
2022/01/03 18:56:08 Function: TestPauseResumeLoopDefaultSettings status changed to deployed
2022/01/03 18:56:08 Pausing app: bucket_op_on_update
2022/01/03 18:56:08 Function: TestPauseResumeLoopDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 18:56:13 Waiting for function: TestPauseResumeLoopDefaultSettings status to change to paused
2022/01/03 18:56:13 Function: TestPauseResumeLoopDefaultSettings status changed to paused
2022/01/03 18:56:18 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2022/01/03 18:56:23 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2022/01/03 18:56:28 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2022/01/03 18:56:33 Waiting for app: TestPauseResumeLoopDefaultSettings to get un-deployed
2022/01/03 18:56:33 App: TestPauseResumeLoopDefaultSettings got un-deployed
2022/01/03 18:56:33 No eventing-con process running
2022/01/03 18:56:33 Function: TestPauseResumeLoopDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopDefaultSettings deleting in background"
}
2022/01/03 18:56:35 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:56:45 Waiting for dst bucket item count to get to: 0 curr count: 25000
2022/01/03 18:56:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:56:47 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:56:57 Waiting for dst bucket item count to get to: 0 curr count: 25000
2022/01/03 18:56:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeLoopDefaultSettings (228.59s)
=== RUN   TestPauseResumeLoopNonDefaultSettings
2022/01/03 18:57:07 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2022/01/03 18:57:07 App: TestPauseResumeLoopNonDefaultSettings got un-deployed
2022/01/03 18:57:07 No eventing-con process running
2022/01/03 18:57:07 Function: TestPauseResumeLoopNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeLoopNonDefaultSettings not found"
}
2022/01/03 18:57:09 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:57:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:57:15 Context: Bucket flush, response code: 200 dump: 
2022/01/03 18:57:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 18:57:20 Deploying app: TestPauseResumeLoopNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 18:57:21 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopNonDefaultSettings stored in temp store"
}
2022/01/03 18:57:21 Starting bucket ops to source bucket
2022/01/03 18:57:29 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:57:34 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:57:39 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:57:44 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:57:50 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:57:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 18:58:00 Waiting for dst bucket item count to get to: 5000 curr count: 1977
2022/01/03 18:58:05 Waiting for dst bucket item count to get to: 5000 curr count: 1977
2022/01/03 18:58:05 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 18:58:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:58:10 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2022/01/03 18:58:10 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2022/01/03 18:58:10 Pausing app: bucket_op_with_timer
2022/01/03 18:58:10 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 18:58:15 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2022/01/03 18:58:15 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2022/01/03 18:58:15 Resuming app: bucket_op_with_timer
2022/01/03 18:58:16 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 18:58:16 Starting bucket ops to source bucket
2022/01/03 18:58:24 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 18:58:29 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 18:58:34 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 18:58:39 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 18:58:44 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 18:58:49 Waiting for dst bucket item count to get to: 10000 curr count: 7636
2022/01/03 18:58:54 Waiting for dst bucket item count to get to: 10000 curr count: 7636
2022/01/03 18:58:54 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 18:58:54 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:58:59 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2022/01/03 18:58:59 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2022/01/03 18:58:59 Pausing app: bucket_op_with_timer
2022/01/03 18:58:59 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 18:59:04 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2022/01/03 18:59:04 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2022/01/03 18:59:04 Resuming app: bucket_op_with_timer
2022/01/03 18:59:05 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 18:59:05 Starting bucket ops to source bucket
2022/01/03 18:59:13 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2022/01/03 18:59:18 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2022/01/03 18:59:23 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2022/01/03 18:59:28 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2022/01/03 18:59:33 Waiting for dst bucket item count to get to: 15000 curr count: 10000
2022/01/03 18:59:38 Waiting for dst bucket item count to get to: 15000 curr count: 13410
2022/01/03 18:59:38 src & dst bucket item count matched up. src bucket count: 15000 dst bucket count: 15000
2022/01/03 18:59:38 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 18:59:43 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2022/01/03 18:59:43 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2022/01/03 18:59:43 Pausing app: bucket_op_with_timer
2022/01/03 18:59:43 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 18:59:48 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2022/01/03 18:59:48 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2022/01/03 18:59:48 Resuming app: bucket_op_with_timer
2022/01/03 18:59:50 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 18:59:50 Starting bucket ops to source bucket
2022/01/03 18:59:57 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/03 19:00:02 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/03 19:00:07 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/03 19:00:12 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/03 19:00:17 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/03 19:00:22 Waiting for dst bucket item count to get to: 20000 curr count: 15000
2022/01/03 19:00:27 Waiting for dst bucket item count to get to: 20000 curr count: 17450
2022/01/03 19:00:32 Waiting for dst bucket item count to get to: 20000 curr count: 19950
2022/01/03 19:00:32 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2022/01/03 19:00:33 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:00:38 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2022/01/03 19:00:38 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2022/01/03 19:00:38 Pausing app: bucket_op_with_timer
2022/01/03 19:00:38 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 19:00:43 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2022/01/03 19:00:43 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2022/01/03 19:00:43 Resuming app: bucket_op_with_timer
2022/01/03 19:00:44 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 19:00:44 Starting bucket ops to source bucket
2022/01/03 19:00:52 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/03 19:00:57 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/03 19:01:02 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/03 19:01:07 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/03 19:01:12 Waiting for dst bucket item count to get to: 25000 curr count: 20000
2022/01/03 19:01:17 Waiting for dst bucket item count to get to: 25000 curr count: 22500
2022/01/03 19:01:17 src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2022/01/03 19:01:17 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:01:22 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to deployed
2022/01/03 19:01:22 Function: TestPauseResumeLoopNonDefaultSettings status changed to deployed
2022/01/03 19:01:22 Pausing app: bucket_op_with_timer
2022/01/03 19:01:22 Function: TestPauseResumeLoopNonDefaultSettings update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:4 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:77 timer_context_size:15728640 user_prefix:eventing worker_count:4] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 19:01:27 Waiting for function: TestPauseResumeLoopNonDefaultSettings status to change to paused
2022/01/03 19:01:27 Function: TestPauseResumeLoopNonDefaultSettings status changed to paused
2022/01/03 19:01:32 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2022/01/03 19:01:37 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2022/01/03 19:01:42 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2022/01/03 19:01:47 Waiting for app: TestPauseResumeLoopNonDefaultSettings to get un-deployed
2022/01/03 19:01:47 App: TestPauseResumeLoopNonDefaultSettings got un-deployed
2022/01/03 19:01:47 No eventing-con process running
2022/01/03 19:01:47 Function: TestPauseResumeLoopNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeLoopNonDefaultSettings deleting in background"
}
2022/01/03 19:01:49 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:01:59 Waiting for dst bucket item count to get to: 0 curr count: 25000
2022/01/03 19:02:04 Waiting for dst bucket item count to get to: 0 curr count: 12500
2022/01/03 19:02:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:02:06 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:02:16 Waiting for dst bucket item count to get to: 0 curr count: 25000
2022/01/03 19:02:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeLoopNonDefaultSettings (318.97s)
=== RUN   TestPauseAndResumeWithWorkerCountChange
2022/01/03 19:02:26 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2022/01/03 19:02:26 App: TestPauseAndResumeWithWorkerCountChange got un-deployed
2022/01/03 19:02:26 No eventing-con process running
2022/01/03 19:02:26 Function: TestPauseAndResumeWithWorkerCountChange delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseAndResumeWithWorkerCountChange not found"
}
2022/01/03 19:02:28 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:02:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:02:34 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:02:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:02:39 Deploying app: TestPauseAndResumeWithWorkerCountChange. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:02:41 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseAndResumeWithWorkerCountChange stored in temp store"
}
2022/01/03 19:02:46 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2022/01/03 19:02:51 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2022/01/03 19:02:56 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get deployed
2022/01/03 19:02:56 App: TestPauseAndResumeWithWorkerCountChange got deployed
2022/01/03 19:02:56 Starting bucket ops to source bucket
2022/01/03 19:03:05 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:03:10 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:03:15 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:03:20 Waiting for dst bucket item count to get to: 5000 curr count: 2846
2022/01/03 19:03:25 Waiting for dst bucket item count to get to: 5000 curr count: 2846
2022/01/03 19:03:25 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 19:03:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:03:25 Pausing app: bucket_op_with_timer
2022/01/03 19:03:25 Function: TestPauseAndResumeWithWorkerCountChange update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 19:03:30 Waiting for function: TestPauseAndResumeWithWorkerCountChange status to change to paused
2022/01/03 19:03:30 Function: TestPauseAndResumeWithWorkerCountChange status changed to paused
2022/01/03 19:03:30 Resuming app: bucket_op_with_timer
2022/01/03 19:03:31 Function: TestPauseAndResumeWithWorkerCountChange update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:6] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 19:03:31 Starting bucket ops to source bucket
2022/01/03 19:03:42 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 19:03:47 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 19:03:52 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 19:03:57 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 19:04:02 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 19:04:03 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 19:04:08 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2022/01/03 19:04:13 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2022/01/03 19:04:18 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2022/01/03 19:04:23 Waiting for app: TestPauseAndResumeWithWorkerCountChange to get un-deployed
2022/01/03 19:04:23 App: TestPauseAndResumeWithWorkerCountChange got un-deployed
2022/01/03 19:04:23 No eventing-con process running
2022/01/03 19:04:23 Function: TestPauseAndResumeWithWorkerCountChange delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseAndResumeWithWorkerCountChange deleting in background"
}
2022/01/03 19:04:25 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:04:35 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/03 19:04:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:04:36 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:04:46 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/03 19:04:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseAndResumeWithWorkerCountChange (150.51s)
=== RUN   TestPauseResumeWithEventingReb
2022/01/03 19:04:56 Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2022/01/03 19:04:56 App: TestPauseResumeWithEventingReb got un-deployed
2022/01/03 19:04:56 No eventing-con process running
2022/01/03 19:04:56 Function: TestPauseResumeWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestPauseResumeWithEventingReb not found"
}
2022/01/03 19:04:58 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:05:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:05:05 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:05:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:05:10 Deploying app: TestPauseResumeWithEventingReb. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:05:11 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeWithEventingReb stored in temp store"
}
2022/01/03 19:05:16 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2022/01/03 19:05:21 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2022/01/03 19:05:26 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2022/01/03 19:05:31 Waiting for app: TestPauseResumeWithEventingReb to get deployed
2022/01/03 19:05:31 App: TestPauseResumeWithEventingReb got deployed
2022/01/03 19:05:31 Starting bucket ops to source bucket
2022/01/03 19:05:40 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:05:45 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:05:50 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:05:55 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:06:00 Waiting for dst bucket item count to get to: 5000 curr count: 4120
2022/01/03 19:06:05 Waiting for dst bucket item count to get to: 5000 curr count: 4120
2022/01/03 19:06:05 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 19:06:05 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:06:05 Pausing app: bucket_op_with_timer
2022/01/03 19:06:05 Function: TestPauseResumeWithEventingReb update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 19:06:10 Waiting for function: TestPauseResumeWithEventingReb status to change to paused
2022/01/03 19:06:10 Function: TestPauseResumeWithEventingReb status changed to paused
2022/01/03 19:06:10 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 19:06:11 Removing node(s): [] from the cluster
2022/01/03 19:06:16 Rebalance progress: 29.16666666666666
2022/01/03 19:06:21 Rebalance progress: 29.16666666666666
2022/01/03 19:06:26 Rebalance progress: 100
2022/01/03 19:06:26 Resuming app: bucket_op_with_timer
2022/01/03 19:06:27 Function: TestPauseResumeWithEventingReb update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:true sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:6] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 19:06:27 Starting bucket ops to source bucket
2022/01/03 19:06:38 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 19:06:43 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 19:06:48 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 19:06:53 Waiting for dst bucket item count to get to: 10000 curr count: 5000
2022/01/03 19:06:58 Waiting for dst bucket item count to get to: 10000 curr count: 5710
2022/01/03 19:07:03 Waiting for dst bucket item count to get to: 10000 curr count: 5710
2022/01/03 19:07:03 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 19:07:03 Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/03 19:07:08 Rebalance progress: 29.16666666666666
2022/01/03 19:07:13 Rebalance progress: 29.16666666666666
2022/01/03 19:07:18 Rebalance progress: 100

VB distribution across eventing nodes and their workers::

2022/01/03 19:07:23 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:83} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 19:07:38 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:83} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 19:07:53 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:83} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 19:08:08 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:83} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 19:08:23 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:83} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 19:08:38 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:83} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 19:08:53 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:83} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 19:09:08 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:83} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 19:09:23 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:83} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 19:09:38 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:83} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 19:09:53 waitForIndexes waiting for indexes: [{Name:#primary Bucket:default Completion:100} {Name:#primary Bucket:eventing Completion:83} {Name:#primary Bucket:hello-world Completion:100}]

DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: 6162b9dc39ccbbcf730139521696aea6
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [228-284]
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 57
	v: [285-341]
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [0-56]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [57-113]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [114-170]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [171-227]
Producer node: 172.31.2.134:9300	Node UUID: d9f81b306a62aeccbc06d13d30aa00aa
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 56
	v: [968-1023]
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [683-739]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [740-796]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [797-853]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [854-910]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [911-967]
Producer node: 127.0.0.1:9303	Node UUID: c08f27935334a8a4084e04bb8c567ea3
	workerID: worker_TestPauseResumeWithEventingReb_0
	len: 57
	v: [342-398]
	workerID: worker_TestPauseResumeWithEventingReb_1
	len: 57
	v: [399-455]
	workerID: worker_TestPauseResumeWithEventingReb_2
	len: 57
	v: [456-512]
	workerID: worker_TestPauseResumeWithEventingReb_3
	len: 57
	v: [513-569]
	workerID: worker_TestPauseResumeWithEventingReb_4
	len: 57
	v: [570-626]
	workerID: worker_TestPauseResumeWithEventingReb_5
	len: 56
	v: [627-682]


2022/01/03 19:10:09 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:10:14 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2022/01/03 19:10:19 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2022/01/03 19:10:24 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2022/01/03 19:10:29 clusterSetup.go:397: Waiting for app: TestPauseResumeWithEventingReb to get un-deployed
2022/01/03 19:10:29 clusterSetup.go:405: App: TestPauseResumeWithEventingReb got un-deployed
2022/01/03 19:10:29 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:10:29 eventingSetup.go:418: Function: TestPauseResumeWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestPauseResumeWithEventingReb deleting in background"
}
2022/01/03 19:10:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:10:41 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8349
2022/01/03 19:10:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8349
2022/01/03 19:10:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:10:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:10:57 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 19:10:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestPauseResumeWithEventingReb (371.10s)
=== RUN   TestBucketDeleteAfterPause
2022/01/03 19:11:07 clusterSetup.go:397: Waiting for app: TestBucketDeleteAfterPause to get un-deployed
2022/01/03 19:11:07 clusterSetup.go:405: App: TestBucketDeleteAfterPause got un-deployed
2022/01/03 19:11:07 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:11:07 eventingSetup.go:418: Function: TestBucketDeleteAfterPause delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketDeleteAfterPause not found"
}
2022/01/03 19:11:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:11:14 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:11:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:11:21 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:11:21 eventingSetup.go:125: Deploying app: TestBucketDeleteAfterPause. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:11:22 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteAfterPause stored in temp store"
}
2022/01/03 19:11:27 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2022/01/03 19:11:32 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2022/01/03 19:11:37 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2022/01/03 19:11:42 clusterSetup.go:346: Waiting for app: TestBucketDeleteAfterPause to get deployed
2022/01/03 19:11:42 clusterSetup.go:354: App: TestBucketDeleteAfterPause got deployed
2022/01/03 19:11:42 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 19:11:52 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:11:52 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 19:11:52 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:11:52 handler_test.go:712: Pausing app: bucket_op_on_update
2022/01/03 19:11:52 eventingSetup.go:270: Function: TestBucketDeleteAfterPause update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 19:11:57 eventingSetup.go:719: Waiting for function: TestBucketDeleteAfterPause status to change to paused
2022/01/03 19:11:57 eventingSetup.go:727: Function: TestBucketDeleteAfterPause status changed to paused
2022/01/03 19:11:57 handler_test.go:716: Deleting source bucket: default
2022/01/03 19:12:03 eventingSetup.go:719: Waiting for function: TestBucketDeleteAfterPause status to change to undeployed
2022/01/03 19:12:03 eventingSetup.go:727: Function: TestBucketDeleteAfterPause status changed to undeployed
2022/01/03 19:12:08 clusterSetup.go:397: Waiting for app: TestBucketDeleteAfterPause to get un-deployed
2022/01/03 19:12:08 clusterSetup.go:405: App: TestBucketDeleteAfterPause got un-deployed
2022/01/03 19:12:08 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:12:09 eventingSetup.go:418: Function: TestBucketDeleteAfterPause delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteAfterPause deleting in background"
}
2022/01/03 19:12:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:12:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:12:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:12:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 19:12:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBucketDeleteAfterPause (89.18s)
=== RUN   TestChangeFnCodeBetweenPauseResume
2022/01/03 19:12:37 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2022/01/03 19:12:37 clusterSetup.go:405: App: TestChangeFnCodeBetweenPauseResume got un-deployed
2022/01/03 19:12:37 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:12:37 eventingSetup.go:418: Function: TestChangeFnCodeBetweenPauseResume delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestChangeFnCodeBetweenPauseResume not found"
}
2022/01/03 19:12:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:12:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:12:45 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:12:50 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:12:50 eventingSetup.go:125: Deploying app: TestChangeFnCodeBetweenPauseResume. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:12:51 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume stored in temp store"
}
2022/01/03 19:12:56 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2022/01/03 19:13:01 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2022/01/03 19:13:06 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2022/01/03 19:13:11 clusterSetup.go:346: Waiting for app: TestChangeFnCodeBetweenPauseResume to get deployed
2022/01/03 19:13:11 clusterSetup.go:354: App: TestChangeFnCodeBetweenPauseResume got deployed
2022/01/03 19:13:11 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 19:13:46 handler_test.go:739: Pausing function: TestChangeFnCodeBetweenPauseResume
2022/01/03 19:13:46 eventingSetup.go:270: Function: TestChangeFnCodeBetweenPauseResume update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:true description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 19:13:51 eventingSetup.go:719: Waiting for function: TestChangeFnCodeBetweenPauseResume status to change to paused
2022/01/03 19:13:51 eventingSetup.go:727: Function: TestChangeFnCodeBetweenPauseResume status changed to paused
2022/01/03 19:16:51 handler_test.go:748: Resuming function: TestChangeFnCodeBetweenPauseResume
2022/01/03 19:16:51 eventingSetup.go:125: Deploying app: TestChangeFnCodeBetweenPauseResume. Item count src bucket: 5000 dst bucket: 0
2022/01/03 19:16:52 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume stored in temp store"
}
2022/01/03 19:16:57 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2022/01/03 19:16:57 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:16:57 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 0 expected 5000
2022/01/03 19:17:02 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2022/01/03 19:17:02 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:17:02 eventingSetup.go:799: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 3289 expected 5000
2022/01/03 19:17:07 eventingSetup.go:795: Waiting for function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter to get to 5000
2022/01/03 19:17:07 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:17:07 eventingSetup.go:804: Function: TestChangeFnCodeBetweenPauseResume stat: timer_callback_missing_counter got to 5000
2022/01/03 19:17:07 handler_test.go:753: Undeploying function: TestChangeFnCodeBetweenPauseResume
2022/01/03 19:17:07 eventingSetup.go:270: Function: TestChangeFnCodeBetweenPauseResume update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 19:17:17 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2022/01/03 19:17:22 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2022/01/03 19:17:27 clusterSetup.go:397: Waiting for app: TestChangeFnCodeBetweenPauseResume to get un-deployed
2022/01/03 19:17:27 clusterSetup.go:405: App: TestChangeFnCodeBetweenPauseResume got un-deployed
2022/01/03 19:17:27 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:17:27 eventingSetup.go:418: Function: TestChangeFnCodeBetweenPauseResume delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestChangeFnCodeBetweenPauseResume deleting in background"
}
2022/01/03 19:17:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:17:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 19:17:44 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/03 19:17:44 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:17:45 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:17:50 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestChangeFnCodeBetweenPauseResume (323.90s)
=== RUN   TestCommentUnCommentOnDelete
2022/01/03 19:18:00 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2022/01/03 19:18:01 clusterSetup.go:405: App: TestCommentUnCommentOnDelete got un-deployed
2022/01/03 19:18:01 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:18:01 eventingSetup.go:418: Function: TestCommentUnCommentOnDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCommentUnCommentOnDelete not found"
}
2022/01/03 19:18:02 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:18:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:18:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:18:14 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:18:14 eventingSetup.go:125: Deploying app: TestCommentUnCommentOnDelete. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:18:15 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete stored in temp store"
}
2022/01/03 19:18:20 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/03 19:18:25 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/03 19:18:30 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/03 19:18:35 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/03 19:18:35 clusterSetup.go:354: App: TestCommentUnCommentOnDelete got deployed
2022/01/03 19:18:35 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 19:18:44 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:18:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 1490
2022/01/03 19:18:54 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 3990
2022/01/03 19:18:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 19:18:54 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:18:54 handler_test.go:780: Undeploying app: TestCommentUnCommentOnDelete
2022/01/03 19:18:54 eventingSetup.go:270: Function: TestCommentUnCommentOnDelete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 19:19:24 eventingSetup.go:125: Deploying app: TestCommentUnCommentOnDelete. Item count src bucket: 5000 dst bucket: 5000
2022/01/03 19:19:25 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete stored in temp store"
}
2022/01/03 19:19:30 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/03 19:19:35 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/03 19:19:40 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/03 19:19:45 clusterSetup.go:346: Waiting for app: TestCommentUnCommentOnDelete to get deployed
2022/01/03 19:19:45 clusterSetup.go:354: App: TestCommentUnCommentOnDelete got deployed
2022/01/03 19:19:45 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 19:19:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4863
2022/01/03 19:20:03 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4863
2022/01/03 19:20:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:20:03 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:20:03 handler_test.go:799: Undeploying app: TestCommentUnCommentOnDelete
2022/01/03 19:20:03 eventingSetup.go:270: Function: TestCommentUnCommentOnDelete update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 19:20:13 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2022/01/03 19:20:18 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2022/01/03 19:20:23 clusterSetup.go:397: Waiting for app: TestCommentUnCommentOnDelete to get un-deployed
2022/01/03 19:20:23 clusterSetup.go:405: App: TestCommentUnCommentOnDelete got un-deployed
2022/01/03 19:20:23 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:20:23 eventingSetup.go:418: Function: TestCommentUnCommentOnDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCommentUnCommentOnDelete deleting in background"
}
2022/01/03 19:20:24 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:20:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:20:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:20:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCommentUnCommentOnDelete (165.49s)
=== RUN   TestCPPWorkerCleanup
2022/01/03 19:20:46 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2022/01/03 19:20:46 clusterSetup.go:405: App: TestCPPWorkerCleanup got un-deployed
2022/01/03 19:20:46 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:20:46 eventingSetup.go:418: Function: TestCPPWorkerCleanup delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCPPWorkerCleanup not found"
}
2022/01/03 19:20:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:20:52 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:20:54 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:20:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:20:59 eventingSetup.go:125: Deploying app: TestCPPWorkerCleanup. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:21:00 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCPPWorkerCleanup stored in temp store"
}
2022/01/03 19:21:00 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 19:21:07 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:21:12 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:21:17 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:21:22 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:21:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 4785
2022/01/03 19:21:32 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 4785
2022/01/03 19:21:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 19:21:32 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:21:37 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2022/01/03 19:21:43 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2022/01/03 19:21:48 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2022/01/03 19:21:53 clusterSetup.go:397: Waiting for app: TestCPPWorkerCleanup to get un-deployed
2022/01/03 19:21:53 clusterSetup.go:405: App: TestCPPWorkerCleanup got un-deployed
2022/01/03 19:21:53 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:21:53 eventingSetup.go:418: Function: TestCPPWorkerCleanup delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCPPWorkerCleanup deleting in background"
}
2022/01/03 19:21:54 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:22:04 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 19:22:09 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/03 19:22:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:22:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:22:21 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4621
2022/01/03 19:22:26 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4621
2022/01/03 19:22:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCPPWorkerCleanup (139.82s)
=== RUN   TestWithUserXattrs
2022/01/03 19:23:06 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2022/01/03 19:23:06 clusterSetup.go:405: App: TestWithUserXattrs got un-deployed
2022/01/03 19:23:06 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:23:06 eventingSetup.go:418: Function: TestWithUserXattrs delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestWithUserXattrs not found"
}
2022/01/03 19:23:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:23:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:23:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:23:19 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:23:19 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 19:23:21 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 19:23:23 eventingSetup.go:125: Deploying app: TestWithUserXattrs. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:23:24 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestWithUserXattrs stored in temp store"
}
2022/01/03 19:23:29 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2022/01/03 19:23:34 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2022/01/03 19:23:39 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2022/01/03 19:23:44 clusterSetup.go:346: Waiting for app: TestWithUserXattrs to get deployed
2022/01/03 19:23:44 clusterSetup.go:354: App: TestWithUserXattrs got deployed
2022/01/03 19:23:44 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 19:23:53 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:23:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 4277
2022/01/03 19:24:03 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 4277
2022/01/03 19:24:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 19:24:03 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:24:09 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2022/01/03 19:24:14 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2022/01/03 19:24:19 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2022/01/03 19:24:24 clusterSetup.go:397: Waiting for app: TestWithUserXattrs to get un-deployed
2022/01/03 19:24:24 clusterSetup.go:405: App: TestWithUserXattrs got un-deployed
2022/01/03 19:24:24 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:24:24 eventingSetup.go:418: Function: TestWithUserXattrs delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestWithUserXattrs deleting in background"
}
2022/01/03 19:24:25 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:24:35 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 19:24:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:24:37 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:24:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 19:24:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestWithUserXattrs (110.91s)
=== RUN   TestEventProcessingPostBucketFlush
2022/01/03 19:24:57 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2022/01/03 19:24:57 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2022/01/03 19:24:57 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:24:57 eventingSetup.go:418: Function: TestEventProcessingPostBucketFlush delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventProcessingPostBucketFlush not found"
}
2022/01/03 19:24:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:25:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:25:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:25:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:25:10 eventingSetup.go:125: Deploying app: TestEventProcessingPostBucketFlush. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:25:11 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventProcessingPostBucketFlush stored in temp store"
}
2022/01/03 19:25:16 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2022/01/03 19:25:21 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2022/01/03 19:25:26 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2022/01/03 19:25:31 clusterSetup.go:346: Waiting for app: TestEventProcessingPostBucketFlush to get deployed
2022/01/03 19:25:31 clusterSetup.go:354: App: TestEventProcessingPostBucketFlush got deployed
2022/01/03 19:25:31 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 19:25:40 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:25:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:25:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 19:25:45 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:25:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:25:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3288
2022/01/03 19:26:04 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 788
2022/01/03 19:26:04 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:26:06 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:26:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 19:26:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:26:16 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 19:26:41 eventingSetup.go:441: Waiting for dst bucket item count to get to: 25000 curr count: 14881
2022/01/03 19:26:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 25000 curr count: 14881
2022/01/03 19:26:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 25000 dst bucket count: 25000
2022/01/03 19:26:46 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:26:46 eventingSetup.go:270: Function: TestEventProcessingPostBucketFlush update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 19:26:51 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2022/01/03 19:26:56 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2022/01/03 19:27:01 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2022/01/03 19:27:06 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2022/01/03 19:27:06 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2022/01/03 19:27:06 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:27:11 clusterSetup.go:397: Waiting for app: TestEventProcessingPostBucketFlush to get un-deployed
2022/01/03 19:27:11 clusterSetup.go:405: App: TestEventProcessingPostBucketFlush got un-deployed
2022/01/03 19:27:11 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:27:11 eventingSetup.go:418: Function: TestEventProcessingPostBucketFlush delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventProcessingPostBucketFlush deleting in background"
}
2022/01/03 19:27:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:27:23 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 25000
2022/01/03 19:27:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12500
2022/01/03 19:27:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:27:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:27:40 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12500
2022/01/03 19:27:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12500
2022/01/03 19:27:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventProcessingPostBucketFlush (177.81s)
=== RUN   TestMetaBucketDelete
2022/01/03 19:27:55 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2022/01/03 19:27:55 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2022/01/03 19:27:55 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:27:55 eventingSetup.go:418: Function: TestMetaBucketDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaBucketDelete not found"
}
2022/01/03 19:27:56 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:28:01 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:28:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:28:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:28:08 eventingSetup.go:125: Deploying app: TestMetaBucketDelete. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:28:09 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDelete stored in temp store"
}
2022/01/03 19:28:14 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2022/01/03 19:28:19 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2022/01/03 19:28:24 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2022/01/03 19:28:29 clusterSetup.go:346: Waiting for app: TestMetaBucketDelete to get deployed
2022/01/03 19:28:29 clusterSetup.go:354: App: TestMetaBucketDelete got deployed
2022/01/03 19:28:29 handler_test.go:902: Deleting metadata bucket: eventing
2022/01/03 19:28:30 handler_test.go:904: Deleted metadata bucket: eventing
2022/01/03 19:28:35 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2022/01/03 19:28:35 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2022/01/03 19:28:50 clusterSetup.go:397: Waiting for app: TestMetaBucketDelete to get un-deployed
2022/01/03 19:28:50 clusterSetup.go:405: App: TestMetaBucketDelete got un-deployed
2022/01/03 19:28:50 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:28:50 eventingSetup.go:418: Function: TestMetaBucketDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDelete deleting in background"
}
2022/01/03 19:28:52 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:28:57 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:28:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:29:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaBucketDelete (78.88s)
=== RUN   TestMetaBucketDeleteWithBootstrap
2022/01/03 19:29:13 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2022/01/03 19:29:13 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2022/01/03 19:29:13 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:29:13 eventingSetup.go:418: Function: TestMetaBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaBucketDeleteWithBootstrap not found"
}
2022/01/03 19:29:15 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:29:20 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:29:21 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:29:26 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:29:26 eventingSetup.go:125: Deploying app: TestMetaBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:29:28 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDeleteWithBootstrap stored in temp store"
}
2022/01/03 19:29:46 handler_test.go:923: Deleting metadata bucket: eventing
2022/01/03 19:29:47 handler_test.go:925: Deleted metadata bucket: eventing
2022/01/03 19:30:02 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2022/01/03 19:30:02 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2022/01/03 19:30:17 clusterSetup.go:397: Waiting for app: TestMetaBucketDeleteWithBootstrap to get un-deployed
2022/01/03 19:30:17 clusterSetup.go:405: App: TestMetaBucketDeleteWithBootstrap got un-deployed
2022/01/03 19:30:17 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:30:17 eventingSetup.go:418: Function: TestMetaBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaBucketDeleteWithBootstrap deleting in background"
}
2022/01/03 19:30:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:30:23 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:30:25 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:30:30 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaBucketDeleteWithBootstrap (86.76s)
=== RUN   TestSourceBucketDelete
2022/01/03 19:30:40 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2022/01/03 19:30:40 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2022/01/03 19:30:40 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:30:40 eventingSetup.go:418: Function: TestSourceBucketDelete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceBucketDelete not found"
}
2022/01/03 19:30:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:30:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:30:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:30:53 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:30:53 eventingSetup.go:125: Deploying app: TestSourceBucketDelete. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:30:54 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDelete stored in temp store"
}
2022/01/03 19:30:59 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2022/01/03 19:31:04 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2022/01/03 19:31:09 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2022/01/03 19:31:14 clusterSetup.go:346: Waiting for app: TestSourceBucketDelete to get deployed
2022/01/03 19:31:14 clusterSetup.go:354: App: TestSourceBucketDelete got deployed
2022/01/03 19:31:14 handler_test.go:945: Deleting source bucket: default
2022/01/03 19:31:16 handler_test.go:947: Deleted source bucket: default
2022/01/03 19:31:21 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2022/01/03 19:31:21 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2022/01/03 19:31:36 clusterSetup.go:397: Waiting for app: TestSourceBucketDelete to get un-deployed
2022/01/03 19:31:36 clusterSetup.go:405: App: TestSourceBucketDelete got un-deployed
2022/01/03 19:31:36 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:31:36 eventingSetup.go:418: Function: TestSourceBucketDelete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDelete deleting in background"
}
2022/01/03 19:31:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:31:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:31:44 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:31:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceBucketDelete (79.11s)
=== RUN   TestSourceBucketDeleteWithBootstrap
2022/01/03 19:31:59 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2022/01/03 19:31:59 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2022/01/03 19:31:59 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:31:59 eventingSetup.go:418: Function: TestSourceBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceBucketDeleteWithBootstrap not found"
}
2022/01/03 19:32:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:32:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:32:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:32:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:32:12 eventingSetup.go:125: Deploying app: TestSourceBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:32:14 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDeleteWithBootstrap stored in temp store"
}
2022/01/03 19:32:32 handler_test.go:966: Deleting source bucket: default
2022/01/03 19:32:34 handler_test.go:968: Deleted source bucket: default
2022/01/03 19:32:49 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2022/01/03 19:32:49 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2022/01/03 19:33:04 clusterSetup.go:397: Waiting for app: TestSourceBucketDeleteWithBootstrap to get un-deployed
2022/01/03 19:33:04 clusterSetup.go:405: App: TestSourceBucketDeleteWithBootstrap got un-deployed
2022/01/03 19:33:04 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:33:04 eventingSetup.go:418: Function: TestSourceBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceBucketDeleteWithBootstrap deleting in background"
}
2022/01/03 19:33:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:33:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:33:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:33:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceBucketDeleteWithBootstrap (87.63s)
=== RUN   TestSourceAndMetaBucketDeleteWithBootstrap
2022/01/03 19:33:27 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2022/01/03 19:33:27 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2022/01/03 19:33:27 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:33:27 eventingSetup.go:418: Function: TestSourceAndMetaBucketDeleteWithBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestSourceAndMetaBucketDeleteWithBootstrap not found"
}
2022/01/03 19:33:28 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:33:33 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:33:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:33:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:33:40 eventingSetup.go:125: Deploying app: TestSourceAndMetaBucketDeleteWithBootstrap. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:33:41 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceAndMetaBucketDeleteWithBootstrap stored in temp store"
}
2022/01/03 19:34:00 handler_test.go:988: Deleting source bucket: default
2022/01/03 19:34:01 handler_test.go:990: Deleted source bucket: default
2022/01/03 19:34:01 handler_test.go:992: Deleting metadata bucket: eventing
2022/01/03 19:34:02 handler_test.go:994: Deleted metadata bucket: eventing
2022/01/03 19:34:17 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2022/01/03 19:34:17 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2022/01/03 19:34:32 clusterSetup.go:397: Waiting for app: TestSourceAndMetaBucketDeleteWithBootstrap to get un-deployed
2022/01/03 19:34:32 clusterSetup.go:405: App: TestSourceAndMetaBucketDeleteWithBootstrap got un-deployed
2022/01/03 19:34:32 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:34:32 eventingSetup.go:418: Function: TestSourceAndMetaBucketDeleteWithBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestSourceAndMetaBucketDeleteWithBootstrap deleting in background"
}
2022/01/03 19:34:33 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:34:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:34:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:34:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestSourceAndMetaBucketDeleteWithBootstrap (88.32s)
=== RUN   TestUndeployDuringBootstrap
2022/01/03 19:34:55 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2022/01/03 19:34:55 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2022/01/03 19:34:55 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:34:55 eventingSetup.go:418: Function: TestUndeployDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployDuringBootstrap not found"
}
2022/01/03 19:34:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:35:02 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:35:03 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:35:08 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:35:08 eventingSetup.go:125: Deploying app: TestUndeployDuringBootstrap. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:35:09 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployDuringBootstrap stored in temp store"
}
2022/01/03 19:35:09 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 19:35:21 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:35:21 clusterSetup.go:375: Apps undergoing bootstrap: true
2022/01/03 19:35:21 clusterSetup.go:378: App: TestUndeployDuringBootstrap started bootstrap
2022/01/03 19:35:21 clusterSetup.go:375: Apps undergoing bootstrap: true
2022/01/03 19:35:26 clusterSetup.go:375: Apps undergoing bootstrap: true
2022/01/03 19:35:31 clusterSetup.go:367: No apps undergoing bootstrap
2022/01/03 19:35:36 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2022/01/03 19:35:41 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2022/01/03 19:35:47 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2022/01/03 19:35:47 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2022/01/03 19:35:47 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:36:12 clusterSetup.go:397: Waiting for app: TestUndeployDuringBootstrap to get un-deployed
2022/01/03 19:36:12 clusterSetup.go:405: App: TestUndeployDuringBootstrap got un-deployed
2022/01/03 19:36:12 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:36:12 eventingSetup.go:418: Function: TestUndeployDuringBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployDuringBootstrap deleting in background"
}
2022/01/03 19:36:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:36:23 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 19:36:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/03 19:36:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:36:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:36:40 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1529
2022/01/03 19:36:45 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1529
2022/01/03 19:36:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployDuringBootstrap (119.32s)
=== RUN   TestDeleteBeforeUndeploy
2022/01/03 19:36:50 eventingSetup.go:125: Deploying app: TestDeleteBeforeUndeploy. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:36:51 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeleteBeforeUndeploy stored in temp store"
}
2022/01/03 19:36:56 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2022/01/03 19:37:01 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2022/01/03 19:37:06 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2022/01/03 19:37:11 clusterSetup.go:346: Waiting for app: TestDeleteBeforeUndeploy to get deployed
2022/01/03 19:37:11 clusterSetup.go:354: App: TestDeleteBeforeUndeploy got deployed
2022/01/03 19:37:11 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 422 dump: {
 "name": "ERR_APP_NOT_UNDEPLOYED",
 "code": 22,
 "description": "Function: TestDeleteBeforeUndeploy skipping delete request as it hasn't been undeployed"
}
2022/01/03 19:37:11 eventingSetup.go:270: Function: TestDeleteBeforeUndeploy update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 19:37:11 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDeleteBeforeUndeploy deleting in background"
}
2022/01/03 19:37:16 clusterSetup.go:397: Waiting for app: TestDeleteBeforeUndeploy to get un-deployed
2022/01/03 19:37:16 clusterSetup.go:405: App: TestDeleteBeforeUndeploy got un-deployed
2022/01/03 19:37:16 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:37:16 eventingSetup.go:418: Function: TestDeleteBeforeUndeploy delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDeleteBeforeUndeploy not found"
}
2022/01/03 19:37:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:37:22 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:37:24 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:37:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDeleteBeforeUndeploy (44.64s)
=== RUN   TestUndeployWhenTimersAreFired
2022/01/03 19:37:39 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2022/01/03 19:37:39 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2022/01/03 19:37:39 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:37:39 eventingSetup.go:418: Function: TestUndeployWhenTimersAreFired delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployWhenTimersAreFired not found"
}
2022/01/03 19:37:40 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:37:45 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:37:47 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:37:52 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:37:52 eventingSetup.go:125: Deploying app: TestUndeployWhenTimersAreFired. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:37:54 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWhenTimersAreFired stored in temp store"
}
2022/01/03 19:37:59 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2022/01/03 19:38:04 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2022/01/03 19:38:09 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2022/01/03 19:38:14 clusterSetup.go:346: Waiting for app: TestUndeployWhenTimersAreFired to get deployed
2022/01/03 19:38:14 clusterSetup.go:354: App: TestUndeployWhenTimersAreFired got deployed
2022/01/03 19:38:14 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 19:38:49 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2022/01/03 19:38:54 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2022/01/03 19:38:59 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2022/01/03 19:39:04 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2022/01/03 19:39:04 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2022/01/03 19:39:04 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:40:49 clusterSetup.go:397: Waiting for app: TestUndeployWhenTimersAreFired to get un-deployed
2022/01/03 19:40:49 clusterSetup.go:405: App: TestUndeployWhenTimersAreFired got un-deployed
2022/01/03 19:40:49 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:40:49 eventingSetup.go:418: Function: TestUndeployWhenTimersAreFired delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWhenTimersAreFired deleting in background"
}
2022/01/03 19:40:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:41:00 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4882
2022/01/03 19:41:05 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4882
2022/01/03 19:41:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:41:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:41:17 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 19:41:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployWhenTimersAreFired (228.03s)
=== RUN   TestUndeployWithKVFailover
2022/01/03 19:41:27 clusterSetup.go:397: Waiting for app: TestUndeployWithKVFailover to get un-deployed
2022/01/03 19:41:27 clusterSetup.go:405: App: TestUndeployWithKVFailover got un-deployed
2022/01/03 19:41:27 eventingSetup.go:46: No eventing-con process running
2022/01/03 19:41:27 eventingSetup.go:418: Function: TestUndeployWithKVFailover delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployWithKVFailover not found"
}
2022/01/03 19:41:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:41:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:41:35 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:41:40 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:41:40 eventingSetup.go:125: Deploying app: TestUndeployWithKVFailover. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:41:42 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWithKVFailover stored in temp store"
}
2022/01/03 19:41:42 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 19:41:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:41:54 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:41:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:42:04 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:42:09 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:42:14 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:42:19 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 1366
2022/01/03 19:42:24 eventingSetup.go:441: Waiting for dst bucket item count to get to: 5000 curr count: 1366
2022/01/03 19:42:24 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 19:42:24 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2022/01/03 19:42:24 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 19:42:29 Rebalance progress: 29.16666666666666
2022/01/03 19:42:34 Rebalance progress: 29.16666666666666
2022/01/03 19:42:39 Rebalance progress: 100
2022/01/03 19:42:39 Failing over: [127.0.0.1:19003]
2022/01/03 19:42:49 Function: TestUndeployWithKVFailover update settings: map[bucket_cache_age:1000 bucket_cache_size:67108864 cpp_worker_thread_count:1 dcp_stream_boundary:everything deployment_status:false description:Sample app execution_timeout:5 language_compatibility:6.5.0 lcb_inst_capacity:5 log_level:INFO n1ql_consistency:request num_timer_partitions:128 processing_status:false sock_batch_size:1 timer_context_size:15728640 user_prefix:eventing worker_count:3] requested, response code: 0 dump: &{Name: Code:0 Description: Attributes:[] RuntimeInfo: httpResponseCode:0}
2022/01/03 19:43:49 Removing node(s): [] from the cluster
2022/01/03 19:43:54 Rebalance progress: 29.16666666666666
2022/01/03 19:43:59 Rebalance progress: 29.16666666666666
2022/01/03 19:44:04 Rebalance progress: 100
2022/01/03 19:44:09 Waiting for app: TestUndeployWithKVFailover to get un-deployed
2022/01/03 19:44:09 App: TestUndeployWithKVFailover got un-deployed
2022/01/03 19:44:09 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:44:14 Waiting for app: TestUndeployWithKVFailover to get un-deployed
2022/01/03 19:44:14 App: TestUndeployWithKVFailover got un-deployed
2022/01/03 19:44:14 No eventing-con process running
2022/01/03 19:44:14 Function: TestUndeployWithKVFailover delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployWithKVFailover deleting in background"
}
2022/01/03 19:44:15 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:44:25 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 19:44:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:44:27 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:44:37 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 19:44:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestUndeployWithKVFailover (200.04s)
=== RUN   TestBucketFlushWhileFnDeployed
2022/01/03 19:44:47 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2022/01/03 19:44:47 App: TestBucketFlushWhileFnDeployed got un-deployed
2022/01/03 19:44:47 No eventing-con process running
2022/01/03 19:44:47 Function: TestBucketFlushWhileFnDeployed delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketFlushWhileFnDeployed not found"
}
2022/01/03 19:44:49 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:44:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:44:55 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:45:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:45:00 Deploying app: TestBucketFlushWhileFnDeployed. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:45:02 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketFlushWhileFnDeployed stored in temp store"
}
2022/01/03 19:45:07 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2022/01/03 19:45:12 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2022/01/03 19:45:17 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2022/01/03 19:45:22 Waiting for app: TestBucketFlushWhileFnDeployed to get deployed
2022/01/03 19:45:22 App: TestBucketFlushWhileFnDeployed got deployed
2022/01/03 19:45:22 Starting bucket ops to source bucket
2022/01/03 19:45:42 Waiting for dst bucket item count to get to: 20000 curr count: 8439
2022/01/03 19:45:42 src & dst bucket item count matched up. src bucket count: 20000 dst bucket count: 20000
2022/01/03 19:45:42 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:45:44 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:45:54 Waiting for dst bucket item count to get to: 0 curr count: 20000
2022/01/03 19:45:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:45:56 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:46:06 Waiting for dst bucket item count to get to: 0 curr count: 20000
2022/01/03 19:46:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:46:06 Starting bucket ops to source bucket
2022/01/03 19:46:19 Waiting for dst bucket item count to get to: 10000 curr count: 2181
2022/01/03 19:46:24 Waiting for dst bucket item count to get to: 10000 curr count: 2181
2022/01/03 19:46:25 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 19:46:25 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:46:30 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2022/01/03 19:46:35 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2022/01/03 19:46:40 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2022/01/03 19:46:45 Waiting for app: TestBucketFlushWhileFnDeployed to get un-deployed
2022/01/03 19:46:45 App: TestBucketFlushWhileFnDeployed got un-deployed
2022/01/03 19:46:45 No eventing-con process running
2022/01/03 19:46:45 Function: TestBucketFlushWhileFnDeployed delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketFlushWhileFnDeployed deleting in background"
}
2022/01/03 19:46:46 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:46:56 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/03 19:46:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:46:58 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:47:08 Waiting for dst bucket item count to get to: 0 curr count: 5866
2022/01/03 19:47:13 Waiting for dst bucket item count to get to: 0 curr count: 866
2022/01/03 19:47:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBucketFlushWhileFnDeployed (155.48s)
=== RUN   TestTimerOverwrite
2022/01/03 19:47:23 Waiting for app: TestTimerOverwrite to get un-deployed
2022/01/03 19:47:23 App: TestTimerOverwrite got un-deployed
2022/01/03 19:47:23 No eventing-con process running
2022/01/03 19:47:23 Function: TestTimerOverwrite delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerOverwrite not found"
}
2022/01/03 19:47:24 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:47:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:47:31 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:47:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:47:36 Deploying app: TestTimerOverwrite. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:47:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverwrite stored in temp store"
}
2022/01/03 19:47:42 Waiting for app: TestTimerOverwrite to get deployed
2022/01/03 19:47:47 Waiting for app: TestTimerOverwrite to get deployed
2022/01/03 19:47:52 Waiting for app: TestTimerOverwrite to get deployed
2022/01/03 19:47:57 Waiting for app: TestTimerOverwrite to get deployed
2022/01/03 19:47:57 App: TestTimerOverwrite got deployed
2022/01/03 19:48:07 Starting bucket ops to source bucket
2022/01/03 19:48:16 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:48:21 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:48:26 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:48:31 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:48:36 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:48:41 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:48:46 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:48:51 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:48:56 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:49:01 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:49:06 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 19:49:11 Waiting for dst bucket item count to get to: 5000 curr count: 87
2022/01/03 19:49:16 Waiting for dst bucket item count to get to: 5000 curr count: 87
2022/01/03 19:49:16 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 19:49:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:49:31 Waiting for app: TestTimerOverwrite to get un-deployed
2022/01/03 19:49:37 Waiting for app: TestTimerOverwrite to get un-deployed
2022/01/03 19:49:42 Waiting for app: TestTimerOverwrite to get un-deployed
2022/01/03 19:49:47 Waiting for app: TestTimerOverwrite to get un-deployed
2022/01/03 19:49:47 App: TestTimerOverwrite got un-deployed
2022/01/03 19:49:47 No eventing-con process running
2022/01/03 19:49:47 Function: TestTimerOverwrite delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverwrite deleting in background"
}
2022/01/03 19:49:48 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:49:58 Waiting for dst bucket item count to get to: 0 curr count: 3347
2022/01/03 19:50:03 Waiting for dst bucket item count to get to: 0 curr count: 847
2022/01/03 19:50:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:50:05 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:50:15 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 19:50:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerOverwrite (181.92s)
=== RUN   TestUndeployBackdoorDuringBootstrap
2022/01/03 19:50:20 Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2022/01/03 19:50:20 Removing node(s): [] from the cluster
2022/01/03 19:50:25 Rebalance progress: 100
2022/01/03 19:50:25 Failing over: [127.0.0.1:19003]
2022/01/03 19:50:30 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2022/01/03 19:50:30 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2022/01/03 19:50:30 No eventing-con process running
2022/01/03 19:50:30 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployBackdoorDuringBootstrap not found"
}
2022/01/03 19:50:31 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:50:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:50:38 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:50:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:50:43 Deploying app: TestUndeployBackdoorDuringBootstrap. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:50:44 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployBackdoorDuringBootstrap stored in temp store"
}
2022/01/03 19:50:44 Starting bucket ops to source bucket
2022/01/03 19:50:54 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:50:54 Context: Post to set retry counter, response code: 200 dump: {
 "code": 0
}
2022/01/03 19:50:54 set retry counter, response &{[123 10 32 34 99 111 100 101 34 58 32 48 10 125] }
2022/01/03 19:51:59 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2022/01/03 19:51:59 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2022/01/03 19:51:59 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:51:59 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestUndeployBackdoorDuringBootstrap deleting in background"
}
2022/01/03 19:52:04 Waiting for app: TestUndeployBackdoorDuringBootstrap to get un-deployed
2022/01/03 19:52:04 App: TestUndeployBackdoorDuringBootstrap got un-deployed
2022/01/03 19:52:04 No eventing-con process running
2022/01/03 19:52:04 Function: TestUndeployBackdoorDuringBootstrap delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestUndeployBackdoorDuringBootstrap not found"
}
2022/01/03 19:52:06 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:52:16 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 19:52:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:52:17 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:52:27 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/03 19:52:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:52:27 Removing node(s): [] from the cluster
2022/01/03 19:52:33 Rebalance progress: 100
--- PASS: TestUndeployBackdoorDuringBootstrap (137.85s)
=== RUN   TestOnUpdateSrcMutation
2022/01/03 19:52:43 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2022/01/03 19:52:43 App: TestOnUpdateSrcMutation got un-deployed
2022/01/03 19:52:43 No eventing-con process running
2022/01/03 19:52:43 Function: TestOnUpdateSrcMutation delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateSrcMutation not found"
}
2022/01/03 19:52:44 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:52:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:52:51 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:52:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:52:56 Deploying app: TestOnUpdateSrcMutation. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:52:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutation stored in temp store"
}
2022/01/03 19:52:57 Starting bucket ops to source bucket
2022/01/03 19:53:24 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 19:53:24 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:53:29 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2022/01/03 19:53:34 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2022/01/03 19:53:39 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2022/01/03 19:53:44 Waiting for app: TestOnUpdateSrcMutation to get un-deployed
2022/01/03 19:53:44 App: TestOnUpdateSrcMutation got un-deployed
2022/01/03 19:53:44 No eventing-con process running
2022/01/03 19:53:44 Function: TestOnUpdateSrcMutation delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutation deleting in background"
}
2022/01/03 19:53:45 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:53:55 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/03 19:53:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:53:57 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:54:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateSrcMutation (89.45s)
=== RUN   TestOnDeleteSrcMutation
2022/01/03 19:54:12 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2022/01/03 19:54:12 App: TestOnDeleteSrcMutation got un-deployed
2022/01/03 19:54:12 No eventing-con process running
2022/01/03 19:54:12 Function: TestOnDeleteSrcMutation delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteSrcMutation not found"
}
2022/01/03 19:54:13 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:54:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:54:20 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:54:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:54:25 Deploying app: TestOnDeleteSrcMutation. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:54:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutation stored in temp store"
}
2022/01/03 19:54:26 Starting bucket ops to source bucket
2022/01/03 19:54:55 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 19:54:55 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:55:00 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2022/01/03 19:55:05 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2022/01/03 19:55:10 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2022/01/03 19:55:15 Waiting for app: TestOnDeleteSrcMutation to get un-deployed
2022/01/03 19:55:15 App: TestOnDeleteSrcMutation got un-deployed
2022/01/03 19:55:15 No eventing-con process running
2022/01/03 19:55:15 Function: TestOnDeleteSrcMutation delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutation deleting in background"
}
2022/01/03 19:55:16 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:55:26 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 19:55:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:55:28 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:55:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteSrcMutation (91.13s)
=== RUN   TestOnUpdateSrcMutationWithTimer
2022/01/03 19:55:43 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2022/01/03 19:55:43 App: TestOnUpdateSrcMutationWithTimer got un-deployed
2022/01/03 19:55:43 No eventing-con process running
2022/01/03 19:55:43 Function: TestOnUpdateSrcMutationWithTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnUpdateSrcMutationWithTimer not found"
}
2022/01/03 19:55:44 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:55:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:55:51 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:55:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:55:56 Deploying app: TestOnUpdateSrcMutationWithTimer. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:55:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutationWithTimer stored in temp store"
}
2022/01/03 19:55:57 Starting bucket ops to source bucket
2022/01/03 19:56:34 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 19:56:34 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:56:39 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2022/01/03 19:56:44 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2022/01/03 19:56:49 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2022/01/03 19:56:54 Waiting for app: TestOnUpdateSrcMutationWithTimer to get un-deployed
2022/01/03 19:56:54 App: TestOnUpdateSrcMutationWithTimer got un-deployed
2022/01/03 19:56:54 No eventing-con process running
2022/01/03 19:56:54 Function: TestOnUpdateSrcMutationWithTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnUpdateSrcMutationWithTimer deleting in background"
}
2022/01/03 19:56:56 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:57:06 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/03 19:57:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:57:07 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:57:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnUpdateSrcMutationWithTimer (99.26s)
=== RUN   TestOnDeleteSrcMutationsWithTimer
2022/01/03 19:57:22 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2022/01/03 19:57:22 App: TestOnDeleteSrcMutationsWithTimer got un-deployed
2022/01/03 19:57:22 No eventing-con process running
2022/01/03 19:57:22 Function: TestOnDeleteSrcMutationsWithTimer delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteSrcMutationsWithTimer not found"
}
2022/01/03 19:57:24 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:57:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:57:30 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:57:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:57:35 Deploying app: TestOnDeleteSrcMutationsWithTimer. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:57:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutationsWithTimer stored in temp store"
}
2022/01/03 19:57:37 Starting bucket ops to source bucket
2022/01/03 19:58:15 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 19:58:15 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 19:58:20 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2022/01/03 19:58:25 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2022/01/03 19:58:30 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2022/01/03 19:58:35 Waiting for app: TestOnDeleteSrcMutationsWithTimer to get un-deployed
2022/01/03 19:58:36 App: TestOnDeleteSrcMutationsWithTimer got un-deployed
2022/01/03 19:58:36 No eventing-con process running
2022/01/03 19:58:36 Function: TestOnDeleteSrcMutationsWithTimer delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteSrcMutationsWithTimer deleting in background"
}
2022/01/03 19:58:37 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:58:47 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 19:58:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:58:49 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:58:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteSrcMutationsWithTimer (101.29s)
=== RUN   TestInterHandlerRecursion
2022/01/03 19:59:04 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 19:59:04 App: TestInterHandlerRecursion_source_bucket_update_op got un-deployed
2022/01/03 19:59:04 No eventing-con process running
2022/01/03 19:59:04 Function: TestInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_source_bucket_update_op not found"
}
2022/01/03 19:59:05 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:59:10 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:59:12 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:59:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:59:22 Waiting for app: TestInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/03 19:59:22 App: TestInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2022/01/03 19:59:22 No eventing-con process running
2022/01/03 19:59:22 Function: TestInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2022/01/03 19:59:23 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:59:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:59:30 Context: Bucket flush, response code: 200 dump: 
2022/01/03 19:59:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 19:59:35 Deploying app: TestInterHandlerRecursion_source_bucket_update_op. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:59:36 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op stored in temp store"
}
2022/01/03 19:59:36 response body {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op stored in temp store"
} err 
2022/01/03 19:59:41 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/03 19:59:46 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/03 19:59:51 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/03 19:59:56 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/03 19:59:56 App: TestInterHandlerRecursion_source_bucket_update_op got deployed
2022/01/03 19:59:56 Deploying app: TestInterHandlerRecursion_src_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2022/01/03 19:59:56 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_FUNCTION_RECURSION",
 "code": 50,
 "description": "Inter handler recursion error"
}
2022/01/03 19:59:56 response body {
 "name": "ERR_INTER_FUNCTION_RECURSION",
 "code": 50,
 "description": "Inter handler recursion error"
} err 
2022/01/03 20:00:01 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 20:00:06 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 20:00:11 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 20:00:16 Waiting for app: TestInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 20:00:16 App: TestInterHandlerRecursion_source_bucket_update_op got un-deployed
2022/01/03 20:00:16 No eventing-con process running
2022/01/03 20:00:16 Function: TestInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterHandlerRecursion_source_bucket_update_op deleting in background"
}
2022/01/03 20:00:18 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:00:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:00:24 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:00:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:00:34 Waiting for app: TestInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/03 20:00:34 App: TestInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2022/01/03 20:00:34 No eventing-con process running
2022/01/03 20:00:34 Function: TestInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2022/01/03 20:00:36 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:00:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:00:42 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:00:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterHandlerRecursion (113.83s)
=== RUN   TestInterBucketRecursion
2022/01/03 20:00:52 Deploying app: TestInterBucketRecursion_function1. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:00:54 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 stored in temp store"
}
2022/01/03 20:00:54 response body {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 stored in temp store"
} err 
2022/01/03 20:00:54 Deploying app: TestInterBucketRecursion_function2. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:00:54 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestInterBucketRecursion_function2 causes a cycle involving functions: [TestInterBucketRecursion_function1], hence deployment is disallowed"
}
2022/01/03 20:00:59 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2022/01/03 20:01:04 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2022/01/03 20:01:09 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2022/01/03 20:01:14 Waiting for app: TestInterBucketRecursion_function1 to get deployed
2022/01/03 20:01:14 App: TestInterBucketRecursion_function1 got deployed
2022/01/03 20:01:19 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2022/01/03 20:01:24 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2022/01/03 20:01:29 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2022/01/03 20:01:34 Waiting for app: TestInterBucketRecursion_function1 to get un-deployed
2022/01/03 20:01:34 App: TestInterBucketRecursion_function1 got un-deployed
2022/01/03 20:01:34 No eventing-con process running
2022/01/03 20:01:34 Function: TestInterBucketRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion_function1 deleting in background"
}
2022/01/03 20:01:35 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:01:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:01:42 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:01:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:01:52 Waiting for app: TestInterBucketRecursion_function2 to get un-deployed
2022/01/03 20:01:52 App: TestInterBucketRecursion_function2 got un-deployed
2022/01/03 20:01:52 No eventing-con process running
2022/01/03 20:01:52 Function: TestInterBucketRecursion_function2 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterBucketRecursion_function2 not found"
}
2022/01/03 20:01:53 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:01:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:02:00 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:02:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterBucketRecursion (77.58s)
=== RUN   TestLargeHandler
2022/01/03 20:02:05 Changed force_compress value to false
2022/01/03 20:02:05 Deploying app: TestLargeHandler_function. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:02:05 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_APPCODE_SIZE",
 "code": 39,
 "description": "Function: TestLargeHandler_function handler Code size is more than 131072. Code Size: 131768"
}
2022/01/03 20:02:05 Changed force_compress value to true
2022/01/03 20:02:05 Deploying app: TestLargeHandler_function. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:02:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestLargeHandler_function stored in temp store"
}
2022/01/03 20:02:12 Waiting for app: TestLargeHandler_function to get deployed
2022/01/03 20:02:17 Waiting for app: TestLargeHandler_function to get deployed
2022/01/03 20:02:22 Waiting for app: TestLargeHandler_function to get deployed
2022/01/03 20:02:27 Waiting for app: TestLargeHandler_function to get deployed
2022/01/03 20:02:27 App: TestLargeHandler_function got deployed
2022/01/03 20:02:32 Waiting for app: TestLargeHandler_function to get un-deployed
2022/01/03 20:02:38 Waiting for app: TestLargeHandler_function to get un-deployed
2022/01/03 20:02:43 Waiting for app: TestLargeHandler_function to get un-deployed
2022/01/03 20:02:48 Waiting for app: TestLargeHandler_function to get un-deployed
2022/01/03 20:02:48 App: TestLargeHandler_function got un-deployed
2022/01/03 20:02:48 No eventing-con process running
2022/01/03 20:02:48 Function: TestLargeHandler_function delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestLargeHandler_function deleting in background"
}
2022/01/03 20:02:49 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:02:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:02:56 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:03:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestLargeHandler (55.49s)
=== RUN   TestAllowInterHandlerRecursion
2022/01/03 20:03:11 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 20:03:11 App: TestAllowInterHandlerRecursion_source_bucket_update_op got un-deployed
2022/01/03 20:03:11 No eventing-con process running
2022/01/03 20:03:11 Function: TestAllowInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op not found"
}
2022/01/03 20:03:12 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:03:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:03:19 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:03:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:03:29 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/03 20:03:29 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2022/01/03 20:03:29 No eventing-con process running
2022/01/03 20:03:29 Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete not found"
}
2022/01/03 20:03:30 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:03:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:03:37 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:03:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:03:42 Deploying app: TestAllowInterHandlerRecursion_source_bucket_update_op. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:03:43 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op stored in temp store"
}
2022/01/03 20:03:43 response body {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op stored in temp store"
} err 
2022/01/03 20:03:48 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/03 20:03:53 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/03 20:03:58 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/03 20:04:03 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get deployed
2022/01/03 20:04:03 App: TestAllowInterHandlerRecursion_source_bucket_update_op got deployed
2022/01/03 20:04:03 Deploying app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:04:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete stored in temp store"
}
2022/01/03 20:04:04 response body {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete stored in temp store"
} err 
2022/01/03 20:04:09 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2022/01/03 20:04:14 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2022/01/03 20:04:19 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2022/01/03 20:04:24 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get deployed
2022/01/03 20:04:24 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got deployed
2022/01/03 20:04:24 TestAllowInterHandlerRecursion_src_bucket_op_on_delete is deployed
2022/01/03 20:04:29 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 20:04:35 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 20:04:40 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 20:04:45 Waiting for app: TestAllowInterHandlerRecursion_source_bucket_update_op to get un-deployed
2022/01/03 20:04:45 App: TestAllowInterHandlerRecursion_source_bucket_update_op got un-deployed
2022/01/03 20:04:45 No eventing-con process running
2022/01/03 20:04:45 Function: TestAllowInterHandlerRecursion_source_bucket_update_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_source_bucket_update_op deleting in background"
}
2022/01/03 20:04:47 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:04:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:04:54 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:04:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:05:04 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/03 20:05:09 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/03 20:05:14 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/03 20:05:19 Waiting for app: TestAllowInterHandlerRecursion_src_bucket_op_on_delete to get un-deployed
2022/01/03 20:05:19 App: TestAllowInterHandlerRecursion_src_bucket_op_on_delete got un-deployed
2022/01/03 20:05:19 No eventing-con process running
2022/01/03 20:05:19 Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterHandlerRecursion_src_bucket_op_on_delete deleting in background"
}
2022/01/03 20:05:20 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:05:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:05:27 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:05:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAllowInterHandlerRecursion (151.48s)
=== RUN   TestAllowInterBucketRecursion
2022/01/03 20:05:37 Deploying app: TestAllowInterBucketRecursion_function1. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:05:38 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 stored in temp store"
}
2022/01/03 20:05:38 response body {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 stored in temp store"
} err 
2022/01/03 20:05:43 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2022/01/03 20:05:48 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2022/01/03 20:05:53 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2022/01/03 20:05:58 Waiting for app: TestAllowInterBucketRecursion_function1 to get deployed
2022/01/03 20:05:58 App: TestAllowInterBucketRecursion_function1 got deployed
2022/01/03 20:05:58 Deploying app: TestAllowInterBucketRecursion_function2. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:05:59 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 stored in temp store"
}
2022/01/03 20:05:59 response body {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 stored in temp store"
} err 
2022/01/03 20:06:04 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2022/01/03 20:06:09 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2022/01/03 20:06:14 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2022/01/03 20:06:19 Waiting for app: TestAllowInterBucketRecursion_function2 to get deployed
2022/01/03 20:06:19 App: TestAllowInterBucketRecursion_function2 got deployed
2022/01/03 20:06:19 TestAllowInterBucketRecursion_function2 is deployed
2022/01/03 20:06:25 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2022/01/03 20:06:30 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2022/01/03 20:06:35 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2022/01/03 20:06:40 Waiting for app: TestAllowInterBucketRecursion_function1 to get un-deployed
2022/01/03 20:06:40 App: TestAllowInterBucketRecursion_function1 got un-deployed
2022/01/03 20:06:40 No eventing-con process running
2022/01/03 20:06:40 Function: TestAllowInterBucketRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function1 deleting in background"
}
2022/01/03 20:06:41 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:06:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:06:49 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:06:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:06:59 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2022/01/03 20:07:04 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2022/01/03 20:07:09 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2022/01/03 20:07:14 Waiting for app: TestAllowInterBucketRecursion_function2 to get un-deployed
2022/01/03 20:07:14 App: TestAllowInterBucketRecursion_function2 got un-deployed
2022/01/03 20:07:14 No eventing-con process running
2022/01/03 20:07:14 Function: TestAllowInterBucketRecursion_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestAllowInterBucketRecursion_function2 deleting in background"
}
2022/01/03 20:07:16 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:07:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:07:22 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:07:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestAllowInterBucketRecursion (115.30s)
=== RUN   TestInterBucketRecursion2
2022/01/03 20:07:33 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:07:39 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:07:45 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:07:51 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:07:56 Deploying app: TestInterBucketRecursion2_function1. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:07:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function1 stored in temp store"
}
2022/01/03 20:08:03 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2022/01/03 20:08:08 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2022/01/03 20:08:13 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2022/01/03 20:08:18 Waiting for app: TestInterBucketRecursion2_function1 to get deployed
2022/01/03 20:08:18 App: TestInterBucketRecursion2_function1 got deployed
2022/01/03 20:08:18 Deploying app: TestInterBucketRecursion2_function2. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:08:19 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function2 stored in temp store"
}
2022/01/03 20:08:24 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2022/01/03 20:08:29 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2022/01/03 20:08:34 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2022/01/03 20:08:39 Waiting for app: TestInterBucketRecursion2_function2 to get deployed
2022/01/03 20:08:39 App: TestInterBucketRecursion2_function2 got deployed
2022/01/03 20:08:39 Deploying app: TestInterBucketRecursion2_function3. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:08:40 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function3 stored in temp store"
}
2022/01/03 20:08:45 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2022/01/03 20:08:50 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2022/01/03 20:08:55 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2022/01/03 20:09:00 Waiting for app: TestInterBucketRecursion2_function3 to get deployed
2022/01/03 20:09:00 App: TestInterBucketRecursion2_function3 got deployed
2022/01/03 20:09:00 Deploying app: TestInterBucketRecursion2_function4. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:09:00 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestInterBucketRecursion2_function4 causes a cycle involving functions: [TestInterBucketRecursion2_function1 TestInterBucketRecursion2_function2 TestInterBucketRecursion2_function3], hence deployment is disallowed"
}
2022/01/03 20:09:05 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2022/01/03 20:09:10 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2022/01/03 20:09:15 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2022/01/03 20:09:20 Waiting for app: TestInterBucketRecursion2_function1 to get un-deployed
2022/01/03 20:09:20 App: TestInterBucketRecursion2_function1 got un-deployed
2022/01/03 20:09:20 No eventing-con process running
2022/01/03 20:09:20 Function: TestInterBucketRecursion2_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function1 deleting in background"
}
2022/01/03 20:09:22 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:09:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:09:29 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:09:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:09:39 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2022/01/03 20:09:44 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2022/01/03 20:09:49 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2022/01/03 20:09:54 Waiting for app: TestInterBucketRecursion2_function2 to get un-deployed
2022/01/03 20:09:54 App: TestInterBucketRecursion2_function2 got un-deployed
2022/01/03 20:09:54 No eventing-con process running
2022/01/03 20:09:54 Function: TestInterBucketRecursion2_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function2 deleting in background"
}
2022/01/03 20:09:55 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:10:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:10:02 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:10:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:10:12 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2022/01/03 20:10:17 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2022/01/03 20:10:22 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2022/01/03 20:10:27 Waiting for app: TestInterBucketRecursion2_function3 to get un-deployed
2022/01/03 20:10:27 App: TestInterBucketRecursion2_function3 got un-deployed
2022/01/03 20:10:27 No eventing-con process running
2022/01/03 20:10:27 Function: TestInterBucketRecursion2_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestInterBucketRecursion2_function3 deleting in background"
}
2022/01/03 20:10:29 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:10:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:10:36 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:10:41 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:10:46 Waiting for app: TestInterBucketRecursion2_function4 to get un-deployed
2022/01/03 20:10:46 App: TestInterBucketRecursion2_function4 got un-deployed
2022/01/03 20:10:46 No eventing-con process running
2022/01/03 20:10:46 Function: TestInterBucketRecursion2_function4 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestInterBucketRecursion2_function4 not found"
}
2022/01/03 20:10:47 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:10:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:10:54 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:10:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestInterBucketRecursion2 (213.33s)
=== RUN   TestBucketDeleteWithRebOut
2022/01/03 20:11:06 Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2022/01/03 20:11:11 Rebalance progress: 100

VB distribution across eventing nodes and their workers::

2022/01/03 20:11:14 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 20:11:29 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 20:11:44 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 20:11:59 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 20:12:14 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 20:12:29 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 20:12:44 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 20:12:59 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 20:13:14 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 20:13:29 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 20:13:44 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]
2022/01/03 20:13:59 waitForIndexes waiting for indexes: [{Name:#primary Bucket:eventing Completion:51} {Name:#primary Bucket:hello-world Completion:100}]

DCP Stream statuses:

vbucket curr owner:


2022/01/03 20:14:14 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:14:14 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 20:14:14 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 20:14:19 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:

vbucket curr owner:


2022/01/03 20:14:19 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:14:19 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 20:14:20 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 20:14:25 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:

vbucket curr owner:


2022/01/03 20:14:25 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:14:30 clusterSetup.go:397: Waiting for app: TestBucketDeleteWithRebOut to get un-deployed
2022/01/03 20:14:30 clusterSetup.go:405: App: TestBucketDeleteWithRebOut got un-deployed
2022/01/03 20:14:30 eventingSetup.go:46: No eventing-con process running
2022/01/03 20:14:30 eventingSetup.go:418: Function: TestBucketDeleteWithRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestBucketDeleteWithRebOut not found"
}
2022/01/03 20:14:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:14:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:14:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:14:43 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:14:48 eventingSetup.go:125: Deploying app: TestBucketDeleteWithRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:14:49 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteWithRebOut stored in temp store"
}
2022/01/03 20:14:54 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2022/01/03 20:14:59 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2022/01/03 20:15:04 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2022/01/03 20:15:09 clusterSetup.go:346: Waiting for app: TestBucketDeleteWithRebOut to get deployed
2022/01/03 20:15:09 clusterSetup.go:354: App: TestBucketDeleteWithRebOut got deployed

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: 6162b9dc39ccbbcf730139521696aea6
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [0-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [114-227]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 114
	v: [228-341]
Producer node: 172.31.2.134:9300	Node UUID: d9f81b306a62aeccbc06d13d30aa00aa
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [911-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [683-796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [797-910]
Producer node: 127.0.0.1:9303	Node UUID: c08f27935334a8a4084e04bb8c567ea3
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [570-682]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [342-455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [456-569]


2022/01/03 20:15:09 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:15:09 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 20:15:14 Rebalance progress: 29.16666666666666
2022/01/03 20:15:19 Rebalance progress: 29.16666666666666
2022/01/03 20:15:24 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 1024
	vb list dump: [0-1023]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: 6162b9dc39ccbbcf730139521696aea6
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [0-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [114-227]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 114
	v: [228-341]
Producer node: 172.31.2.134:9300	Node UUID: d9f81b306a62aeccbc06d13d30aa00aa
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [797-910]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [911-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [683-796]
Producer node: 127.0.0.1:9303	Node UUID: c08f27935334a8a4084e04bb8c567ea3
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 114
	v: [456-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 113
	v: [570-682]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 114
	v: [342-455]


2022/01/03 20:15:24 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:15:24 handler_test.go:1674: Deleting source bucket: default
2022/01/03 20:15:26 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 20:15:26 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 20:15:31 Rebalance progress: 29.16666666666666
2022/01/03 20:15:36 Rebalance progress: 29.16666666666666
2022/01/03 20:15:41 Rebalance progress: 100

VB distribution across eventing nodes and their workers::


DCP Stream statuses:
	stream status: running
	len: 904
	vb list dump: [0-6, 9-11, 13-14, 16-41, 43-45, 47-51, 53-70, 72, 74-77, 79-90, 93-95, 97-113, 115-117, 119-125, 127-156, 158-159, 161, 163-171, 173-184, 186-190, 192-200, 202-213, 215-225, 228, 230-234, 236-239, 241-244, 246-257, 259, 261-264, 266-290, 292-298, 300-320, 322, 325-338, 340-354, 356, 358-362, 364-372, 374-390, 392-399, 401, 403-408, 411-416, 418-425, 428-437, 439-442, 445, 447-451, 453-456, 458-460, 462-463, 465-478, 480-482, 484-486, 488-492, 495-500, 504-505, 507, 509-588, 590-593, 595-621, 623-624, 626-627, 629-642, 644-657, 660-663, 665, 667-672, 674-679, 682-701, 703-706, 708-709, 711, 713-720, 722, 724, 726-735, 737-741, 743-744, 747-768, 770-793, 795-815, 818-822, 824-841, 843-849, 851-852, 854, 856-860, 863, 865-869, 871-895, 897-905, 907-918, 920-933, 935-942, 945-961, 963-965, 967-977, 979-980, 982, 984-987, 989-1001, 1004-1023]
	stream status: stopped
	len: 120
	vb list dump: [7-8, 12, 15, 42, 46, 52, 71, 73, 78, 91-92, 96, 114, 118, 126, 157, 160, 162, 172, 185, 191, 201, 214, 226-227, 229, 235, 240, 245, 258, 260, 265, 291, 299, 321, 323-324, 339, 355, 357, 363, 373, 391, 400, 402, 409-410, 417, 426-427, 438, 443-444, 446, 452, 457, 461, 464, 479, 483, 487, 493-494, 501-503, 506, 508, 589, 594, 622, 625, 628, 643, 658-659, 664, 666, 673, 680-681, 702, 707, 710, 712, 721, 723, 725, 736, 742, 745-746, 769, 794, 816-817, 823, 842, 850, 853, 855, 861-862, 864, 870, 896, 906, 919, 934, 943-944, 962, 966, 978, 981, 983, 988, 1002-1003]

vbucket curr owner:
Producer node: 127.0.0.1:9302	Node UUID: 6162b9dc39ccbbcf730139521696aea6
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 101
	v: [0-6, 9-11, 13-14, 16-41, 43-45, 47-51, 53-70, 72, 74-77, 79-90, 93-95, 97-113]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 101
	v: [115-117, 119-125, 127-156, 158-159, 161, 163-171, 173-184, 186-190, 192-200, 202-213, 215-225]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 101
	v: [228, 230-234, 236-239, 241-244, 246-257, 259, 261-264, 266-290, 292-298, 300-320, 322, 325-338, 340-341]
Producer node: 172.31.2.134:9300	Node UUID: d9f81b306a62aeccbc06d13d30aa00aa
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 101
	v: [911-918, 920-933, 935-942, 945-961, 963-965, 967-977, 979-980, 982, 984-987, 989-1001, 1004-1023]
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 101
	v: [683-701, 703-706, 708-709, 711, 713-720, 722, 724, 726-735, 737-741, 743-744, 747-768, 770-793, 795-796]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 101
	v: [797-815, 818-822, 824-841, 843-849, 851-852, 854, 856-860, 863, 865-869, 871-895, 897-905, 907-910]
Producer node: 127.0.0.1:9303	Node UUID: c08f27935334a8a4084e04bb8c567ea3
	workerID: worker_TestBucketDeleteWithRebOut_0
	len: 97
	v: [342-354, 356, 358-362, 364-372, 374-390, 392-399, 401, 403-408, 411-416, 418-425, 428-437, 439-442, 445, 447-451, 453-455]
	workerID: worker_TestBucketDeleteWithRebOut_1
	len: 101
	v: [456, 458-460, 462-463, 465-478, 480-482, 484-486, 488-492, 495-500, 504-505, 507, 509-569]
	workerID: worker_TestBucketDeleteWithRebOut_2
	len: 100
	v: [570-588, 590-593, 595-621, 623-624, 626-627, 629-642, 644-657, 660-663, 665, 667-672, 674-679, 682]


2022/01/03 20:15:42 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:15:47 eventingSetup.go:719: Waiting for function: TestBucketDeleteWithRebOut status to change to undeployed
2022/01/03 20:15:47 eventingSetup.go:727: Function: TestBucketDeleteWithRebOut status changed to undeployed
2022/01/03 20:15:52 clusterSetup.go:397: Waiting for app: TestBucketDeleteWithRebOut to get un-deployed
2022/01/03 20:15:52 clusterSetup.go:405: App: TestBucketDeleteWithRebOut got un-deployed
2022/01/03 20:15:52 eventingSetup.go:46: No eventing-con process running
2022/01/03 20:15:52 eventingSetup.go:418: Function: TestBucketDeleteWithRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBucketDeleteWithRebOut deleting in background"
}
2022/01/03 20:15:53 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:15:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:16:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:16:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:16:05 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2022/01/03 20:16:05 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 20:16:10 Rebalance progress: 100
--- PASS: TestBucketDeleteWithRebOut (312.06s)
=== RUN   TestN1QLRecursion
2022/01/03 20:16:13 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 20:16:13 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2022/01/03 20:16:13 Removing node(s): [] from the cluster
2022/01/03 20:16:18 Rebalance progress: 100
2022/01/03 20:16:25 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:16:30 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:16:36 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:16:41 Deploying app: TestN1QLRecursion_function1. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:16:42 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 stored in temp store"
}
2022/01/03 20:16:42 response body {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 stored in temp store"
} err 
2022/01/03 20:16:47 Waiting for app: TestN1QLRecursion_function1 to get deployed
2022/01/03 20:16:52 Waiting for app: TestN1QLRecursion_function1 to get deployed
2022/01/03 20:16:58 Waiting for app: TestN1QLRecursion_function1 to get deployed
2022/01/03 20:17:03 Waiting for app: TestN1QLRecursion_function1 to get deployed
2022/01/03 20:17:03 App: TestN1QLRecursion_function1 got deployed
2022/01/03 20:17:03 TestN1QLRecursion_function1 is deployed
2022/01/03 20:17:03 Deploying app: TestN1QLRecursion_function3. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:17:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 stored in temp store"
}
2022/01/03 20:17:04 response body {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 stored in temp store"
} err 
2022/01/03 20:17:09 Waiting for app: TestN1QLRecursion_function3 to get deployed
2022/01/03 20:17:14 Waiting for app: TestN1QLRecursion_function3 to get deployed
2022/01/03 20:17:19 Waiting for app: TestN1QLRecursion_function3 to get deployed
2022/01/03 20:17:24 Waiting for app: TestN1QLRecursion_function3 to get deployed
2022/01/03 20:17:24 App: TestN1QLRecursion_function3 got deployed
2022/01/03 20:17:24 TestN1QLRecursion_function3 is deployed
2022/01/03 20:17:24 Deploying app: TestN1QLRecursion_function2. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:17:24 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestN1QLRecursion_function2 causes a cycle involving functions: [TestN1QLRecursion_function3 TestN1QLRecursion_function1], hence deployment is disallowed"
}
2022/01/03 20:17:24 response body {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Inter bucket recursion error; function: TestN1QLRecursion_function2 causes a cycle involving functions: [TestN1QLRecursion_function3 TestN1QLRecursion_function1], hence deployment is disallowed"
} err 
2022/01/03 20:17:24 Success: TestN1QLRecursion_function2 is not deployed
2022/01/03 20:17:29 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2022/01/03 20:17:34 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2022/01/03 20:17:39 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2022/01/03 20:17:44 Waiting for app: TestN1QLRecursion_function1 to get un-deployed
2022/01/03 20:17:44 App: TestN1QLRecursion_function1 got un-deployed
2022/01/03 20:17:44 No eventing-con process running
2022/01/03 20:17:44 Function: TestN1QLRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function1 deleting in background"
}
2022/01/03 20:17:46 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:17:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:17:53 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:17:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:18:03 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2022/01/03 20:18:08 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2022/01/03 20:18:13 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2022/01/03 20:18:18 Waiting for app: TestN1QLRecursion_function3 to get un-deployed
2022/01/03 20:18:18 App: TestN1QLRecursion_function3 got un-deployed
2022/01/03 20:18:18 No eventing-con process running
2022/01/03 20:18:18 Function: TestN1QLRecursion_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLRecursion_function3 deleting in background"
}
2022/01/03 20:18:20 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:18:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:18:27 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:18:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:18:33 Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/03 20:18:38 Rebalance progress: 100
--- PASS: TestN1QLRecursion (145.52s)
=== RUN   TestN1QLAllowRecursion
2022/01/03 20:18:38 Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 20:18:39 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2022/01/03 20:18:39 Removing node(s): [] from the cluster
2022/01/03 20:18:44 Rebalance progress: 100
2022/01/03 20:18:49 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:18:55 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:19:01 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:19:06 Deploying app: TestN1QLAllowRecursion_function1. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:19:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 stored in temp store"
}
2022/01/03 20:19:07 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 stored in temp store"
} err 
2022/01/03 20:19:12 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2022/01/03 20:19:17 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2022/01/03 20:19:22 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2022/01/03 20:19:27 Waiting for app: TestN1QLAllowRecursion_function1 to get deployed
2022/01/03 20:19:27 App: TestN1QLAllowRecursion_function1 got deployed
2022/01/03 20:19:27 TestN1QLAllowRecursion_function1 is deployed
2022/01/03 20:19:27 Deploying app: TestN1QLAllowRecursion_function3. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:19:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 stored in temp store"
}
2022/01/03 20:19:28 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 stored in temp store"
} err 
2022/01/03 20:19:33 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2022/01/03 20:19:38 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2022/01/03 20:19:43 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2022/01/03 20:19:48 Waiting for app: TestN1QLAllowRecursion_function3 to get deployed
2022/01/03 20:19:48 App: TestN1QLAllowRecursion_function3 got deployed
2022/01/03 20:19:49 TestN1QLAllowRecursion_function3 is deployed
2022/01/03 20:19:49 Deploying app: TestN1QLAllowRecursion_function2. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:19:50 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 stored in temp store"
}
2022/01/03 20:19:50 response body {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 stored in temp store"
} err 
2022/01/03 20:19:55 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2022/01/03 20:20:00 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2022/01/03 20:20:05 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2022/01/03 20:20:10 Waiting for app: TestN1QLAllowRecursion_function2 to get deployed
2022/01/03 20:20:10 App: TestN1QLAllowRecursion_function2 got deployed
2022/01/03 20:20:10 Success: TestN1QLAllowRecursion_function2 is deployed after allow_interbucket_recursion
2022/01/03 20:20:15 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2022/01/03 20:20:20 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2022/01/03 20:20:25 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2022/01/03 20:20:30 Waiting for app: TestN1QLAllowRecursion_function1 to get un-deployed
2022/01/03 20:20:30 App: TestN1QLAllowRecursion_function1 got un-deployed
2022/01/03 20:20:30 No eventing-con process running
2022/01/03 20:20:30 Function: TestN1QLAllowRecursion_function1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function1 deleting in background"
}
2022/01/03 20:20:32 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:20:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:20:39 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:20:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:20:49 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2022/01/03 20:20:54 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2022/01/03 20:20:59 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2022/01/03 20:21:04 Waiting for app: TestN1QLAllowRecursion_function2 to get un-deployed
2022/01/03 20:21:04 App: TestN1QLAllowRecursion_function2 got un-deployed
2022/01/03 20:21:04 No eventing-con process running
2022/01/03 20:21:04 Function: TestN1QLAllowRecursion_function2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function2 deleting in background"
}
2022/01/03 20:21:06 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:21:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:21:13 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:21:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:21:23 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2022/01/03 20:21:28 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2022/01/03 20:21:33 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2022/01/03 20:21:38 Waiting for app: TestN1QLAllowRecursion_function3 to get un-deployed
2022/01/03 20:21:38 App: TestN1QLAllowRecursion_function3 got un-deployed
2022/01/03 20:21:38 No eventing-con process running
2022/01/03 20:21:38 Function: TestN1QLAllowRecursion_function3 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAllowRecursion_function3 deleting in background"
}
2022/01/03 20:21:40 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:21:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:21:47 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:21:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:21:53 Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/03 20:21:58 Rebalance progress: 100
--- PASS: TestN1QLAllowRecursion (200.03s)
=== RUN   TestOnDeleteExpiryBucketOp
2022/01/03 20:21:58 Sleeping for some time
2022/01/03 20:22:08 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2022/01/03 20:22:08 App: TestOnDeleteExpiryBucketOp got un-deployed
2022/01/03 20:22:08 No eventing-con process running
2022/01/03 20:22:08 Function: TestOnDeleteExpiryBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestOnDeleteExpiryBucketOp not found"
}
2022/01/03 20:22:10 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:22:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:22:17 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:22:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:22:22 Deploying app: TestOnDeleteExpiryBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:22:23 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteExpiryBucketOp stored in temp store"
}
2022/01/03 20:22:23 Starting bucket ops to source bucket
2022/01/03 20:23:12 Waiting for dst bucket item count to get to: 5000 curr count: 0
2022/01/03 20:23:17 Waiting for dst bucket item count to get to: 5000 curr count: 1749
2022/01/03 20:23:22 Waiting for dst bucket item count to get to: 5000 curr count: 4249
2022/01/03 20:23:22 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 20:23:22 Starting bucket ops to source bucket
2022/01/03 20:23:23 Starting bucket ops to source bucket
2022/01/03 20:24:29 Waiting for dst bucket item count to get to: 7000 curr count: 5000
2022/01/03 20:24:34 Waiting for dst bucket item count to get to: 7000 curr count: 6000
2022/01/03 20:24:34 src & dst bucket item count matched up. src bucket count: 7000 dst bucket count: 7000
2022/01/03 20:24:34 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:24:39 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2022/01/03 20:24:44 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2022/01/03 20:24:49 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2022/01/03 20:24:54 Waiting for app: TestOnDeleteExpiryBucketOp to get un-deployed
2022/01/03 20:24:54 App: TestOnDeleteExpiryBucketOp got un-deployed
2022/01/03 20:24:54 No eventing-con process running
2022/01/03 20:24:54 Function: TestOnDeleteExpiryBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestOnDeleteExpiryBucketOp deleting in background"
}
2022/01/03 20:24:56 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:25:06 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/03 20:25:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:25:08 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:25:18 Waiting for dst bucket item count to get to: 0 curr count: 4917
2022/01/03 20:25:23 Waiting for dst bucket item count to get to: 0 curr count: 1417
2022/01/03 20:25:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestOnDeleteExpiryBucketOp (204.80s)
=== RUN   TestTimerOverWriteSameReference
2022/01/03 20:25:28 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2022/01/03 20:25:28 App: TestTimerOverWriteSameReference got un-deployed
2022/01/03 20:25:28 No eventing-con process running
2022/01/03 20:25:28 Function: TestTimerOverWriteSameReference delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestTimerOverWriteSameReference not found"
}
2022/01/03 20:25:30 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:25:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:25:37 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:25:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:25:42 Deploying app: TestTimerOverWriteSameReference. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:25:43 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverWriteSameReference stored in temp store"
}
2022/01/03 20:25:48 Waiting for app: TestTimerOverWriteSameReference to get deployed
2022/01/03 20:25:53 Waiting for app: TestTimerOverWriteSameReference to get deployed
2022/01/03 20:25:58 Waiting for app: TestTimerOverWriteSameReference to get deployed
2022/01/03 20:26:03 Waiting for app: TestTimerOverWriteSameReference to get deployed
2022/01/03 20:26:03 App: TestTimerOverWriteSameReference got deployed
2022/01/03 20:26:13 Starting bucket ops to source bucket
2022/01/03 20:27:14 src & dst bucket item count matched up. src bucket count: 1 dst bucket count: 1
2022/01/03 20:27:24 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:27:29 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2022/01/03 20:27:34 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2022/01/03 20:27:39 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2022/01/03 20:27:44 Waiting for app: TestTimerOverWriteSameReference to get un-deployed
2022/01/03 20:27:44 App: TestTimerOverWriteSameReference got un-deployed
2022/01/03 20:27:44 No eventing-con process running
2022/01/03 20:27:44 Function: TestTimerOverWriteSameReference delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestTimerOverWriteSameReference deleting in background"
}
2022/01/03 20:27:46 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:27:56 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/03 20:27:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:27:58 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:28:08 Waiting for dst bucket item count to get to: 0 curr count: 1
2022/01/03 20:28:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestTimerOverWriteSameReference (164.99s)
=== RUN   TestCancelTimerBucketop
2022/01/03 20:28:13 Waiting for app: TestCancelTimerBucketop to get un-deployed
2022/01/03 20:28:13 App: TestCancelTimerBucketop got un-deployed
2022/01/03 20:28:13 No eventing-con process running
2022/01/03 20:28:13 Function: TestCancelTimerBucketop delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCancelTimerBucketop not found"
}
2022/01/03 20:28:15 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:28:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:28:22 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:28:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:28:27 Deploying app: TestCancelTimerBucketop. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:28:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCancelTimerBucketop stored in temp store"
}
2022/01/03 20:28:33 Waiting for app: TestCancelTimerBucketop to get deployed
2022/01/03 20:28:38 Waiting for app: TestCancelTimerBucketop to get deployed
2022/01/03 20:28:43 Waiting for app: TestCancelTimerBucketop to get deployed
2022/01/03 20:28:48 Waiting for app: TestCancelTimerBucketop to get deployed
2022/01/03 20:28:48 App: TestCancelTimerBucketop got deployed
2022/01/03 20:28:48 Starting bucket ops to source bucket
2022/01/03 20:28:55 Starting bucket ops to source bucket
2022/01/03 20:29:57 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2022/01/03 20:29:57 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:30:03 Waiting for app: TestCancelTimerBucketop to get un-deployed
2022/01/03 20:30:08 Waiting for app: TestCancelTimerBucketop to get un-deployed
2022/01/03 20:30:13 Waiting for app: TestCancelTimerBucketop to get un-deployed
2022/01/03 20:30:13 App: TestCancelTimerBucketop got un-deployed
2022/01/03 20:30:13 No eventing-con process running
2022/01/03 20:30:13 Function: TestCancelTimerBucketop delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCancelTimerBucketop deleting in background"
}
2022/01/03 20:30:15 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:30:25 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/03 20:30:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:30:26 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:30:36 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/03 20:30:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCancelTimerBucketop (148.46s)
=== RUN   TestJSExpiryDate
2022/01/03 20:30:42 Starting bucket ops to source bucket
2022/01/03 20:30:54 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 20:30:54 Deploying app: TestJSExpiryDate. Item count src bucket: 5000 dst bucket: 0
2022/01/03 20:30:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestJSExpiryDate stored in temp store"
}
2022/01/03 20:31:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:31:26 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:31:31 Waiting for app: TestJSExpiryDate to get un-deployed
2022/01/03 20:31:36 Waiting for app: TestJSExpiryDate to get un-deployed
2022/01/03 20:31:41 Waiting for app: TestJSExpiryDate to get un-deployed
2022/01/03 20:31:46 Waiting for app: TestJSExpiryDate to get un-deployed
2022/01/03 20:31:46 App: TestJSExpiryDate got un-deployed
2022/01/03 20:31:46 No eventing-con process running
2022/01/03 20:31:46 Function: TestJSExpiryDate delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestJSExpiryDate deleting in background"
}
2022/01/03 20:31:48 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:31:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:31:55 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:32:00 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestJSExpiryDate (83.82s)
=== RUN   TestBinaryDoc
2022/01/03 20:32:05 Starting bucket ops to source bucket
2022/01/03 20:32:05 Deploying app: TestBinaryDoc. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:32:07 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBinaryDoc stored in temp store"
}
2022/01/03 20:32:07 Starting bucket ops to source bucket
2022/01/03 20:32:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:32:07 Deleting source bucket docs now
2022/01/03 20:32:07 Starting bucket ops to source bucket
2022/01/03 20:32:44 Waiting for dst bucket item count to get to: 32 curr count: 21
2022/01/03 20:32:49 Waiting for dst bucket item count to get to: 32 curr count: 31
2022/01/03 20:32:54 Waiting for dst bucket item count to get to: 32 curr count: 31
2022/01/03 20:32:54 src & dst bucket item count matched up. src bucket count: 32 dst bucket count: 32
2022/01/03 20:32:54 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:32:59 Waiting for app: TestBinaryDoc to get un-deployed
2022/01/03 20:33:04 Waiting for app: TestBinaryDoc to get un-deployed
2022/01/03 20:33:09 Waiting for app: TestBinaryDoc to get un-deployed
2022/01/03 20:33:14 Waiting for app: TestBinaryDoc to get un-deployed
2022/01/03 20:33:14 App: TestBinaryDoc got un-deployed
2022/01/03 20:33:14 No eventing-con process running
2022/01/03 20:33:14 Function: TestBinaryDoc delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestBinaryDoc deleting in background"
}
2022/01/03 20:33:16 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:33:26 Waiting for dst bucket item count to get to: 0 curr count: 32
2022/01/03 20:33:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:33:28 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:33:38 Waiting for dst bucket item count to get to: 0 curr count: 16
2022/01/03 20:33:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBinaryDoc (97.33s)
=== RUN   TestConstantBindings
2022/01/03 20:33:38 Deploying app: TestConstantBindings. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:33:39 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestConstantBindings stored in temp store"
}
2022/01/03 20:33:39 Starting bucket ops to source bucket
2022/01/03 20:33:44 Waiting for dst bucket item count to get to: 6000 curr count: 0
2022/01/03 20:33:49 Waiting for dst bucket item count to get to: 6000 curr count: 0
2022/01/03 20:33:54 Waiting for dst bucket item count to get to: 6000 curr count: 0
2022/01/03 20:33:59 Waiting for dst bucket item count to get to: 6000 curr count: 0
2022/01/03 20:34:04 Waiting for dst bucket item count to get to: 6000 curr count: 3000
2022/01/03 20:34:04 src & dst bucket item count matched up. src bucket count: 6000 dst bucket count: 6000
2022/01/03 20:34:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:34:10 Waiting for app: TestConstantBindings to get un-deployed
2022/01/03 20:34:15 Waiting for app: TestConstantBindings to get un-deployed
2022/01/03 20:34:20 Waiting for app: TestConstantBindings to get un-deployed
2022/01/03 20:34:25 Waiting for app: TestConstantBindings to get un-deployed
2022/01/03 20:34:25 App: TestConstantBindings got un-deployed
2022/01/03 20:34:25 No eventing-con process running
2022/01/03 20:34:25 Function: TestConstantBindings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestConstantBindings deleting in background"
}
2022/01/03 20:34:27 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:34:37 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/03 20:34:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:34:38 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:34:48 Waiting for dst bucket item count to get to: 0 curr count: 5121
2022/01/03 20:34:53 Waiting for dst bucket item count to get to: 0 curr count: 2121
2022/01/03 20:34:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestConstantBindings (75.73s)
=== RUN   TestCodeInsight
2022/01/03 20:34:58 Waiting for app: TestCodeInsight to get un-deployed
2022/01/03 20:34:58 App: TestCodeInsight got un-deployed
2022/01/03 20:34:58 No eventing-con process running
2022/01/03 20:34:58 Function: TestCodeInsight delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestCodeInsight not found"
}
2022/01/03 20:35:00 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:35:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:35:07 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:35:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:35:12 Starting bucket ops to source bucket
2022/01/03 20:35:13 Deploying app: TestCodeInsight. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:35:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCodeInsight stored in temp store"
}
2022/01/03 20:35:19 Waiting for app: TestCodeInsight to get deployed
2022/01/03 20:35:24 Waiting for app: TestCodeInsight to get deployed
2022/01/03 20:35:29 Waiting for app: TestCodeInsight to get deployed
2022/01/03 20:35:34 Waiting for app: TestCodeInsight to get deployed
2022/01/03 20:35:34 App: TestCodeInsight got deployed
2022/01/03 20:35:34 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2022/01/03 20:35:39 Waiting for app: TestCodeInsight to get un-deployed
2022/01/03 20:35:44 Waiting for app: TestCodeInsight to get un-deployed
2022/01/03 20:35:49 Waiting for app: TestCodeInsight to get un-deployed
2022/01/03 20:35:54 Waiting for app: TestCodeInsight to get un-deployed
2022/01/03 20:35:54 App: TestCodeInsight got un-deployed
2022/01/03 20:35:54 No eventing-con process running
2022/01/03 20:35:54 Function: TestCodeInsight delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestCodeInsight deleting in background"
}
2022/01/03 20:35:56 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:36:06 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/03 20:36:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:36:08 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:36:18 Waiting for dst bucket item count to get to: 0 curr count: 623
2022/01/03 20:36:23 Waiting for dst bucket item count to get to: 0 curr count: 123
2022/01/03 20:36:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestCodeInsight (89.48s)
=== RUN   TestParserTransform
--- PASS: TestParserTransform (0.04s)
=== RUN   TestParserDetect
--- PASS: TestParserDetect (0.00s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	12618.042s

Functional tests took 3 hours, 30 minutes and 21 seconds.

N1ql tests

2022/01/03 20:36:31 Started n1ql
2022/01/03 20:36:42 Adding node: https://127.0.0.1:19001 with role: kv,index,n1ql to the cluster
2022/01/03 20:36:42 Error in adding nodes : , response: ["Prepare join failed. Node is already part of cluster."]
2022/01/03 20:36:42 Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 20:36:42 Removing node(s): [] from the cluster
2022/01/03 20:36:48 Rebalance progress: 100
=== RUN   TestRecursiveMutationN1QL
2022/01/03 20:36:53 Waiting for app: TestRecursiveMutationN1QL to get un-deployed
2022/01/03 20:36:53 App: TestRecursiveMutationN1QL got un-deployed
2022/01/03 20:36:53 No eventing-con process running
2022/01/03 20:36:53 Function: TestRecursiveMutationN1QL delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestRecursiveMutationN1QL not found"
}
2022/01/03 20:36:54 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:36:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:37:01 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:37:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:37:06 Deploying app: TestRecursiveMutationN1QL. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:37:06 Context: Post to main store, response code: 400 dump: {
 "name": "ERR_INTER_BUCKET_RECURSION",
 "code": 51,
 "description": "Function: TestRecursiveMutationN1QL N1QL DML to source keyspace default:default"
}
--- PASS: TestRecursiveMutationN1QL (18.64s)
=== RUN   TestFlexReset1
2022/01/03 20:37:11 Waiting for app: TestFlexReset1 to get un-deployed
2022/01/03 20:37:11 App: TestFlexReset1 got un-deployed
2022/01/03 20:37:11 No eventing-con process running
2022/01/03 20:37:11 Function: TestFlexReset1 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestFlexReset1 not found"
}
2022/01/03 20:37:13 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:37:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:37:20 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:37:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:37:25 Starting bucket ops to source bucket
2022/01/03 20:37:25 Deploying app: TestFlexReset1. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:37:27 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset1 stored in temp store"
}
2022/01/03 20:37:32 Waiting for app: TestFlexReset1 to get deployed
2022/01/03 20:37:37 Waiting for app: TestFlexReset1 to get deployed
2022/01/03 20:37:42 Waiting for app: TestFlexReset1 to get deployed
2022/01/03 20:37:47 Waiting for app: TestFlexReset1 to get deployed
2022/01/03 20:37:47 App: TestFlexReset1 got deployed
2022/01/03 20:37:52 Waiting for dst bucket item count to get to: 1000 curr count: 61
2022/01/03 20:37:52 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2022/01/03 20:37:52 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:37:57 Waiting for app: TestFlexReset1 to get un-deployed
2022/01/03 20:38:02 Waiting for app: TestFlexReset1 to get un-deployed
2022/01/03 20:38:07 Waiting for app: TestFlexReset1 to get un-deployed
2022/01/03 20:38:12 Waiting for app: TestFlexReset1 to get un-deployed
2022/01/03 20:38:12 App: TestFlexReset1 got un-deployed
2022/01/03 20:38:12 No eventing-con process running
2022/01/03 20:38:12 Function: TestFlexReset1 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset1 deleting in background"
}
2022/01/03 20:38:14 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:38:24 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/03 20:38:29 Waiting for dst bucket item count to get to: 0 curr count: 500
2022/01/03 20:38:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:38:31 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:38:41 Waiting for dst bucket item count to get to: 0 curr count: 849
2022/01/03 20:38:46 Waiting for dst bucket item count to get to: 0 curr count: 849
2022/01/03 20:38:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestFlexReset1 (99.43s)
=== RUN   TestFlexReset2
2022/01/03 20:38:51 Waiting for app: TestFlexReset2 to get un-deployed
2022/01/03 20:38:51 App: TestFlexReset2 got un-deployed
2022/01/03 20:38:51 No eventing-con process running
2022/01/03 20:38:51 Function: TestFlexReset2 delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestFlexReset2 not found"
}
2022/01/03 20:38:52 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:38:57 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:38:59 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:39:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:39:04 Starting bucket ops to source bucket
2022/01/03 20:39:05 Deploying app: TestFlexReset2. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:39:06 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset2 stored in temp store"
}
2022/01/03 20:39:11 Waiting for app: TestFlexReset2 to get deployed
2022/01/03 20:39:16 Waiting for app: TestFlexReset2 to get deployed
2022/01/03 20:39:21 Waiting for app: TestFlexReset2 to get deployed
2022/01/03 20:39:26 Waiting for app: TestFlexReset2 to get deployed
2022/01/03 20:39:26 App: TestFlexReset2 got deployed
2022/01/03 20:39:31 Waiting for dst bucket item count to get to: 1000 curr count: 220
2022/01/03 20:39:31 src & dst bucket item count matched up. src bucket count: 1000 dst bucket count: 1000
2022/01/03 20:39:31 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:39:36 Waiting for app: TestFlexReset2 to get un-deployed
2022/01/03 20:39:41 Waiting for app: TestFlexReset2 to get un-deployed
2022/01/03 20:39:46 Waiting for app: TestFlexReset2 to get un-deployed
2022/01/03 20:39:51 Waiting for app: TestFlexReset2 to get un-deployed
2022/01/03 20:39:51 App: TestFlexReset2 got un-deployed
2022/01/03 20:39:51 No eventing-con process running
2022/01/03 20:39:51 Function: TestFlexReset2 delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestFlexReset2 deleting in background"
}
2022/01/03 20:39:53 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:40:03 Waiting for dst bucket item count to get to: 0 curr count: 1000
2022/01/03 20:40:08 Waiting for dst bucket item count to get to: 0 curr count: 500
2022/01/03 20:40:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:40:10 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:40:20 Waiting for dst bucket item count to get to: 0 curr count: 602
2022/01/03 20:40:25 Waiting for dst bucket item count to get to: 0 curr count: 602
2022/01/03 20:40:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestFlexReset2 (99.29s)
=== RUN   TestN1QLLabelledBreak
2022/01/03 20:40:30 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2022/01/03 20:40:30 App: TestN1QLLabelledBreak got un-deployed
2022/01/03 20:40:30 No eventing-con process running
2022/01/03 20:40:30 Function: TestN1QLLabelledBreak delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLLabelledBreak not found"
}
2022/01/03 20:40:32 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:40:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:40:38 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:40:43 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:40:43 Deploying app: TestN1QLLabelledBreak. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:40:45 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLLabelledBreak stored in temp store"
}
2022/01/03 20:40:50 Waiting for app: TestN1QLLabelledBreak to get deployed
2022/01/03 20:40:55 Waiting for app: TestN1QLLabelledBreak to get deployed
2022/01/03 20:41:00 Waiting for app: TestN1QLLabelledBreak to get deployed
2022/01/03 20:41:05 Waiting for app: TestN1QLLabelledBreak to get deployed
2022/01/03 20:41:05 App: TestN1QLLabelledBreak got deployed
2022/01/03 20:41:05 Starting bucket ops to source bucket
2022/01/03 20:41:14 Waiting for dst bucket item count to get to: 10000 curr count: 0
2022/01/03 20:41:19 Waiting for dst bucket item count to get to: 10000 curr count: 157
2022/01/03 20:41:24 Waiting for dst bucket item count to get to: 10000 curr count: 472
2022/01/03 20:41:29 Waiting for dst bucket item count to get to: 10000 curr count: 2198
2022/01/03 20:41:34 Waiting for dst bucket item count to get to: 10000 curr count: 4194
2022/01/03 20:41:39 Waiting for dst bucket item count to get to: 10000 curr count: 8280
2022/01/03 20:41:44 Waiting for dst bucket item count to get to: 10000 curr count: 8280
2022/01/03 20:41:44 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 20:41:44 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:41:49 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2022/01/03 20:41:54 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2022/01/03 20:41:59 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2022/01/03 20:42:04 Waiting for app: TestN1QLLabelledBreak to get un-deployed
2022/01/03 20:42:04 App: TestN1QLLabelledBreak got un-deployed
2022/01/03 20:42:04 No eventing-con process running
2022/01/03 20:42:04 Function: TestN1QLLabelledBreak delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLLabelledBreak deleting in background"
}
2022/01/03 20:42:06 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:42:16 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 20:42:16 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:42:18 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:42:28 Waiting for dst bucket item count to get to: 0 curr count: 6913
2022/01/03 20:42:33 Waiting for dst bucket item count to get to: 0 curr count: 1913
2022/01/03 20:42:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLLabelledBreak (128.08s)
=== RUN   TestN1QLUnlabelledBreak
2022/01/03 20:42:38 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2022/01/03 20:42:38 App: TestN1QLUnlabelledBreak got un-deployed
2022/01/03 20:42:38 No eventing-con process running
2022/01/03 20:42:38 Function: TestN1QLUnlabelledBreak delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLUnlabelledBreak not found"
}
2022/01/03 20:42:40 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:42:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:42:47 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:42:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:42:52 Deploying app: TestN1QLUnlabelledBreak. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:42:53 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLUnlabelledBreak stored in temp store"
}
2022/01/03 20:42:58 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2022/01/03 20:43:03 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2022/01/03 20:43:08 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2022/01/03 20:43:13 Waiting for app: TestN1QLUnlabelledBreak to get deployed
2022/01/03 20:43:13 App: TestN1QLUnlabelledBreak got deployed
2022/01/03 20:43:13 Starting bucket ops to source bucket
2022/01/03 20:43:22 Waiting for dst bucket item count to get to: 10000 curr count: 0
2022/01/03 20:43:27 Waiting for dst bucket item count to get to: 10000 curr count: 0
2022/01/03 20:43:32 Waiting for dst bucket item count to get to: 10000 curr count: 1578
2022/01/03 20:43:37 Waiting for dst bucket item count to get to: 10000 curr count: 1578
2022/01/03 20:43:42 Waiting for dst bucket item count to get to: 10000 curr count: 7299
2022/01/03 20:43:47 Waiting for dst bucket item count to get to: 10000 curr count: 8948
2022/01/03 20:43:47 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 20:43:47 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:43:52 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2022/01/03 20:43:57 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2022/01/03 20:44:02 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2022/01/03 20:44:07 Waiting for app: TestN1QLUnlabelledBreak to get un-deployed
2022/01/03 20:44:07 App: TestN1QLUnlabelledBreak got un-deployed
2022/01/03 20:44:07 No eventing-con process running
2022/01/03 20:44:07 Function: TestN1QLUnlabelledBreak delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLUnlabelledBreak deleting in background"
}
2022/01/03 20:44:09 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:44:19 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 20:44:24 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/03 20:44:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:44:26 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:44:36 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/03 20:44:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLUnlabelledBreak (123.09s)
=== RUN   TestN1QLThrowStatement
2022/01/03 20:44:41 Waiting for app: TestN1QLThrowStatement to get un-deployed
2022/01/03 20:44:41 App: TestN1QLThrowStatement got un-deployed
2022/01/03 20:44:41 No eventing-con process running
2022/01/03 20:44:41 Function: TestN1QLThrowStatement delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLThrowStatement not found"
}
2022/01/03 20:44:43 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:44:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:44:50 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:44:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:44:55 Deploying app: TestN1QLThrowStatement. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:44:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLThrowStatement stored in temp store"
}
2022/01/03 20:45:01 Waiting for app: TestN1QLThrowStatement to get deployed
2022/01/03 20:45:06 Waiting for app: TestN1QLThrowStatement to get deployed
2022/01/03 20:45:11 Waiting for app: TestN1QLThrowStatement to get deployed
2022/01/03 20:45:16 Waiting for app: TestN1QLThrowStatement to get deployed
2022/01/03 20:45:16 App: TestN1QLThrowStatement got deployed
2022/01/03 20:45:16 Starting bucket ops to source bucket
2022/01/03 20:45:26 Waiting for dst bucket item count to get to: 10000 curr count: 296
2022/01/03 20:45:31 Waiting for dst bucket item count to get to: 10000 curr count: 296
2022/01/03 20:45:36 Waiting for dst bucket item count to get to: 10000 curr count: 3596
2022/01/03 20:45:41 Waiting for dst bucket item count to get to: 10000 curr count: 3596
2022/01/03 20:45:46 Waiting for dst bucket item count to get to: 10000 curr count: 5595
2022/01/03 20:45:51 Waiting for dst bucket item count to get to: 10000 curr count: 7592
2022/01/03 20:45:56 Waiting for dst bucket item count to get to: 10000 curr count: 7592
2022/01/03 20:45:56 src & dst bucket item count matched up. src bucket count: 10000 dst bucket count: 10000
2022/01/03 20:45:56 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:46:01 Waiting for app: TestN1QLThrowStatement to get un-deployed
2022/01/03 20:46:06 Waiting for app: TestN1QLThrowStatement to get un-deployed
2022/01/03 20:46:11 Waiting for app: TestN1QLThrowStatement to get un-deployed
2022/01/03 20:46:16 Waiting for app: TestN1QLThrowStatement to get un-deployed
2022/01/03 20:46:16 App: TestN1QLThrowStatement got un-deployed
2022/01/03 20:46:16 No eventing-con process running
2022/01/03 20:46:16 Function: TestN1QLThrowStatement delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLThrowStatement deleting in background"
}
2022/01/03 20:46:18 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:46:28 Waiting for dst bucket item count to get to: 0 curr count: 3326
2022/01/03 20:46:33 Waiting for dst bucket item count to get to: 0 curr count: 826
2022/01/03 20:46:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:46:35 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:46:45 Waiting for dst bucket item count to get to: 0 curr count: 10000
2022/01/03 20:46:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLThrowStatement (128.62s)
=== RUN   TestN1QLNestedForLoop
2022/01/03 20:46:50 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2022/01/03 20:46:50 App: TestN1QLNestedForLoop got un-deployed
2022/01/03 20:46:50 No eventing-con process running
2022/01/03 20:46:50 Function: TestN1QLNestedForLoop delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLNestedForLoop not found"
}
2022/01/03 20:46:51 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:46:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:46:58 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:47:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:47:03 Deploying app: TestN1QLNestedForLoop. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:47:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLNestedForLoop stored in temp store"
}
2022/01/03 20:47:09 Waiting for app: TestN1QLNestedForLoop to get deployed
2022/01/03 20:47:14 Waiting for app: TestN1QLNestedForLoop to get deployed
2022/01/03 20:47:19 Waiting for app: TestN1QLNestedForLoop to get deployed
2022/01/03 20:47:25 Waiting for app: TestN1QLNestedForLoop to get deployed
2022/01/03 20:47:25 App: TestN1QLNestedForLoop got deployed
2022/01/03 20:47:25 Starting bucket ops to source bucket
2022/01/03 20:47:34 Waiting for dst bucket item count to get to: 5000 curr count: 90
2022/01/03 20:47:39 Waiting for dst bucket item count to get to: 5000 curr count: 90
2022/01/03 20:47:44 Waiting for dst bucket item count to get to: 5000 curr count: 281
2022/01/03 20:47:49 Waiting for dst bucket item count to get to: 5000 curr count: 1317
2022/01/03 20:47:54 Waiting for dst bucket item count to get to: 5000 curr count: 2509
2022/01/03 20:47:59 Waiting for dst bucket item count to get to: 5000 curr count: 3710
2022/01/03 20:48:04 Waiting for dst bucket item count to get to: 5000 curr count: 4827
2022/01/03 20:48:04 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 20:48:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:48:09 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2022/01/03 20:48:14 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2022/01/03 20:48:19 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2022/01/03 20:48:24 Waiting for app: TestN1QLNestedForLoop to get un-deployed
2022/01/03 20:48:24 App: TestN1QLNestedForLoop got un-deployed
2022/01/03 20:48:24 No eventing-con process running
2022/01/03 20:48:24 Function: TestN1QLNestedForLoop delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLNestedForLoop deleting in background"
}
2022/01/03 20:48:26 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:48:36 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 20:48:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:48:38 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:48:48 Waiting for dst bucket item count to get to: 0 curr count: 3445
2022/01/03 20:48:53 Waiting for dst bucket item count to get to: 0 curr count: 945
2022/01/03 20:48:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLNestedForLoop (128.25s)
=== RUN   TestN1QLAutoClose
2022/01/03 20:48:58 Waiting for app: TestN1QLAutoClose to get un-deployed
2022/01/03 20:48:58 App: TestN1QLAutoClose got un-deployed
2022/01/03 20:48:58 No eventing-con process running
2022/01/03 20:48:58 Function: TestN1QLAutoClose delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLAutoClose not found"
}
2022/01/03 20:49:00 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:49:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:49:06 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:49:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:49:11 Deploying app: TestN1QLAutoClose. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:49:13 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAutoClose stored in temp store"
}
2022/01/03 20:49:18 Waiting for app: TestN1QLAutoClose to get deployed
2022/01/03 20:49:23 Waiting for app: TestN1QLAutoClose to get deployed
2022/01/03 20:49:28 Waiting for app: TestN1QLAutoClose to get deployed
2022/01/03 20:49:33 Waiting for app: TestN1QLAutoClose to get deployed
2022/01/03 20:49:33 App: TestN1QLAutoClose got deployed
2022/01/03 20:49:33 Starting bucket ops to source bucket
2022/01/03 20:49:38 Waiting for dst bucket item count to get to: 500 curr count: 0
2022/01/03 20:49:43 Waiting for dst bucket item count to get to: 500 curr count: 0
2022/01/03 20:49:48 Waiting for dst bucket item count to get to: 500 curr count: 10
2022/01/03 20:49:53 Waiting for dst bucket item count to get to: 500 curr count: 10
2022/01/03 20:49:58 Waiting for dst bucket item count to get to: 500 curr count: 32
2022/01/03 20:50:03 Waiting for dst bucket item count to get to: 500 curr count: 44
2022/01/03 20:50:08 Waiting for dst bucket item count to get to: 500 curr count: 56
2022/01/03 20:50:13 Waiting for dst bucket item count to get to: 500 curr count: 65
2022/01/03 20:50:18 Waiting for dst bucket item count to get to: 500 curr count: 77
2022/01/03 20:50:23 Waiting for dst bucket item count to get to: 500 curr count: 90
2022/01/03 20:50:28 Waiting for dst bucket item count to get to: 500 curr count: 101
2022/01/03 20:50:33 Waiting for dst bucket item count to get to: 500 curr count: 110
2022/01/03 20:50:38 Waiting for dst bucket item count to get to: 500 curr count: 122
2022/01/03 20:50:43 Waiting for dst bucket item count to get to: 500 curr count: 122
2022/01/03 20:50:48 Waiting for dst bucket item count to get to: 500 curr count: 131
2022/01/03 20:50:53 Waiting for dst bucket item count to get to: 500 curr count: 143
2022/01/03 20:50:58 Waiting for dst bucket item count to get to: 500 curr count: 155
2022/01/03 20:51:03 Waiting for dst bucket item count to get to: 500 curr count: 165
2022/01/03 20:51:08 Waiting for dst bucket item count to get to: 500 curr count: 176
2022/01/03 20:51:13 Waiting for dst bucket item count to get to: 500 curr count: 188
2022/01/03 20:51:18 Waiting for dst bucket item count to get to: 500 curr count: 198
2022/01/03 20:51:23 Waiting for dst bucket item count to get to: 500 curr count: 210
2022/01/03 20:51:29 Waiting for dst bucket item count to get to: 500 curr count: 221
2022/01/03 20:51:34 Waiting for dst bucket item count to get to: 500 curr count: 233
2022/01/03 20:51:39 Waiting for dst bucket item count to get to: 500 curr count: 242
2022/01/03 20:51:44 Waiting for dst bucket item count to get to: 500 curr count: 254
2022/01/03 20:51:49 Waiting for dst bucket item count to get to: 500 curr count: 275
2022/01/03 20:51:54 Waiting for dst bucket item count to get to: 500 curr count: 275
2022/01/03 20:51:59 Waiting for dst bucket item count to get to: 500 curr count: 296
2022/01/03 20:52:04 Waiting for dst bucket item count to get to: 500 curr count: 296
2022/01/03 20:52:09 Waiting for dst bucket item count to get to: 500 curr count: 317
2022/01/03 20:52:14 Waiting for dst bucket item count to get to: 500 curr count: 317
2022/01/03 20:52:19 Waiting for dst bucket item count to get to: 500 curr count: 337
2022/01/03 20:52:24 Waiting for dst bucket item count to get to: 500 curr count: 337
2022/01/03 20:52:29 Waiting for dst bucket item count to get to: 500 curr count: 358
2022/01/03 20:52:34 Waiting for dst bucket item count to get to: 500 curr count: 358
2022/01/03 20:52:39 Waiting for dst bucket item count to get to: 500 curr count: 379
2022/01/03 20:52:44 Waiting for dst bucket item count to get to: 500 curr count: 379
2022/01/03 20:52:49 Waiting for dst bucket item count to get to: 500 curr count: 400
2022/01/03 20:52:54 Waiting for dst bucket item count to get to: 500 curr count: 400
2022/01/03 20:52:59 Waiting for dst bucket item count to get to: 500 curr count: 421
2022/01/03 20:53:04 Waiting for dst bucket item count to get to: 500 curr count: 421
2022/01/03 20:53:09 Waiting for dst bucket item count to get to: 500 curr count: 443
2022/01/03 20:53:14 Waiting for dst bucket item count to get to: 500 curr count: 443
2022/01/03 20:53:19 Waiting for dst bucket item count to get to: 500 curr count: 465
2022/01/03 20:53:24 Waiting for dst bucket item count to get to: 500 curr count: 465
2022/01/03 20:53:29 Waiting for dst bucket item count to get to: 500 curr count: 488
2022/01/03 20:53:34 Waiting for dst bucket item count to get to: 500 curr count: 488
2022/01/03 20:53:34 src & dst bucket item count matched up. src bucket count: 500 dst bucket count: 500
2022/01/03 20:53:34 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:53:39 Waiting for app: TestN1QLAutoClose to get un-deployed
2022/01/03 20:53:44 Waiting for app: TestN1QLAutoClose to get un-deployed
2022/01/03 20:53:49 Waiting for app: TestN1QLAutoClose to get un-deployed
2022/01/03 20:53:54 Waiting for app: TestN1QLAutoClose to get un-deployed
2022/01/03 20:53:54 App: TestN1QLAutoClose got un-deployed
2022/01/03 20:53:54 No eventing-con process running
2022/01/03 20:53:54 Function: TestN1QLAutoClose delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLAutoClose deleting in background"
}
2022/01/03 20:53:56 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:54:06 Waiting for dst bucket item count to get to: 0 curr count: 500
2022/01/03 20:54:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:54:08 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:54:18 Waiting for dst bucket item count to get to: 0 curr count: 250
2022/01/03 20:54:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLAutoClose (324.58s)
=== RUN   TestN1QLPosParams
2022/01/03 20:54:23 Waiting for app: TestN1QLPosParams to get un-deployed
2022/01/03 20:54:23 App: TestN1QLPosParams got un-deployed
2022/01/03 20:54:23 No eventing-con process running
2022/01/03 20:54:23 Function: TestN1QLPosParams delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLPosParams not found"
}
2022/01/03 20:54:24 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:54:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:54:31 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:54:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:54:36 Deploying app: TestN1QLPosParams. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:54:37 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLPosParams stored in temp store"
}
2022/01/03 20:54:42 Waiting for app: TestN1QLPosParams to get deployed
2022/01/03 20:54:47 Waiting for app: TestN1QLPosParams to get deployed
2022/01/03 20:54:52 Waiting for app: TestN1QLPosParams to get deployed
2022/01/03 20:54:57 Waiting for app: TestN1QLPosParams to get deployed
2022/01/03 20:54:57 App: TestN1QLPosParams got deployed
2022/01/03 20:54:57 Starting bucket ops to source bucket
2022/01/03 20:55:07 Waiting for dst bucket item count to get to: 5000 curr count: 309
2022/01/03 20:55:12 Waiting for dst bucket item count to get to: 5000 curr count: 309
2022/01/03 20:55:12 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 20:55:12 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:55:17 Waiting for app: TestN1QLPosParams to get un-deployed
2022/01/03 20:55:22 Waiting for app: TestN1QLPosParams to get un-deployed
2022/01/03 20:55:27 Waiting for app: TestN1QLPosParams to get un-deployed
2022/01/03 20:55:32 Waiting for app: TestN1QLPosParams to get un-deployed
2022/01/03 20:55:32 App: TestN1QLPosParams got un-deployed
2022/01/03 20:55:32 No eventing-con process running
2022/01/03 20:55:32 Function: TestN1QLPosParams delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLPosParams deleting in background"
}
2022/01/03 20:55:34 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:55:44 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 20:55:49 Waiting for dst bucket item count to get to: 0 curr count: 2500
2022/01/03 20:55:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:55:51 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:56:01 Waiting for dst bucket item count to get to: 0 curr count: 4518
2022/01/03 20:56:06 Waiting for dst bucket item count to get to: 0 curr count: 4518
2022/01/03 20:56:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLPosParams (108.26s)
=== RUN   TestN1QLExhaustConnPool
2022/01/03 20:56:11 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2022/01/03 20:56:11 App: TestN1QLExhaustConnPool got un-deployed
2022/01/03 20:56:11 No eventing-con process running
2022/01/03 20:56:11 Function: TestN1QLExhaustConnPool delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLExhaustConnPool not found"
}
2022/01/03 20:56:13 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:56:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:56:19 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:56:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:56:24 Deploying app: TestN1QLExhaustConnPool. Item count src bucket: 0 dst bucket: 0
2022/01/03 20:56:25 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLExhaustConnPool stored in temp store"
}
2022/01/03 20:56:30 Waiting for app: TestN1QLExhaustConnPool to get deployed
2022/01/03 20:56:36 Waiting for app: TestN1QLExhaustConnPool to get deployed
2022/01/03 20:56:41 Waiting for app: TestN1QLExhaustConnPool to get deployed
2022/01/03 20:56:46 Waiting for app: TestN1QLExhaustConnPool to get deployed
2022/01/03 20:56:46 App: TestN1QLExhaustConnPool got deployed
2022/01/03 20:56:46 Starting bucket ops to source bucket
2022/01/03 20:56:51 Waiting for dst bucket item count to get to: 100 curr count: 0
2022/01/03 20:56:56 Waiting for dst bucket item count to get to: 100 curr count: 71
2022/01/03 20:57:01 Waiting for dst bucket item count to get to: 100 curr count: 71
2022/01/03 20:57:01 src & dst bucket item count matched up. src bucket count: 100 dst bucket count: 100
2022/01/03 20:57:01 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 20:57:06 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2022/01/03 20:57:11 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2022/01/03 20:57:16 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2022/01/03 20:57:21 Waiting for app: TestN1QLExhaustConnPool to get un-deployed
2022/01/03 20:57:21 App: TestN1QLExhaustConnPool got un-deployed
2022/01/03 20:57:21 No eventing-con process running
2022/01/03 20:57:21 Function: TestN1QLExhaustConnPool delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLExhaustConnPool deleting in background"
}
2022/01/03 20:57:23 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:57:33 Waiting for dst bucket item count to get to: 0 curr count: 100
2022/01/03 20:57:38 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 20:57:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:57:40 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:57:50 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 20:57:55 Waiting for dst bucket item count to get to: 0 curr count: 50
2022/01/03 20:57:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLExhaustConnPool (108.80s)
=== RUN   TestN1QLGraceSufficientTimeOut
2022/01/03 20:58:00 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2022/01/03 20:58:00 App: TestN1QLGraceSufficientTimeOut got un-deployed
2022/01/03 20:58:00 No eventing-con process running
2022/01/03 20:58:00 Function: TestN1QLGraceSufficientTimeOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestN1QLGraceSufficientTimeOut not found"
}
2022/01/03 20:58:01 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:58:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:58:08 Context: Bucket flush, response code: 200 dump: 
2022/01/03 20:58:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 20:58:13 Starting bucket ops to source bucket
2022/01/03 20:58:30 Starting bucket ops to source bucket
2022/01/03 20:58:48 Deploying app: TestN1QLGraceSufficientTimeOut. Item count src bucket: 30000 dst bucket: 13705
2022/01/03 20:58:49 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLGraceSufficientTimeOut stored in temp store"
}
2022/01/03 20:58:54 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2022/01/03 20:58:59 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2022/01/03 20:59:04 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2022/01/03 20:59:09 Waiting for app: TestN1QLGraceSufficientTimeOut to get deployed
2022/01/03 20:59:09 App: TestN1QLGraceSufficientTimeOut got deployed
2022/01/03 20:59:09 Starting bucket ops to source bucket
2022/01/03 20:59:14 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 20:59:19 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 20:59:24 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 20:59:29 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 20:59:34 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 20:59:39 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 20:59:44 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 20:59:49 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 20:59:54 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 20:59:59 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 21:00:04 Waiting for dst bucket item count to get to: 30001 curr count: 30000
2022/01/03 21:00:04 src & dst bucket item count matched up. src bucket count: 30001 dst bucket count: 30001
2022/01/03 21:00:04 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 21:00:09 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2022/01/03 21:00:14 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2022/01/03 21:00:19 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2022/01/03 21:00:24 Waiting for app: TestN1QLGraceSufficientTimeOut to get un-deployed
2022/01/03 21:00:24 App: TestN1QLGraceSufficientTimeOut got un-deployed
2022/01/03 21:00:24 No eventing-con process running
2022/01/03 21:00:24 Function: TestN1QLGraceSufficientTimeOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestN1QLGraceSufficientTimeOut deleting in background"
}
2022/01/03 21:00:26 Context: Bucket flush, response code: 200 dump: 
2022/01/03 21:00:36 Waiting for dst bucket item count to get to: 0 curr count: 30000
2022/01/03 21:00:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:00:38 Context: Bucket flush, response code: 200 dump: 
2022/01/03 21:00:48 Waiting for dst bucket item count to get to: 0 curr count: 21872
2022/01/03 21:00:53 Waiting for dst bucket item count to get to: 0 curr count: 6872
2022/01/03 21:00:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLGraceSufficientTimeOut (178.49s)
=== RUN   TestN1QLQueryConsistency
2022/01/03 21:00:58 Waiting for app: n1qlquery_consistency to get un-deployed
2022/01/03 21:00:58 App: n1qlquery_consistency got un-deployed
2022/01/03 21:00:58 No eventing-con process running
2022/01/03 21:00:58 Function: n1qlquery_consistency delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: n1qlquery_consistency not found"
}
2022/01/03 21:01:00 Context: Bucket flush, response code: 200 dump: 
2022/01/03 21:01:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:01:07 Context: Bucket flush, response code: 200 dump: 
2022/01/03 21:01:12 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:01:12 Starting bucket ops to source bucket
2022/01/03 21:01:15 Deploying app: n1qlquery_consistency. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:01:16 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: n1qlquery_consistency stored in temp store"
}
2022/01/03 21:01:21 Waiting for app: n1qlquery_consistency to get deployed
2022/01/03 21:01:26 Waiting for app: n1qlquery_consistency to get deployed
2022/01/03 21:01:31 Waiting for app: n1qlquery_consistency to get deployed
2022/01/03 21:01:36 Waiting for app: n1qlquery_consistency to get deployed
2022/01/03 21:01:36 App: n1qlquery_consistency got deployed
2022/01/03 21:01:41 Waiting for dst bucket item count to get to: 5000 curr count: 307
2022/01/03 21:01:46 Waiting for dst bucket item count to get to: 5000 curr count: 307
2022/01/03 21:01:46 src & dst bucket item count matched up. src bucket count: 5000 dst bucket count: 5000
2022/01/03 21:01:46 http call resp: Get "http://127.0.0.1:9301/api/v1/stats": dial tcp 127.0.0.1:9301: connect: connection refused
2022/01/03 21:01:51 Waiting for app: n1qlquery_consistency to get un-deployed
2022/01/03 21:01:56 Waiting for app: n1qlquery_consistency to get un-deployed
2022/01/03 21:02:01 Waiting for app: n1qlquery_consistency to get un-deployed
2022/01/03 21:02:06 Waiting for app: n1qlquery_consistency to get un-deployed
2022/01/03 21:02:06 App: n1qlquery_consistency got un-deployed
2022/01/03 21:02:06 No eventing-con process running
2022/01/03 21:02:06 Function: n1qlquery_consistency delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: n1qlquery_consistency deleting in background"
}
2022/01/03 21:02:08 Context: Bucket flush, response code: 200 dump: 
2022/01/03 21:02:18 Waiting for dst bucket item count to get to: 0 curr count: 3333
2022/01/03 21:02:23 Waiting for dst bucket item count to get to: 0 curr count: 833
2022/01/03 21:02:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:02:25 Context: Bucket flush, response code: 200 dump: 
2022/01/03 21:02:35 Waiting for dst bucket item count to get to: 0 curr count: 5000
2022/01/03 21:02:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestN1QLQueryConsistency (101.71s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	1558.278s

N1ql tests took 0 hours, 26 minutes and 4 seconds.

Starting server
Starting server: attempt 1

Rebalance tests

2022/01/03 21:04:10 Started rebalance
Post "http://127.0.0.1:9000/pools/default": EOF
Quota setup Post "http://127.0.0.1:9000/pools/default": EOF
=== RUN   TestDuplicateWithEventingRebIn
2022/01/03 21:04:28 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
running apps fetch error json: cannot unmarshal number into Go value of type string
2022/01/03 21:04:33 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/01/03 21:04:33 App: TestDuplicateWithEventingRebIn got un-deployed
2022/01/03 21:04:33 No eventing-con process running
2022/01/03 21:04:33 Function: TestDuplicateWithEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingRebIn not found"
}
2022/01/03 21:04:35 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:04:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:04:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:04:42 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:04:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:04:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:04:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:04:52 Deploying app: TestDuplicateWithEventingRebIn. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:04:53 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebIn stored in temp store"
}
2022/01/03 21:04:58 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2022/01/03 21:05:03 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2022/01/03 21:05:08 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2022/01/03 21:05:13 Waiting for app: TestDuplicateWithEventingRebIn to get deployed
2022/01/03 21:05:13 App: TestDuplicateWithEventingRebIn got deployed
2022/01/03 21:05:13 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 21:05:13 Starting bucket ops to source bucket
2022/01/03 21:05:27 Removing node(s): [] from the cluster
2022/01/03 21:05:32 Rebalance progress: 0
2022/01/03 21:05:37 Rebalance progress: 0
2022/01/03 21:05:42 Rebalance progress: 25
2022/01/03 21:05:47 Rebalance progress: 25
2022/01/03 21:05:52 Rebalance progress: 25
2022/01/03 21:05:57 Rebalance progress: 98.5576923076923
2022/01/03 21:06:02 Rebalance progress: 98.5576923076923
2022/01/03 21:06:07 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:06:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:06:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:06:07 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2022/01/03 21:06:07 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 21:06:07 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 21:06:12 Rebalance progress: 25
2022/01/03 21:06:17 Rebalance progress: 25
2022/01/03 21:06:22 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:06:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:06:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:06:22 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2022/01/03 21:06:22 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 21:06:22 Waiting for src bucket item count to get to: 200000 curr count: 91495
2022/01/03 21:06:27 Waiting for src bucket item count to get to: 200000 curr count: 108369
2022/01/03 21:06:32 Waiting for src bucket item count to get to: 200000 curr count: 108369
2022/01/03 21:06:37 Waiting for src bucket item count to get to: 200000 curr count: 125239
2022/01/03 21:06:42 Waiting for src bucket item count to get to: 200000 curr count: 125239
2022/01/03 21:06:47 Waiting for src bucket item count to get to: 200000 curr count: 142179
2022/01/03 21:06:52 Waiting for src bucket item count to get to: 200000 curr count: 142179
2022/01/03 21:06:57 Waiting for src bucket item count to get to: 200000 curr count: 158800
2022/01/03 21:07:02 Waiting for src bucket item count to get to: 200000 curr count: 158800
2022/01/03 21:07:07 Waiting for src bucket item count to get to: 200000 curr count: 175408
2022/01/03 21:07:12 Waiting for src bucket item count to get to: 200000 curr count: 175408
2022/01/03 21:07:17 Waiting for src bucket item count to get to: 200000 curr count: 192309
2022/01/03 21:07:22 Waiting for src bucket item count to get to: 200000 curr count: 192309
2022/01/03 21:07:32 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/01/03 21:07:37 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/01/03 21:07:42 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/01/03 21:07:47 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/01/03 21:07:52 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/01/03 21:07:57 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/01/03 21:08:02 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/01/03 21:08:07 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/01/03 21:08:12 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/01/03 21:08:17 Waiting for dst bucket item count to get to: 200000 curr count: 200001
2022/01/03 21:08:17 Post SET ops. Expected item count: 200000 got 200001
2022/01/03 21:08:22 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/01/03 21:08:27 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/01/03 21:08:32 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/01/03 21:08:37 Waiting for app: TestDuplicateWithEventingRebIn to get un-deployed
2022/01/03 21:08:37 App: TestDuplicateWithEventingRebIn got un-deployed
2022/01/03 21:08:37 No eventing-con process running
2022/01/03 21:08:37 Function: TestDuplicateWithEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebIn deleting in background"
}
2022/01/03 21:08:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:08:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:08:49 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/03 21:08:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:08:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:08:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:09:01 Waiting for dst bucket item count to get to: 0 curr count: 181326
2022/01/03 21:09:06 Waiting for dst bucket item count to get to: 0 curr count: 181326
2022/01/03 21:09:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingRebIn (287.54s)
=== RUN   TestDuplicateWithEventingRebOut
2022/01/03 21:09:11 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 21:09:11 Removing node(s): [] from the cluster
2022/01/03 21:09:16 Rebalance progress: 100
2022/01/03 21:09:21 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/01/03 21:09:21 App: TestDuplicateWithEventingRebOut got un-deployed
2022/01/03 21:09:21 No eventing-con process running
2022/01/03 21:09:21 Function: TestDuplicateWithEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingRebOut not found"
}
2022/01/03 21:09:23 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:09:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:09:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:09:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:09:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:09:35 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:09:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:09:40 Deploying app: TestDuplicateWithEventingRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:09:41 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebOut stored in temp store"
}
2022/01/03 21:09:46 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2022/01/03 21:09:51 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2022/01/03 21:09:56 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2022/01/03 21:10:01 Waiting for app: TestDuplicateWithEventingRebOut to get deployed
2022/01/03 21:10:01 App: TestDuplicateWithEventingRebOut got deployed
2022/01/03 21:10:01 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 21:10:01 Starting bucket ops to source bucket
2022/01/03 21:10:06 Rebalance progress: 25
2022/01/03 21:10:11 Rebalance progress: 25
2022/01/03 21:10:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:10:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:10:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:10:16 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2022/01/03 21:10:16 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 21:10:16 Waiting for src bucket item count to get to: 200000 curr count: 13731
2022/01/03 21:10:21 Waiting for src bucket item count to get to: 200000 curr count: 30190
2022/01/03 21:10:26 Waiting for src bucket item count to get to: 200000 curr count: 30190
2022/01/03 21:10:31 Waiting for src bucket item count to get to: 200000 curr count: 46935
2022/01/03 21:10:36 Waiting for src bucket item count to get to: 200000 curr count: 46935
2022/01/03 21:10:41 Waiting for src bucket item count to get to: 200000 curr count: 63529
2022/01/03 21:10:46 Waiting for src bucket item count to get to: 200000 curr count: 63529
2022/01/03 21:10:51 Waiting for src bucket item count to get to: 200000 curr count: 63529
2022/01/03 21:10:56 Waiting for src bucket item count to get to: 200000 curr count: 79911
2022/01/03 21:11:01 Waiting for src bucket item count to get to: 200000 curr count: 79911
2022/01/03 21:11:06 Waiting for src bucket item count to get to: 200000 curr count: 96434
2022/01/03 21:11:11 Waiting for src bucket item count to get to: 200000 curr count: 96434
2022/01/03 21:11:16 Waiting for src bucket item count to get to: 200000 curr count: 113210
2022/01/03 21:11:21 Waiting for src bucket item count to get to: 200000 curr count: 113210
2022/01/03 21:11:26 Waiting for src bucket item count to get to: 200000 curr count: 130124
2022/01/03 21:11:31 Waiting for src bucket item count to get to: 200000 curr count: 130124
2022/01/03 21:11:36 Waiting for src bucket item count to get to: 200000 curr count: 146994
2022/01/03 21:11:41 Waiting for src bucket item count to get to: 200000 curr count: 146994
2022/01/03 21:11:46 Waiting for src bucket item count to get to: 200000 curr count: 163939
2022/01/03 21:11:51 Waiting for src bucket item count to get to: 200000 curr count: 163939
2022/01/03 21:11:56 Waiting for src bucket item count to get to: 200000 curr count: 180167
2022/01/03 21:12:01 Waiting for src bucket item count to get to: 200000 curr count: 180167
2022/01/03 21:12:06 Waiting for src bucket item count to get to: 200000 curr count: 196584
2022/01/03 21:12:11 Waiting for src bucket item count to get to: 200000 curr count: 196584
2022/01/03 21:12:16 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 21:12:16 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 21:12:21 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/01/03 21:12:26 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/01/03 21:12:31 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/01/03 21:12:36 Waiting for app: TestDuplicateWithEventingRebOut to get un-deployed
2022/01/03 21:12:36 App: TestDuplicateWithEventingRebOut got un-deployed
2022/01/03 21:12:36 No eventing-con process running
2022/01/03 21:12:36 Function: TestDuplicateWithEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingRebOut deleting in background"
}
2022/01/03 21:12:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:12:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:12:48 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/03 21:12:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:12:50 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:12:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:12:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingRebOut (228.79s)
=== RUN   TestDuplicateWithEventingSwapReb
2022/01/03 21:13:05 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/01/03 21:13:05 App: TestDuplicateWithEventingSwapReb got un-deployed
2022/01/03 21:13:05 No eventing-con process running
2022/01/03 21:13:05 Function: TestDuplicateWithEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithEventingSwapReb not found"
}
2022/01/03 21:13:06 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:13:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:13:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:13:13 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:13:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:13:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:13:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:13:23 Deploying app: TestDuplicateWithEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:13:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingSwapReb stored in temp store"
}
2022/01/03 21:13:29 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2022/01/03 21:13:34 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2022/01/03 21:13:39 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2022/01/03 21:13:44 Waiting for app: TestDuplicateWithEventingSwapReb to get deployed
2022/01/03 21:13:44 App: TestDuplicateWithEventingSwapReb got deployed
2022/01/03 21:13:44 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 21:13:44 Starting bucket ops to source bucket
2022/01/03 21:13:45 Removing node(s): [] from the cluster
2022/01/03 21:13:50 Rebalance progress: 25
2022/01/03 21:13:55 Rebalance progress: 25
2022/01/03 21:14:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:14:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:14:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:14:00 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9302/api/v1/stats": dial tcp 127.0.0.1:9302: connect: connection refused
2022/01/03 21:14:00 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 21:14:00 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 21:14:07 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 21:14:12 Rebalance progress: 16.66666666666667
2022/01/03 21:14:17 Rebalance progress: 16.66666666666667
2022/01/03 21:14:22 Rebalance progress: 16.66666666666667
2022/01/03 21:14:27 Rebalance progress: 39.08969210174029
2022/01/03 21:14:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:14:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:14:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:14:32 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 21:14:32 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 21:14:37 Rebalance progress: 16.66666666666667
2022/01/03 21:14:42 Rebalance progress: 16.66666666666667
2022/01/03 21:14:47 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:14:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:14:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:14:47 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 21:14:47 Waiting for src bucket item count to get to: 200000 curr count: 83927
2022/01/03 21:14:52 Waiting for src bucket item count to get to: 200000 curr count: 100115
2022/01/03 21:14:57 Waiting for src bucket item count to get to: 200000 curr count: 100115
2022/01/03 21:15:02 Waiting for src bucket item count to get to: 200000 curr count: 116565
2022/01/03 21:15:07 Waiting for src bucket item count to get to: 200000 curr count: 116565
2022/01/03 21:15:12 Waiting for src bucket item count to get to: 200000 curr count: 132841
2022/01/03 21:15:17 Waiting for src bucket item count to get to: 200000 curr count: 132841
2022/01/03 21:15:22 Waiting for src bucket item count to get to: 200000 curr count: 149183
2022/01/03 21:15:27 Waiting for src bucket item count to get to: 200000 curr count: 149183
2022/01/03 21:15:32 Waiting for src bucket item count to get to: 200000 curr count: 165957
2022/01/03 21:15:37 Waiting for src bucket item count to get to: 200000 curr count: 165957
2022/01/03 21:15:42 Waiting for src bucket item count to get to: 200000 curr count: 182068
2022/01/03 21:15:47 Waiting for src bucket item count to get to: 200000 curr count: 182068
2022/01/03 21:15:52 Waiting for src bucket item count to get to: 200000 curr count: 198247
2022/01/03 21:15:57 Waiting for src bucket item count to get to: 200000 curr count: 198247
2022/01/03 21:16:02 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 21:16:02 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 21:16:07 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/01/03 21:16:12 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/01/03 21:16:17 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/01/03 21:16:23 Waiting for app: TestDuplicateWithEventingSwapReb to get un-deployed
2022/01/03 21:16:23 App: TestDuplicateWithEventingSwapReb got un-deployed
2022/01/03 21:16:23 No eventing-con process running
2022/01/03 21:16:23 Function: TestDuplicateWithEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithEventingSwapReb deleting in background"
}
2022/01/03 21:16:24 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:16:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:16:34 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/03 21:16:39 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/03 21:16:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:16:41 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:16:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:16:51 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/03 21:16:56 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/03 21:16:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithEventingSwapReb (241.37s)
=== RUN   TestDuplicateWithKVRebIn
2022/01/03 21:17:06 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/01/03 21:17:06 App: TestDuplicateWithKVRebIn got un-deployed
2022/01/03 21:17:06 No eventing-con process running
2022/01/03 21:17:06 Function: TestDuplicateWithKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVRebIn not found"
}
2022/01/03 21:17:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:17:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:17:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:17:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:17:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:17:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:17:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:17:25 Deploying app: TestDuplicateWithKVRebIn. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:17:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebIn stored in temp store"
}
2022/01/03 21:17:31 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2022/01/03 21:17:36 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2022/01/03 21:17:41 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2022/01/03 21:17:46 Waiting for app: TestDuplicateWithKVRebIn to get deployed
2022/01/03 21:17:46 App: TestDuplicateWithKVRebIn got deployed
2022/01/03 21:17:46 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 21:17:46 Starting bucket ops to source bucket
2022/01/03 21:17:46 Removing node(s): [] from the cluster
2022/01/03 21:17:51 Rebalance progress: 16.66666666666667
2022/01/03 21:17:56 Rebalance progress: 16.66666666666667
2022/01/03 21:18:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:18:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:18:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:18:01 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 21:18:01 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 21:18:06 Rebalance progress: 16.66666666666667
2022/01/03 21:18:11 Rebalance progress: 16.66666666666667
2022/01/03 21:18:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:18:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:18:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:18:16 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 21:18:16 Waiting for src bucket item count to get to: 200000 curr count: 37630
2022/01/03 21:18:21 Waiting for src bucket item count to get to: 200000 curr count: 54181
2022/01/03 21:18:26 Waiting for src bucket item count to get to: 200000 curr count: 54181
2022/01/03 21:18:31 Waiting for src bucket item count to get to: 200000 curr count: 70461
2022/01/03 21:18:37 Waiting for src bucket item count to get to: 200000 curr count: 70461
2022/01/03 21:18:42 Waiting for src bucket item count to get to: 200000 curr count: 85779
2022/01/03 21:18:47 Waiting for src bucket item count to get to: 200000 curr count: 85779
2022/01/03 21:18:52 Waiting for src bucket item count to get to: 200000 curr count: 101969
2022/01/03 21:18:57 Waiting for src bucket item count to get to: 200000 curr count: 101969
2022/01/03 21:19:02 Waiting for src bucket item count to get to: 200000 curr count: 118339
2022/01/03 21:19:07 Waiting for src bucket item count to get to: 200000 curr count: 118339
2022/01/03 21:19:12 Waiting for src bucket item count to get to: 200000 curr count: 134737
2022/01/03 21:19:17 Waiting for src bucket item count to get to: 200000 curr count: 134737
2022/01/03 21:19:22 Waiting for src bucket item count to get to: 200000 curr count: 134737
2022/01/03 21:19:27 Waiting for src bucket item count to get to: 200000 curr count: 151364
2022/01/03 21:19:32 Waiting for src bucket item count to get to: 200000 curr count: 151364
2022/01/03 21:19:37 Waiting for src bucket item count to get to: 200000 curr count: 167953
2022/01/03 21:19:42 Waiting for src bucket item count to get to: 200000 curr count: 167953
2022/01/03 21:19:47 Waiting for src bucket item count to get to: 200000 curr count: 183646
2022/01/03 21:19:52 Waiting for src bucket item count to get to: 200000 curr count: 183646
2022/01/03 21:19:57 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 21:19:57 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 21:20:02 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/01/03 21:20:07 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/01/03 21:20:12 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/01/03 21:20:17 Waiting for app: TestDuplicateWithKVRebIn to get un-deployed
2022/01/03 21:20:17 App: TestDuplicateWithKVRebIn got un-deployed
2022/01/03 21:20:17 No eventing-con process running
2022/01/03 21:20:17 Function: TestDuplicateWithKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebIn deleting in background"
}
2022/01/03 21:20:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:20:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:20:29 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/03 21:20:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:20:30 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:20:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:20:40 Waiting for dst bucket item count to get to: 0 curr count: 84323
2022/01/03 21:20:45 Waiting for dst bucket item count to get to: 0 curr count: 84323
2022/01/03 21:20:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVRebIn (229.33s)
=== RUN   TestDuplicateWithKVRebOut
2022/01/03 21:20:50 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 21:20:51 Removing node(s): [] from the cluster
2022/01/03 21:20:56 Rebalance progress: 100
2022/01/03 21:21:01 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/01/03 21:21:01 App: TestDuplicateWithKVRebOut got un-deployed
2022/01/03 21:21:01 No eventing-con process running
2022/01/03 21:21:01 Function: TestDuplicateWithKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVRebOut not found"
}
2022/01/03 21:21:02 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:21:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:21:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:21:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:21:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:21:14 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:21:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:21:19 Deploying app: TestDuplicateWithKVRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:21:20 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebOut stored in temp store"
}
2022/01/03 21:21:25 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2022/01/03 21:21:30 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2022/01/03 21:21:35 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2022/01/03 21:21:40 Waiting for app: TestDuplicateWithKVRebOut to get deployed
2022/01/03 21:21:40 App: TestDuplicateWithKVRebOut got deployed
2022/01/03 21:21:40 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 21:21:40 Starting bucket ops to source bucket
2022/01/03 21:21:45 Rebalance progress: 16.66666666666667
2022/01/03 21:21:50 Rebalance progress: 16.66666666666667
2022/01/03 21:21:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:21:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:21:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:21:55 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 21:21:55 Waiting for src bucket item count to get to: 200000 curr count: 13835
2022/01/03 21:22:00 Waiting for src bucket item count to get to: 200000 curr count: 30399
2022/01/03 21:22:05 Waiting for src bucket item count to get to: 200000 curr count: 30399
2022/01/03 21:22:11 Waiting for src bucket item count to get to: 200000 curr count: 47127
2022/01/03 21:22:16 Waiting for src bucket item count to get to: 200000 curr count: 47127
2022/01/03 21:22:21 Waiting for src bucket item count to get to: 200000 curr count: 63777
2022/01/03 21:22:26 Waiting for src bucket item count to get to: 200000 curr count: 63777
2022/01/03 21:22:31 Waiting for src bucket item count to get to: 200000 curr count: 63777
2022/01/03 21:22:36 Waiting for src bucket item count to get to: 200000 curr count: 79608
2022/01/03 21:22:41 Waiting for src bucket item count to get to: 200000 curr count: 79608
2022/01/03 21:22:46 Waiting for src bucket item count to get to: 200000 curr count: 96012
2022/01/03 21:22:51 Waiting for src bucket item count to get to: 200000 curr count: 96012
2022/01/03 21:22:56 Waiting for src bucket item count to get to: 200000 curr count: 112816
2022/01/03 21:23:01 Waiting for src bucket item count to get to: 200000 curr count: 112816
2022/01/03 21:23:06 Waiting for src bucket item count to get to: 200000 curr count: 129691
2022/01/03 21:23:11 Waiting for src bucket item count to get to: 200000 curr count: 129691
2022/01/03 21:23:16 Waiting for src bucket item count to get to: 200000 curr count: 146356
2022/01/03 21:23:21 Waiting for src bucket item count to get to: 200000 curr count: 146356
2022/01/03 21:23:26 Waiting for src bucket item count to get to: 200000 curr count: 163095
2022/01/03 21:23:31 Waiting for src bucket item count to get to: 200000 curr count: 163095
2022/01/03 21:23:36 Waiting for src bucket item count to get to: 200000 curr count: 179090
2022/01/03 21:23:41 Waiting for src bucket item count to get to: 200000 curr count: 179090
2022/01/03 21:23:46 Waiting for src bucket item count to get to: 200000 curr count: 195541
2022/01/03 21:23:51 Waiting for src bucket item count to get to: 200000 curr count: 195541
2022/01/03 21:23:56 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 21:23:56 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 21:24:01 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/01/03 21:24:06 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/01/03 21:24:11 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/01/03 21:24:16 Waiting for app: TestDuplicateWithKVRebOut to get un-deployed
2022/01/03 21:24:16 App: TestDuplicateWithKVRebOut got un-deployed
2022/01/03 21:24:16 No eventing-con process running
2022/01/03 21:24:16 Function: TestDuplicateWithKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVRebOut deleting in background"
}
2022/01/03 21:24:18 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:24:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:24:28 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/03 21:24:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:24:29 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:24:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:24:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVRebOut (229.03s)
=== RUN   TestDuplicateWithKVSwapReb
2022/01/03 21:24:44 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2022/01/03 21:24:44 App: TestDuplicateWithKVSwapReb got un-deployed
2022/01/03 21:24:44 No eventing-con process running
2022/01/03 21:24:44 Function: TestDuplicateWithKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateWithKVSwapReb not found"
}
2022/01/03 21:24:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:24:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:24:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:24:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:24:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:24:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:25:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:25:03 Deploying app: TestDuplicateWithKVSwapReb. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:25:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVSwapReb stored in temp store"
}
2022/01/03 21:25:09 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2022/01/03 21:25:14 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2022/01/03 21:25:19 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2022/01/03 21:25:24 Waiting for app: TestDuplicateWithKVSwapReb to get deployed
2022/01/03 21:25:24 App: TestDuplicateWithKVSwapReb got deployed
2022/01/03 21:25:24 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 21:25:24 Starting bucket ops to source bucket
2022/01/03 21:25:24 Removing node(s): [] from the cluster
2022/01/03 21:25:29 Rebalance progress: 16.66666666666667
2022/01/03 21:25:34 Rebalance progress: 16.66666666666667
2022/01/03 21:25:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:25:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:25:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:25:39 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 21:25:39 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/03 21:25:40 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 21:25:45 Rebalance progress: 16.66666666666667
2022/01/03 21:25:50 Rebalance progress: 16.66666666666667
2022/01/03 21:25:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:25:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:25:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:25:55 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 21:25:55 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 21:26:00 Rebalance progress: 16.66666666666667
2022/01/03 21:26:05 Rebalance progress: 16.66666666666667
2022/01/03 21:26:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:26:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:26:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:26:10 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 21:26:10 Waiting for src bucket item count to get to: 200000 curr count: 55396
2022/01/03 21:26:15 Waiting for src bucket item count to get to: 200000 curr count: 72024
2022/01/03 21:26:20 Waiting for src bucket item count to get to: 200000 curr count: 72024
2022/01/03 21:26:25 Waiting for src bucket item count to get to: 200000 curr count: 87325
2022/01/03 21:26:30 Waiting for src bucket item count to get to: 200000 curr count: 87325
2022/01/03 21:26:35 Waiting for src bucket item count to get to: 200000 curr count: 103901
2022/01/03 21:26:40 Waiting for src bucket item count to get to: 200000 curr count: 120551
2022/01/03 21:26:45 Waiting for src bucket item count to get to: 200000 curr count: 120551
2022/01/03 21:26:50 Waiting for src bucket item count to get to: 200000 curr count: 136667
2022/01/03 21:26:55 Waiting for src bucket item count to get to: 200000 curr count: 136667
2022/01/03 21:27:00 Waiting for src bucket item count to get to: 200000 curr count: 152820
2022/01/03 21:27:05 Waiting for src bucket item count to get to: 200000 curr count: 152820
2022/01/03 21:27:10 Waiting for src bucket item count to get to: 200000 curr count: 152820
2022/01/03 21:27:15 Waiting for src bucket item count to get to: 200000 curr count: 169423
2022/01/03 21:27:20 Waiting for src bucket item count to get to: 200000 curr count: 169423
2022/01/03 21:27:25 Waiting for src bucket item count to get to: 200000 curr count: 185156
2022/01/03 21:27:30 Waiting for src bucket item count to get to: 200000 curr count: 185156
2022/01/03 21:27:35 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 21:27:35 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 21:27:40 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2022/01/03 21:27:45 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2022/01/03 21:27:50 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2022/01/03 21:27:55 Waiting for app: TestDuplicateWithKVSwapReb to get un-deployed
2022/01/03 21:27:55 App: TestDuplicateWithKVSwapReb got un-deployed
2022/01/03 21:27:55 No eventing-con process running
2022/01/03 21:27:55 Function: TestDuplicateWithKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateWithKVSwapReb deleting in background"
}
2022/01/03 21:27:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:28:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:28:07 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/03 21:28:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:28:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:28:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:28:19 Waiting for dst bucket item count to get to: 0 curr count: 200000
2022/01/03 21:28:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateWithKVSwapReb (224.57s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpOneByOne
2022/01/03 21:28:29 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 21:28:29 App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/01/03 21:28:29 No eventing-con process running
2022/01/03 21:28:29 Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne not found"
}
2022/01/03 21:28:31 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:28:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:28:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:28:37 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:28:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:28:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:28:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:28:47 Deploying app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:28:49 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2022/01/03 21:28:54 Starting bucket ops to source bucket
2022/01/03 21:28:59 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/03 21:29:04 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/03 21:29:09 Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/03 21:29:09 App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:29:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:29:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:29:09 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 21:29:09 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 21:29:09 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:29:14 Rebalance progress: 16.66666666666667
2022/01/03 21:29:19 Rebalance progress: 16.66666666666667
2022/01/03 21:29:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:29:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:29:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:29:24 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 21:29:24 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 21:29:24 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:29:29 Rebalance progress: 16.66666666666667
2022/01/03 21:29:34 Rebalance progress: 16.66666666666667
2022/01/03 21:29:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:29:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:29:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:29:39 eventingSetup.go:610: http call resp: Get "http://127.0.0.1:9303/api/v1/stats": dial tcp 127.0.0.1:9303: connect: connection refused
2022/01/03 21:29:39 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 21:29:45 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:29:50 Rebalance progress: 12.5
2022/01/03 21:29:55 Rebalance progress: 12.5
2022/01/03 21:30:00 Rebalance progress: 12.5
2022/01/03 21:30:05 Rebalance progress: 28.02419354838709
2022/01/03 21:30:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:30:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:30:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:30:10 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 21:30:15 Rebalance progress: 12.5
2022/01/03 21:30:20 Rebalance progress: 12.5
2022/01/03 21:30:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:30:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:30:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:30:25 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 21:30:30 Rebalance progress: 12.5
2022/01/03 21:30:35 Rebalance progress: 12.5
2022/01/03 21:30:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:30:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:30:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:30:40 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/03 21:30:45 Rebalance progress: 12.5
2022/01/03 21:30:50 Rebalance progress: 12.5
2022/01/03 21:30:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:30:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:30:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:31:00 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 21:31:05 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 21:31:10 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 21:31:15 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 21:31:15 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/01/03 21:31:15 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:31:16 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2022/01/03 21:31:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:31:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:31:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12156
2022/01/03 21:31:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:31:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:31:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:31:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12156
2022/01/03 21:31:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpOneByOne (200.08s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce
2022/01/03 21:31:49 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/01/03 21:31:49 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got un-deployed
2022/01/03 21:31:49 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:31:49 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce not found"
}
2022/01/03 21:31:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:31:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:31:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:31:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:32:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:32:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:32:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:32:08 eventingSetup.go:125: Deploying app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:32:09 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce stored in temp store"
}
2022/01/03 21:32:14 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 21:32:19 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2022/01/03 21:32:24 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2022/01/03 21:32:29 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get deployed
2022/01/03 21:32:29 clusterSetup.go:354: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:32:29 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:32:29 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:32:29 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 21:32:29 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 21:32:29 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 21:32:30 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:32:35 Rebalance progress: 12.5
2022/01/03 21:32:40 Rebalance progress: 12.5
2022/01/03 21:32:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:32:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:32:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:32:45 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2022/01/03 21:32:50 Rebalance progress: 12.5
2022/01/03 21:32:55 Rebalance progress: 12.5
2022/01/03 21:33:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:33:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:33:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:33:05 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/01/03 21:33:10 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/01/03 21:33:15 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/01/03 21:33:20 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce to get un-deployed
2022/01/03 21:33:20 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce got un-deployed
2022/01/03 21:33:20 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:33:20 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce deleting in background"
}
2022/01/03 21:33:22 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:33:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:33:32 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4601
2022/01/03 21:33:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4601
2022/01/03 21:33:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:33:39 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:33:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:33:49 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4601
2022/01/03 21:33:49 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpAllAtOnce (129.65s)
=== RUN   TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings
2022/01/03 21:33:59 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 21:33:59 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got un-deployed
2022/01/03 21:33:59 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:33:59 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings not found"
}
2022/01/03 21:34:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:34:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:34:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:34:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:34:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:34:12 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:34:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:34:17 eventingSetup.go:125: Deploying app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:34:18 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings stored in temp store"
}
2022/01/03 21:34:23 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 21:34:28 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2022/01/03 21:34:33 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2022/01/03 21:34:38 clusterSetup.go:346: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get deployed
2022/01/03 21:34:38 clusterSetup.go:354: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:34:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:34:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:34:38 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 21:34:39 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:34:44 Rebalance progress: 12.5
2022/01/03 21:34:49 Rebalance progress: 12.5
2022/01/03 21:34:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:34:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:34:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:34:54 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 21:34:54 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:34:59 Rebalance progress: 12.5
2022/01/03 21:35:04 Rebalance progress: 12.5
2022/01/03 21:35:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:35:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:35:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:35:09 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 21:35:09 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:35:14 Rebalance progress: 12.5
2022/01/03 21:35:19 Rebalance progress: 12.5
2022/01/03 21:35:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:35:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:35:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:35:25 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 21:35:30 Rebalance progress: 12.5
2022/01/03 21:35:35 Rebalance progress: 12.5
2022/01/03 21:35:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:35:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:35:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:35:40 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 21:35:45 Rebalance progress: 12.5
2022/01/03 21:35:50 Rebalance progress: 12.5
2022/01/03 21:35:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:35:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:35:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:35:55 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/03 21:36:00 Rebalance progress: 12.5
2022/01/03 21:36:05 Rebalance progress: 12.5
2022/01/03 21:36:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:36:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:36:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:36:15 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 21:36:20 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 21:36:25 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 21:36:30 clusterSetup.go:397: Waiting for app: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings to get un-deployed
2022/01/03 21:36:30 clusterSetup.go:405: App: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings got un-deployed
2022/01/03 21:36:30 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:36:30 eventingSetup.go:418: Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings deleting in background"
}
2022/01/03 21:36:32 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:36:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:36:42 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10638
2022/01/03 21:36:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10638
2022/01/03 21:36:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:36:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:36:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:36:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10638
2022/01/03 21:36:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebKVOpsOnUpdateBucketOpNonDefaultSettings (189.96s)
=== RUN   TestEventingSwapRebOnUpdateBucketOp
2022/01/03 21:37:09 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/01/03 21:37:09 clusterSetup.go:405: App: TestEventingSwapRebOnUpdateBucketOp got un-deployed
2022/01/03 21:37:09 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:37:09 eventingSetup.go:418: Function: TestEventingSwapRebOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebOnUpdateBucketOp not found"
}
2022/01/03 21:37:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:37:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:37:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:37:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:37:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:37:22 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:37:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:37:22 eventingSetup.go:125: Deploying app: TestEventingSwapRebOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:37:23 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebOnUpdateBucketOp stored in temp store"
}
2022/01/03 21:37:28 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 21:37:33 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2022/01/03 21:37:38 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2022/01/03 21:37:43 clusterSetup.go:346: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get deployed
2022/01/03 21:37:43 clusterSetup.go:354: App: TestEventingSwapRebOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:37:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:37:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:37:43 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 21:37:44 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:37:49 Rebalance progress: 12.5
2022/01/03 21:37:54 Rebalance progress: 12.5
2022/01/03 21:37:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:37:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:37:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:37:59 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 21:37:59 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 21:38:04 Rebalance progress: 12.5
2022/01/03 21:38:09 Rebalance progress: 12.5
2022/01/03 21:38:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:38:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:38:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:38:14 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 21:38:19 Rebalance progress: 12.5
2022/01/03 21:38:24 Rebalance progress: 12.5
2022/01/03 21:38:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:38:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:38:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:38:34 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/01/03 21:38:39 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/01/03 21:38:44 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/01/03 21:38:49 clusterSetup.go:397: Waiting for app: TestEventingSwapRebOnUpdateBucketOp to get un-deployed
2022/01/03 21:38:49 clusterSetup.go:405: App: TestEventingSwapRebOnUpdateBucketOp got un-deployed
2022/01/03 21:38:49 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:38:49 eventingSetup.go:418: Function: TestEventingSwapRebOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebOnUpdateBucketOp deleting in background"
}
2022/01/03 21:38:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:38:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:39:01 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6070
2022/01/03 21:39:06 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6070
2022/01/03 21:39:06 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:39:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:39:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:39:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6070
2022/01/03 21:39:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebOnUpdateBucketOp (139.18s)
=== RUN   TestMetaRollbackWithEventingReb
2022/01/03 21:39:23 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 21:39:23 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:39:28 Rebalance progress: 100
2022/01/03 21:39:33 Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/01/03 21:39:33 App: TestMetaRollbackWithEventingReb got un-deployed
2022/01/03 21:39:33 No eventing-con process running
2022/01/03 21:39:33 Function: TestMetaRollbackWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaRollbackWithEventingReb not found"
}
2022/01/03 21:39:35 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:39:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:39:40 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:39:42 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:39:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:39:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:39:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:39:47 Deploying app: TestMetaRollbackWithEventingReb. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:39:48 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaRollbackWithEventingReb stored in temp store"
}
2022/01/03 21:39:53 Starting bucket ops to source bucket
2022/01/03 21:39:58 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2022/01/03 21:40:03 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2022/01/03 21:40:08 Waiting for app: TestMetaRollbackWithEventingReb to get deployed
2022/01/03 21:40:08 App: TestMetaRollbackWithEventingReb got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:40:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:40:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:40:08 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 21:40:08 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:40:13 Rebalance progress: 12.5
2022/01/03 21:40:18 Rebalance progress: 12.5
2022/01/03 21:40:23 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:40:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:40:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:40:23 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2022/01/03 21:40:23 bucketOps.go:134: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2022/01/03 21:40:28 Rebalance progress: 12.5
2022/01/03 21:40:33 Rebalance progress: 12.5
2022/01/03 21:40:38 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:40:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:40:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:40:44 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/01/03 21:40:49 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/01/03 21:40:54 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/01/03 21:40:59 clusterSetup.go:397: Waiting for app: TestMetaRollbackWithEventingReb to get un-deployed
2022/01/03 21:40:59 clusterSetup.go:405: App: TestMetaRollbackWithEventingReb got un-deployed
2022/01/03 21:40:59 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:40:59 eventingSetup.go:418: Function: TestMetaRollbackWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaRollbackWithEventingReb deleting in background"
}
2022/01/03 21:41:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:41:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:41:10 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2288
2022/01/03 21:41:15 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 2288
2022/01/03 21:41:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:41:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:41:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:41:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4538
2022/01/03 21:41:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaRollbackWithEventingReb (129.37s)
=== RUN   TestMetaPartialRollbackWithEventingReb
2022/01/03 21:41:32 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 21:41:32 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:41:37 Rebalance progress: 100
2022/01/03 21:41:42 Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/01/03 21:41:43 App: TestMetaPartialRollbackWithEventingReb got un-deployed
2022/01/03 21:41:43 No eventing-con process running
2022/01/03 21:41:43 Function: TestMetaPartialRollbackWithEventingReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestMetaPartialRollbackWithEventingReb not found"
}
2022/01/03 21:41:44 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:41:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:41:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:41:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:41:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:41:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:41:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:41:56 Deploying app: TestMetaPartialRollbackWithEventingReb. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:41:57 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaPartialRollbackWithEventingReb stored in temp store"
}
2022/01/03 21:42:02 Starting bucket ops to source bucket
2022/01/03 21:42:07 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2022/01/03 21:42:12 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2022/01/03 21:42:17 Waiting for app: TestMetaPartialRollbackWithEventingReb to get deployed
2022/01/03 21:42:17 App: TestMetaPartialRollbackWithEventingReb got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:42:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:42:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:42:17 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 21:42:18 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:42:23 Rebalance progress: 12.5
2022/01/03 21:42:28 Rebalance progress: 12.5
2022/01/03 21:42:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:42:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:42:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:42:33 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2022/01/03 21:42:33 bucketOps.go:65: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaPartialRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2022/01/03 21:42:38 Rebalance progress: 12.5
2022/01/03 21:42:43 Rebalance progress: 12.5
2022/01/03 21:42:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:42:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:42:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:42:48 bucketOps.go:65: Metakv lookup failed, err: Get "/_metakv/eventing/tempApps/TestMetaPartialRollbackWithEventingReb/0": Unable to initialize cbauth's revrpc: cbauth environment variable CBAUTH_REVRPC_URL is not set
2022/01/03 21:42:53 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/01/03 21:42:58 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/01/03 21:43:03 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/01/03 21:43:08 clusterSetup.go:397: Waiting for app: TestMetaPartialRollbackWithEventingReb to get un-deployed
2022/01/03 21:43:08 clusterSetup.go:405: App: TestMetaPartialRollbackWithEventingReb got un-deployed
2022/01/03 21:43:08 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:43:08 eventingSetup.go:418: Function: TestMetaPartialRollbackWithEventingReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestMetaPartialRollbackWithEventingReb deleting in background"
}
2022/01/03 21:43:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:43:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:43:20 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3697
2022/01/03 21:43:25 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3697
2022/01/03 21:43:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:43:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:43:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:43:37 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 38264
2022/01/03 21:43:37 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestMetaPartialRollbackWithEventingReb (129.58s)
=== RUN   TestEventingRebMultipleHandlersOneByOne
2022/01/03 21:43:47 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/01/03 21:43:47 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got un-deployed
2022/01/03 21:43:47 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:43:47 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op not found"
}
2022/01/03 21:43:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:43:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:43:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:43:55 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:44:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:44:00 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:44:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:44:05 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:44:06 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:44:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:44:06 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:44:08 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update stored in temp store"
}
2022/01/03 21:44:13 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 21:44:18 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2022/01/03 21:44:23 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2022/01/03 21:44:28 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get deployed
2022/01/03 21:44:28 clusterSetup.go:354: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got deployed
2022/01/03 21:44:33 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2022/01/03 21:44:38 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2022/01/03 21:44:43 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get deployed
2022/01/03 21:44:43 clusterSetup.go:354: App: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:44:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:44:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:44:43 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 21:44:44 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:44:49 Rebalance progress: 12.5
2022/01/03 21:44:54 Rebalance progress: 12.5
2022/01/03 21:44:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:44:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:44:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:44:59 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 21:44:59 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:45:04 Rebalance progress: 12.5
2022/01/03 21:45:09 Rebalance progress: 12.5
2022/01/03 21:45:14 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:45:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:45:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:45:14 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 21:45:14 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:45:19 Rebalance progress: 12.5
2022/01/03 21:45:24 Rebalance progress: 12.5
2022/01/03 21:45:29 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:45:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:45:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:45:30 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 21:45:35 Rebalance progress: 12.5
2022/01/03 21:45:40 Rebalance progress: 12.5
2022/01/03 21:45:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:45:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:45:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:45:45 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 21:45:50 Rebalance progress: 12.5
2022/01/03 21:45:55 Rebalance progress: 12.5
2022/01/03 21:46:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:46:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:46:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:46:00 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/03 21:46:05 Rebalance progress: 12.5
2022/01/03 21:46:10 Rebalance progress: 12.5
2022/01/03 21:46:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:46:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:46:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:46:20 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/01/03 21:46:25 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/01/03 21:46:30 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/01/03 21:46:35 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op to get un-deployed
2022/01/03 21:46:35 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op got un-deployed
2022/01/03 21:46:35 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:46:35 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnesys_test_bucket_op deleting in background"
}
2022/01/03 21:46:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:46:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:46:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12224
2022/01/03 21:46:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:46:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:46:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:47:00 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3717
2022/01/03 21:47:05 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 3717
2022/01/03 21:47:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:47:10 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2022/01/03 21:47:15 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2022/01/03 21:47:20 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2022/01/03 21:47:25 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update to get un-deployed
2022/01/03 21:47:25 clusterSetup.go:405: App: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update got un-deployed
2022/01/03 21:47:25 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:47:26 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersOneByOnebucket_op_on_update deleting in background"
}
2022/01/03 21:47:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:47:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:47:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:47:34 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:47:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:47:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultipleHandlersOneByOne (242.29s)
=== RUN   TestEventingRebMultipleHandlersAllAtOnce
2022/01/03 21:47:49 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2022/01/03 21:47:49 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got un-deployed
2022/01/03 21:47:49 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:47:49 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op not found"
}
2022/01/03 21:47:51 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:47:56 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:47:56 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:47:58 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:48:03 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:48:03 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:48:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:48:08 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:48:09 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:48:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:48:09 eventingSetup.go:125: Deploying app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:48:10 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update stored in temp store"
}
2022/01/03 21:48:15 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 21:48:20 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2022/01/03 21:48:25 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2022/01/03 21:48:30 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get deployed
2022/01/03 21:48:30 clusterSetup.go:354: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got deployed
2022/01/03 21:48:35 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2022/01/03 21:48:40 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2022/01/03 21:48:45 clusterSetup.go:346: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get deployed
2022/01/03 21:48:45 clusterSetup.go:354: App: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:48:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:48:45 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:48:45 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 21:48:45 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 21:48:46 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: eventing to the cluster
2022/01/03 21:48:46 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:48:51 Rebalance progress: 12.5
2022/01/03 21:48:56 Rebalance progress: 12.5
2022/01/03 21:49:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:49:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:49:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:49:01 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2022/01/03 21:49:06 Rebalance progress: 12.5
2022/01/03 21:49:11 Rebalance progress: 12.5
2022/01/03 21:49:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:49:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:49:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:49:21 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2022/01/03 21:49:27 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2022/01/03 21:49:32 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op to get un-deployed
2022/01/03 21:49:32 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op got un-deployed
2022/01/03 21:49:32 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:49:32 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncesys_test_bucket_op deleting in background"
}
2022/01/03 21:49:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:49:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:49:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6140
2022/01/03 21:49:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:49:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:49:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:49:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6140
2022/01/03 21:49:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:50:03 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2022/01/03 21:50:08 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2022/01/03 21:50:13 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2022/01/03 21:50:18 clusterSetup.go:397: Waiting for app: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update to get un-deployed
2022/01/03 21:50:18 clusterSetup.go:405: App: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update got un-deployed
2022/01/03 21:50:18 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:50:18 eventingSetup.go:418: Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultipleHandlersAllAtOncebucket_op_on_update deleting in background"
}
2022/01/03 21:50:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:50:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:50:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:50:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:50:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:50:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultipleHandlersAllAtOnce (172.54s)
=== RUN   TestEventingSwapRebMultipleHandlers
2022/01/03 21:50:42 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/01/03 21:50:42 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got un-deployed
2022/01/03 21:50:42 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:50:42 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update not found"
}
2022/01/03 21:50:43 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:50:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:50:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:50:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:50:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:50:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:51:00 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/01/03 21:51:00 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got un-deployed
2022/01/03 21:51:00 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:51:00 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op not found"
}
2022/01/03 21:51:02 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:51:07 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:51:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:51:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:51:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:51:14 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:51:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:51:14 eventingSetup.go:125: Deploying app: TestEventingSwapRebMultipleHandlersbucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:51:15 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:51:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:51:15 eventingSetup.go:125: Deploying app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:51:16 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op stored in temp store"
}
2022/01/03 21:51:21 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 21:51:26 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2022/01/03 21:51:31 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2022/01/03 21:51:36 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get deployed
2022/01/03 21:51:36 clusterSetup.go:354: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got deployed
2022/01/03 21:51:41 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2022/01/03 21:51:46 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2022/01/03 21:51:51 clusterSetup.go:346: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get deployed
2022/01/03 21:51:51 clusterSetup.go:354: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:51:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:51:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:51:51 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 21:51:51 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:51:56 Rebalance progress: 12.5
2022/01/03 21:52:01 Rebalance progress: 12.5
2022/01/03 21:52:06 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:52:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:52:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:52:06 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 21:52:07 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 21:52:12 Rebalance progress: 12.5
2022/01/03 21:52:17 Rebalance progress: 12.5
2022/01/03 21:52:22 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:52:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:52:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:52:22 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 21:52:27 Rebalance progress: 12.5
2022/01/03 21:52:32 Rebalance progress: 12.5
2022/01/03 21:52:37 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:52:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:52:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:52:42 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/01/03 21:52:47 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/01/03 21:52:52 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/01/03 21:52:57 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlersbucket_op_on_update to get un-deployed
2022/01/03 21:52:57 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlersbucket_op_on_update got un-deployed
2022/01/03 21:52:57 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:52:57 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlersbucket_op_on_update deleting in background"
}
2022/01/03 21:53:01 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:53:06 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:53:11 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1610
2022/01/03 21:53:16 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1610
2022/01/03 21:53:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:53:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:53:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:53:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7599
2022/01/03 21:53:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:53:33 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/01/03 21:53:38 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/01/03 21:53:43 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/01/03 21:53:48 clusterSetup.go:397: Waiting for app: TestEventingSwapRebMultipleHandlerssys_test_bucket_op to get un-deployed
2022/01/03 21:53:48 clusterSetup.go:405: App: TestEventingSwapRebMultipleHandlerssys_test_bucket_op got un-deployed
2022/01/03 21:53:48 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:53:48 eventingSetup.go:418: Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebMultipleHandlerssys_test_bucket_op deleting in background"
}
2022/01/03 21:53:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:53:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:53:55 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:53:57 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:54:02 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:54:02 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebMultipleHandlers (210.03s)
=== RUN   TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne
2022/01/03 21:54:12 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 21:54:12 clusterSetup.go:405: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/01/03 21:54:12 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:54:12 eventingSetup.go:418: Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne not found"
}
2022/01/03 21:54:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:54:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:54:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:54:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:54:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:54:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:54:30 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:54:30 eventingSetup.go:125: Deploying app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:54:31 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2022/01/03 21:54:36 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 21:54:41 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/03 21:54:46 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/03 21:54:51 clusterSetup.go:346: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/03 21:54:51 clusterSetup.go:354: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:54:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:54:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:54:51 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 21:54:52 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:55:12 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:55:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:55:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:55:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:55:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:55:43 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:55:48 Rebalance progress: 12.5
2022/01/03 21:55:53 Rebalance progress: 12.5
2022/01/03 21:55:58 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:55:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:55:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:55:58 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 21:55:58 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 21:56:03 Rebalance progress: 12.5
2022/01/03 21:56:08 Rebalance progress: 12.5
2022/01/03 21:56:13 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:56:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:56:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:56:13 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 21:56:18 Rebalance progress: 12.5
2022/01/03 21:56:23 Rebalance progress: 12.5
2022/01/03 21:56:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:56:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:56:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:56:33 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 21:56:38 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 21:56:44 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 21:56:49 clusterSetup.go:397: Waiting for app: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 21:56:49 clusterSetup.go:405: App: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/01/03 21:56:49 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:56:49 eventingSetup.go:418: Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2022/01/03 21:56:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:56:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:57:00 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4700
2022/01/03 21:57:05 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4700
2022/01/03 21:57:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:57:07 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:57:12 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:57:17 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 11195
2022/01/03 21:57:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebStopStartKVOpsOnUpdateBucketOpOneByOne (195.45s)
=== RUN   TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne
2022/01/03 21:57:27 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 21:57:27 clusterSetup.go:405: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/01/03 21:57:27 eventingSetup.go:46: No eventing-con process running
2022/01/03 21:57:27 eventingSetup.go:418: Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne not found"
}
2022/01/03 21:57:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:57:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:57:34 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 21:57:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:57:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:57:41 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:57:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 21:57:46 eventingSetup.go:125: Deploying app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne. Item count src bucket: 0 dst bucket: 0
2022/01/03 21:57:47 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne stored in temp store"
}
2022/01/03 21:57:52 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 21:57:57 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/03 21:58:02 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/03 21:58:07 clusterSetup.go:346: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get deployed
2022/01/03 21:58:07 clusterSetup.go:354: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:58:07 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:58:07 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:58:07 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 21:58:07 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:58:27 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:58:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:58:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:58:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:58:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:58:38 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 21:58:38 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:58:58 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:58:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:58:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:59:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:59:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:59:08 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 21:59:09 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 21:59:29 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:59:29 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:59:29 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:59:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 21:59:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 21:59:39 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 21:59:40 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 22:00:00 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:00:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:00:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:00:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:00:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:00:10 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 22:00:10 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 22:00:31 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:00:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:00:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:00:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:00:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:00:41 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 22:00:46 Rebalance progress: 12.5
2022/01/03 22:00:51 Rebalance progress: 12.5
2022/01/03 22:00:56 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:00:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:00:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:00:56 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 22:00:56 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 22:01:01 Rebalance progress: 12.5
2022/01/03 22:01:06 Rebalance progress: 12.5
2022/01/03 22:01:11 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:01:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:01:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:01:11 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 22:01:17 Rebalance progress: 12.5
2022/01/03 22:01:22 Rebalance progress: 12.5
2022/01/03 22:01:27 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:01:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:01:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:01:32 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 22:01:37 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 22:01:42 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 22:01:47 clusterSetup.go:397: Waiting for app: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne to get un-deployed
2022/01/03 22:01:47 clusterSetup.go:405: App: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne got un-deployed
2022/01/03 22:01:47 eventingSetup.go:46: No eventing-con process running
2022/01/03 22:01:47 eventingSetup.go:418: Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne deleting in background"
}
2022/01/03 22:01:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:01:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:01:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 21462
2022/01/03 22:01:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:02:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:02:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:02:10 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8504
2022/01/03 22:02:15 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8504
2022/01/03 22:02:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebMultiStopStartKVOpsOnUpdateBucketOpOneByOne (298.24s)
=== RUN   TestEventingFailoverOnUpdateBucketOp
2022/01/03 22:02:25 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2022/01/03 22:02:25 clusterSetup.go:405: App: TestEventingFailoverOnUpdateBucketOp got un-deployed
2022/01/03 22:02:25 eventingSetup.go:46: No eventing-con process running
2022/01/03 22:02:25 eventingSetup.go:418: Function: TestEventingFailoverOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingFailoverOnUpdateBucketOp not found"
}
2022/01/03 22:02:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:02:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:02:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:02:34 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:02:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:02:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:02:44 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:02:44 eventingSetup.go:125: Deploying app: TestEventingFailoverOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/03 22:02:45 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingFailoverOnUpdateBucketOp stored in temp store"
}
2022/01/03 22:02:50 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 22:02:55 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2022/01/03 22:03:00 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2022/01/03 22:03:05 clusterSetup.go:346: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get deployed
2022/01/03 22:03:05 clusterSetup.go:354: App: TestEventingFailoverOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:03:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:03:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:03:05 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 22:03:05 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 22:03:11 Rebalance progress: 12.5
2022/01/03 22:03:16 Rebalance progress: 12.5
2022/01/03 22:03:21 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:03:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:03:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:03:21 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:03:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:03:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:03:31 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 22:03:36 Rebalance progress: 12.5
2022/01/03 22:03:41 Rebalance progress: 12.5
2022/01/03 22:03:46 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:03:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:03:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:03:46 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 22:03:46 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 22:03:51 Rebalance progress: 12.5
2022/01/03 22:03:56 Rebalance progress: 12.5
2022/01/03 22:04:01 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:04:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:04:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:04:01 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 22:04:06 Rebalance progress: 12.5
2022/01/03 22:04:11 Rebalance progress: 12.5
2022/01/03 22:04:16 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:04:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:04:16 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:04:21 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2022/01/03 22:04:26 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2022/01/03 22:04:31 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2022/01/03 22:04:36 clusterSetup.go:397: Waiting for app: TestEventingFailoverOnUpdateBucketOp to get un-deployed
2022/01/03 22:04:36 clusterSetup.go:405: App: TestEventingFailoverOnUpdateBucketOp got un-deployed
2022/01/03 22:04:36 eventingSetup.go:46: No eventing-con process running
2022/01/03 22:04:36 eventingSetup.go:418: Function: TestEventingFailoverOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingFailoverOnUpdateBucketOp deleting in background"
}
2022/01/03 22:04:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:04:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:04:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8614
2022/01/03 22:04:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:04:50 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:04:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:05:00 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 581
2022/01/03 22:05:05 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 581
2022/01/03 22:05:05 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingFailoverOnUpdateBucketOp (169.64s)
=== RUN   TestEventingKVRebalanceOnUpdateBucketOp
2022/01/03 22:05:15 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/01/03 22:05:15 clusterSetup.go:405: App: TestEventingKVRebalanceOnUpdateBucketOp got un-deployed
2022/01/03 22:05:15 eventingSetup.go:46: No eventing-con process running
2022/01/03 22:05:15 eventingSetup.go:418: Function: TestEventingKVRebalanceOnUpdateBucketOp delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingKVRebalanceOnUpdateBucketOp not found"
}
2022/01/03 22:05:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:05:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:05:22 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:05:23 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:05:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:05:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:05:33 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:05:33 eventingSetup.go:125: Deploying app: TestEventingKVRebalanceOnUpdateBucketOp. Item count src bucket: 0 dst bucket: 0
2022/01/03 22:05:35 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingKVRebalanceOnUpdateBucketOp stored in temp store"
}
2022/01/03 22:05:40 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 22:05:45 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2022/01/03 22:05:50 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2022/01/03 22:05:55 clusterSetup.go:346: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get deployed
2022/01/03 22:05:55 clusterSetup.go:354: App: TestEventingKVRebalanceOnUpdateBucketOp got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:05:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:05:55 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:05:55 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing,kv to the cluster
2022/01/03 22:05:55 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 22:06:00 Rebalance progress: 12.5
2022/01/03 22:06:05 Rebalance progress: 12.5
2022/01/03 22:06:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:06:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:06:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:06:10 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing,kv to the cluster
2022/01/03 22:06:10 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 22:06:15 Rebalance progress: 12.5
2022/01/03 22:06:20 Rebalance progress: 12.5
2022/01/03 22:06:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:06:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:06:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:06:25 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 22:06:30 Rebalance progress: 12.5
2022/01/03 22:06:35 Rebalance progress: 12.5
2022/01/03 22:06:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:06:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:06:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:06:45 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/01/03 22:06:51 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/01/03 22:06:56 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/01/03 22:07:01 clusterSetup.go:397: Waiting for app: TestEventingKVRebalanceOnUpdateBucketOp to get un-deployed
2022/01/03 22:07:01 clusterSetup.go:405: App: TestEventingKVRebalanceOnUpdateBucketOp got un-deployed
2022/01/03 22:07:01 eventingSetup.go:46: No eventing-con process running
2022/01/03 22:07:01 eventingSetup.go:418: Function: TestEventingKVRebalanceOnUpdateBucketOp delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingKVRebalanceOnUpdateBucketOp deleting in background"
}
2022/01/03 22:07:02 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:07:07 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:07:12 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6059
2022/01/03 22:07:17 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6059
2022/01/03 22:07:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:07:19 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:07:24 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:07:29 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6059
2022/01/03 22:07:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingKVRebalanceOnUpdateBucketOp (144.30s)
=== RUN   TestEventingRebInWithOps
2022/01/03 22:07:39 clusterSetup.go:397: Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/01/03 22:07:39 clusterSetup.go:405: App: TestEventingRebInWithOps got un-deployed
2022/01/03 22:07:39 eventingSetup.go:46: No eventing-con process running
2022/01/03 22:07:39 eventingSetup.go:418: Function: TestEventingRebInWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebInWithOps not found"
}
2022/01/03 22:07:41 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:07:46 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:07:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:07:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:07:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:07:53 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:07:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:07:58 eventingSetup.go:125: Deploying app: TestEventingRebInWithOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 22:07:59 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithOps stored in temp store"
}
2022/01/03 22:08:04 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2022/01/03 22:08:09 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2022/01/03 22:08:14 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2022/01/03 22:08:19 clusterSetup.go:346: Waiting for app: TestEventingRebInWithOps to get deployed
2022/01/03 22:08:19 clusterSetup.go:354: App: TestEventingRebInWithOps got deployed
2022/01/03 22:08:19 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 22:08:19 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/03 22:08:20 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 22:08:25 Rebalance progress: 12.5
2022/01/03 22:08:30 Rebalance progress: 12.5
2022/01/03 22:08:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:08:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:08:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:08:35 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 22:08:40 Rebalance progress: 12.5
2022/01/03 22:08:45 Rebalance progress: 12.5
2022/01/03 22:08:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:08:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:08:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:08:50 Waiting for src bucket item count to get to: 200000 curr count: 30889
2022/01/03 22:08:55 Waiting for src bucket item count to get to: 200000 curr count: 47363
2022/01/03 22:09:00 Waiting for src bucket item count to get to: 200000 curr count: 47363
2022/01/03 22:09:05 Waiting for src bucket item count to get to: 200000 curr count: 63803
2022/01/03 22:09:10 Waiting for src bucket item count to get to: 200000 curr count: 63803
2022/01/03 22:09:15 Waiting for src bucket item count to get to: 200000 curr count: 79537
2022/01/03 22:09:20 Waiting for src bucket item count to get to: 200000 curr count: 79537
2022/01/03 22:09:25 Waiting for src bucket item count to get to: 200000 curr count: 95903
2022/01/03 22:09:30 Waiting for src bucket item count to get to: 200000 curr count: 95903
2022/01/03 22:09:35 Waiting for src bucket item count to get to: 200000 curr count: 112358
2022/01/03 22:09:40 Waiting for src bucket item count to get to: 200000 curr count: 128770
2022/01/03 22:09:45 Waiting for src bucket item count to get to: 200000 curr count: 128770
2022/01/03 22:09:50 Waiting for src bucket item count to get to: 200000 curr count: 145127
2022/01/03 22:09:55 Waiting for src bucket item count to get to: 200000 curr count: 145127
2022/01/03 22:10:00 Waiting for src bucket item count to get to: 200000 curr count: 161264
2022/01/03 22:10:05 Waiting for src bucket item count to get to: 200000 curr count: 161264
2022/01/03 22:10:10 Waiting for src bucket item count to get to: 200000 curr count: 161264
2022/01/03 22:10:15 Waiting for src bucket item count to get to: 200000 curr count: 176561
2022/01/03 22:10:20 Waiting for src bucket item count to get to: 200000 curr count: 176561
2022/01/03 22:10:25 Waiting for src bucket item count to get to: 200000 curr count: 192860
2022/01/03 22:10:30 Waiting for src bucket item count to get to: 200000 curr count: 192860
2022/01/03 22:10:35 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 22:10:35 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 22:10:35 Starting bucket ops to source bucket
2022/01/03 22:14:21 Waiting for dst bucket item count to get to: 0 curr count: 11422
2022/01/03 22:14:26 Waiting for dst bucket item count to get to: 0 curr count: 11422
2022/01/03 22:14:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:14:26 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 22:14:31 Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/01/03 22:14:36 Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/01/03 22:14:41 Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/01/03 22:14:46 Waiting for app: TestEventingRebInWithOps to get un-deployed
2022/01/03 22:14:46 App: TestEventingRebInWithOps got un-deployed
2022/01/03 22:14:46 No eventing-con process running
2022/01/03 22:14:46 Function: TestEventingRebInWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithOps deleting in background"
}
2022/01/03 22:14:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:14:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:14:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:14:54 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:14:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:14:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebInWithOps (450.02s)
=== RUN   TestEventingRebOutWithOps
2022/01/03 22:15:04 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 22:15:05 Removing node(s): [] from the cluster
2022/01/03 22:15:10 Rebalance progress: 100
2022/01/03 22:15:15 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/01/03 22:15:15 App: TestEventingRebOutWithOps got un-deployed
2022/01/03 22:15:15 No eventing-con process running
2022/01/03 22:15:15 Function: TestEventingRebOutWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebOutWithOps not found"
}
2022/01/03 22:15:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:15:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:15:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:15:23 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:15:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:15:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:15:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:15:33 Deploying app: TestEventingRebOutWithOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 22:15:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithOps stored in temp store"
}
2022/01/03 22:15:39 Waiting for app: TestEventingRebOutWithOps to get deployed
2022/01/03 22:15:44 Waiting for app: TestEventingRebOutWithOps to get deployed
2022/01/03 22:15:49 Waiting for app: TestEventingRebOutWithOps to get deployed
2022/01/03 22:15:54 Waiting for app: TestEventingRebOutWithOps to get deployed
2022/01/03 22:15:54 App: TestEventingRebOutWithOps got deployed
2022/01/03 22:15:54 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 22:15:54 Starting bucket ops to source bucket
2022/01/03 22:16:00 Rebalance progress: 12.5
2022/01/03 22:16:05 Rebalance progress: 12.5
2022/01/03 22:16:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:16:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:16:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:16:10 Waiting for src bucket item count to get to: 200000 curr count: 7033
2022/01/03 22:16:15 Waiting for src bucket item count to get to: 200000 curr count: 23283
2022/01/03 22:16:20 Waiting for src bucket item count to get to: 200000 curr count: 23283
2022/01/03 22:16:25 Waiting for src bucket item count to get to: 200000 curr count: 39773
2022/01/03 22:16:30 Waiting for src bucket item count to get to: 200000 curr count: 39773
2022/01/03 22:16:35 Waiting for src bucket item count to get to: 200000 curr count: 55974
2022/01/03 22:16:40 Waiting for src bucket item count to get to: 200000 curr count: 55974
2022/01/03 22:16:45 Waiting for src bucket item count to get to: 200000 curr count: 55974
2022/01/03 22:16:50 Waiting for src bucket item count to get to: 200000 curr count: 72514
2022/01/03 22:16:55 Waiting for src bucket item count to get to: 200000 curr count: 87785
2022/01/03 22:17:00 Waiting for src bucket item count to get to: 200000 curr count: 87785
2022/01/03 22:17:05 Waiting for src bucket item count to get to: 200000 curr count: 104219
2022/01/03 22:17:10 Waiting for src bucket item count to get to: 200000 curr count: 104219
2022/01/03 22:17:15 Waiting for src bucket item count to get to: 200000 curr count: 120721
2022/01/03 22:17:20 Waiting for src bucket item count to get to: 200000 curr count: 120721
2022/01/03 22:17:25 Waiting for src bucket item count to get to: 200000 curr count: 137344
2022/01/03 22:17:30 Waiting for src bucket item count to get to: 200000 curr count: 137344
2022/01/03 22:17:35 Waiting for src bucket item count to get to: 200000 curr count: 153885
2022/01/03 22:17:40 Waiting for src bucket item count to get to: 200000 curr count: 153885
2022/01/03 22:17:45 Waiting for src bucket item count to get to: 200000 curr count: 170489
2022/01/03 22:17:50 Waiting for src bucket item count to get to: 200000 curr count: 170489
2022/01/03 22:17:55 Waiting for src bucket item count to get to: 200000 curr count: 185403
2022/01/03 22:18:00 Waiting for src bucket item count to get to: 200000 curr count: 185403
2022/01/03 22:18:05 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 22:18:05 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 22:18:05 Starting bucket ops to source bucket
2022/01/03 22:21:50 Waiting for dst bucket item count to get to: 0 curr count: 9990
2022/01/03 22:21:55 Waiting for dst bucket item count to get to: 0 curr count: 9990
2022/01/03 22:21:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:21:55 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 22:22:00 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/01/03 22:22:05 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/01/03 22:22:10 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/01/03 22:22:15 Waiting for app: TestEventingRebOutWithOps to get un-deployed
2022/01/03 22:22:15 App: TestEventingRebOutWithOps got un-deployed
2022/01/03 22:22:15 No eventing-con process running
2022/01/03 22:22:15 Function: TestEventingRebOutWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithOps deleting in background"
}
2022/01/03 22:22:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:22:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:22:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:22:24 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:22:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:22:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebOutWithOps (449.49s)
=== RUN   TestEventingSwapRebWithOps
2022/01/03 22:22:39 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/01/03 22:22:39 App: TestEventingSwapRebWithOps got un-deployed
2022/01/03 22:22:39 No eventing-con process running
2022/01/03 22:22:39 Function: TestEventingSwapRebWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebWithOps not found"
}
2022/01/03 22:22:41 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:22:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:22:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:22:47 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:22:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:22:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:22:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:22:57 Deploying app: TestEventingSwapRebWithOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 22:22:58 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithOps stored in temp store"
}
2022/01/03 22:23:03 Waiting for app: TestEventingSwapRebWithOps to get deployed
2022/01/03 22:23:08 Waiting for app: TestEventingSwapRebWithOps to get deployed
2022/01/03 22:23:13 Waiting for app: TestEventingSwapRebWithOps to get deployed
2022/01/03 22:23:18 Waiting for app: TestEventingSwapRebWithOps to get deployed
2022/01/03 22:23:18 App: TestEventingSwapRebWithOps got deployed
2022/01/03 22:23:18 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 22:23:18 Starting bucket ops to source bucket
2022/01/03 22:23:19 Removing node(s): [] from the cluster
2022/01/03 22:23:24 Rebalance progress: 12.5
2022/01/03 22:23:29 Rebalance progress: 12.5
2022/01/03 22:23:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:23:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:23:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:23:34 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 22:23:34 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 22:23:39 Rebalance progress: 12.5
2022/01/03 22:23:44 Rebalance progress: 12.5
2022/01/03 22:23:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:23:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:23:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:23:49 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 22:23:54 Rebalance progress: 12.5
2022/01/03 22:23:59 Rebalance progress: 12.5
2022/01/03 22:24:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:24:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:24:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:24:04 Waiting for src bucket item count to get to: 200000 curr count: 63670
2022/01/03 22:24:09 Waiting for src bucket item count to get to: 200000 curr count: 63670
2022/01/03 22:24:14 Waiting for src bucket item count to get to: 200000 curr count: 78647
2022/01/03 22:24:19 Waiting for src bucket item count to get to: 200000 curr count: 78647
2022/01/03 22:24:24 Waiting for src bucket item count to get to: 200000 curr count: 94645
2022/01/03 22:24:29 Waiting for src bucket item count to get to: 200000 curr count: 94645
2022/01/03 22:24:35 Waiting for src bucket item count to get to: 200000 curr count: 111353
2022/01/03 22:24:40 Waiting for src bucket item count to get to: 200000 curr count: 111353
2022/01/03 22:24:45 Waiting for src bucket item count to get to: 200000 curr count: 127862
2022/01/03 22:24:50 Waiting for src bucket item count to get to: 200000 curr count: 127862
2022/01/03 22:24:55 Waiting for src bucket item count to get to: 200000 curr count: 144271
2022/01/03 22:25:00 Waiting for src bucket item count to get to: 200000 curr count: 144271
2022/01/03 22:25:05 Waiting for src bucket item count to get to: 200000 curr count: 160860
2022/01/03 22:25:10 Waiting for src bucket item count to get to: 200000 curr count: 160860
2022/01/03 22:25:15 Waiting for src bucket item count to get to: 200000 curr count: 160860
2022/01/03 22:25:20 Waiting for src bucket item count to get to: 200000 curr count: 175991
2022/01/03 22:25:25 Waiting for src bucket item count to get to: 200000 curr count: 192064
2022/01/03 22:25:30 Waiting for src bucket item count to get to: 200000 curr count: 192064
2022/01/03 22:25:35 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 22:25:35 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 22:25:35 Starting bucket ops to source bucket
2022/01/03 22:29:20 Waiting for dst bucket item count to get to: 0 curr count: 9828
2022/01/03 22:29:25 Waiting for dst bucket item count to get to: 0 curr count: 9828
2022/01/03 22:29:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:29:25 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 22:29:30 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/01/03 22:29:35 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/01/03 22:29:40 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/01/03 22:29:45 Waiting for app: TestEventingSwapRebWithOps to get un-deployed
2022/01/03 22:29:45 App: TestEventingSwapRebWithOps got un-deployed
2022/01/03 22:29:45 No eventing-con process running
2022/01/03 22:29:45 Function: TestEventingSwapRebWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithOps deleting in background"
}
2022/01/03 22:29:47 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:29:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:29:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:29:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:29:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:29:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebWithOps (449.68s)
=== RUN   TestKVRebInWithOps
2022/01/03 22:30:08 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/01/03 22:30:08 App: TestKVRebInWithOps got un-deployed
2022/01/03 22:30:08 No eventing-con process running
2022/01/03 22:30:08 Function: TestKVRebInWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebInWithOps not found"
}
2022/01/03 22:30:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:30:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:30:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:30:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:30:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:30:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:30:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:30:27 Deploying app: TestKVRebInWithOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 22:30:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithOps stored in temp store"
}
2022/01/03 22:30:33 Waiting for app: TestKVRebInWithOps to get deployed
2022/01/03 22:30:38 Waiting for app: TestKVRebInWithOps to get deployed
2022/01/03 22:30:43 Waiting for app: TestKVRebInWithOps to get deployed
2022/01/03 22:30:48 Waiting for app: TestKVRebInWithOps to get deployed
2022/01/03 22:30:48 App: TestKVRebInWithOps got deployed
2022/01/03 22:30:48 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 22:30:48 Starting bucket ops to source bucket
2022/01/03 22:30:49 Removing node(s): [] from the cluster
2022/01/03 22:30:54 Rebalance progress: 12.5
2022/01/03 22:30:59 Rebalance progress: 12.5
2022/01/03 22:31:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:31:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:31:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:31:04 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 22:31:09 Rebalance progress: 12.5
2022/01/03 22:31:14 Rebalance progress: 12.5
2022/01/03 22:31:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:31:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:31:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:31:19 Waiting for src bucket item count to get to: 200000 curr count: 31696
2022/01/03 22:31:24 Waiting for src bucket item count to get to: 200000 curr count: 47655
2022/01/03 22:31:29 Waiting for src bucket item count to get to: 200000 curr count: 47655
2022/01/03 22:31:34 Waiting for src bucket item count to get to: 200000 curr count: 64167
2022/01/03 22:31:39 Waiting for src bucket item count to get to: 200000 curr count: 64167
2022/01/03 22:31:44 Waiting for src bucket item count to get to: 200000 curr count: 79692
2022/01/03 22:31:49 Waiting for src bucket item count to get to: 200000 curr count: 79692
2022/01/03 22:31:54 Waiting for src bucket item count to get to: 200000 curr count: 95985
2022/01/03 22:31:59 Waiting for src bucket item count to get to: 200000 curr count: 95985
2022/01/03 22:32:04 Waiting for src bucket item count to get to: 200000 curr count: 112198
2022/01/03 22:32:09 Waiting for src bucket item count to get to: 200000 curr count: 112198
2022/01/03 22:32:14 Waiting for src bucket item count to get to: 200000 curr count: 128474
2022/01/03 22:32:19 Waiting for src bucket item count to get to: 200000 curr count: 128474
2022/01/03 22:32:24 Waiting for src bucket item count to get to: 200000 curr count: 144743
2022/01/03 22:32:29 Waiting for src bucket item count to get to: 200000 curr count: 144743
2022/01/03 22:32:34 Waiting for src bucket item count to get to: 200000 curr count: 160703
2022/01/03 22:32:39 Waiting for src bucket item count to get to: 200000 curr count: 160703
2022/01/03 22:32:44 Waiting for src bucket item count to get to: 200000 curr count: 160703
2022/01/03 22:32:49 Waiting for src bucket item count to get to: 200000 curr count: 175735
2022/01/03 22:32:54 Waiting for src bucket item count to get to: 200000 curr count: 175735
2022/01/03 22:32:59 Waiting for src bucket item count to get to: 200000 curr count: 191619
2022/01/03 22:33:04 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 22:33:04 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 22:33:04 Starting bucket ops to source bucket
2022/01/03 22:36:50 Waiting for dst bucket item count to get to: 0 curr count: 10402
2022/01/03 22:36:55 Waiting for dst bucket item count to get to: 0 curr count: 10402
2022/01/03 22:36:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:36:55 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 22:37:00 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/01/03 22:37:05 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/01/03 22:37:10 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/01/03 22:37:15 Waiting for app: TestKVRebInWithOps to get un-deployed
2022/01/03 22:37:15 App: TestKVRebInWithOps got un-deployed
2022/01/03 22:37:15 No eventing-con process running
2022/01/03 22:37:15 Function: TestKVRebInWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithOps deleting in background"
}
2022/01/03 22:37:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:37:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:37:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:37:24 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:37:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:37:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebInWithOps (450.39s)
=== RUN   TestKVRebOutWithOps
2022/01/03 22:37:34 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 22:37:34 Removing node(s): [] from the cluster
2022/01/03 22:37:39 Rebalance progress: 100
2022/01/03 22:37:44 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/01/03 22:37:44 App: TestKVRebOutWithOps got un-deployed
2022/01/03 22:37:44 No eventing-con process running
2022/01/03 22:37:44 Function: TestKVRebOutWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebOutWithOps not found"
}
2022/01/03 22:37:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:37:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:37:51 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:37:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:37:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:37:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:38:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:38:03 Deploying app: TestKVRebOutWithOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 22:38:04 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithOps stored in temp store"
}
2022/01/03 22:38:09 Waiting for app: TestKVRebOutWithOps to get deployed
2022/01/03 22:38:14 Waiting for app: TestKVRebOutWithOps to get deployed
2022/01/03 22:38:19 Waiting for app: TestKVRebOutWithOps to get deployed
2022/01/03 22:38:24 Waiting for app: TestKVRebOutWithOps to get deployed
2022/01/03 22:38:24 App: TestKVRebOutWithOps got deployed
2022/01/03 22:38:24 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 22:38:24 Starting bucket ops to source bucket
2022/01/03 22:38:29 Rebalance progress: 12.5
2022/01/03 22:38:34 Rebalance progress: 12.5
2022/01/03 22:38:39 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:38:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:38:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:38:39 Waiting for src bucket item count to get to: 200000 curr count: 7875
2022/01/03 22:38:44 Waiting for src bucket item count to get to: 200000 curr count: 24125
2022/01/03 22:38:49 Waiting for src bucket item count to get to: 200000 curr count: 24125
2022/01/03 22:38:54 Waiting for src bucket item count to get to: 200000 curr count: 40547
2022/01/03 22:38:59 Waiting for src bucket item count to get to: 200000 curr count: 40547
2022/01/03 22:39:04 Waiting for src bucket item count to get to: 200000 curr count: 57005
2022/01/03 22:39:09 Waiting for src bucket item count to get to: 200000 curr count: 57005
2022/01/03 22:39:14 Waiting for src bucket item count to get to: 200000 curr count: 57005
2022/01/03 22:39:19 Waiting for src bucket item count to get to: 200000 curr count: 73543
2022/01/03 22:39:24 Waiting for src bucket item count to get to: 200000 curr count: 73543
2022/01/03 22:39:29 Waiting for src bucket item count to get to: 200000 curr count: 88886
2022/01/03 22:39:34 Waiting for src bucket item count to get to: 200000 curr count: 88886
2022/01/03 22:39:39 Waiting for src bucket item count to get to: 200000 curr count: 105462
2022/01/03 22:39:44 Waiting for src bucket item count to get to: 200000 curr count: 105462
2022/01/03 22:39:49 Waiting for src bucket item count to get to: 200000 curr count: 121876
2022/01/03 22:39:54 Waiting for src bucket item count to get to: 200000 curr count: 138207
2022/01/03 22:39:59 Waiting for src bucket item count to get to: 200000 curr count: 138207
2022/01/03 22:40:04 Waiting for src bucket item count to get to: 200000 curr count: 154472
2022/01/03 22:40:09 Waiting for src bucket item count to get to: 200000 curr count: 154472
2022/01/03 22:40:14 Waiting for src bucket item count to get to: 200000 curr count: 170965
2022/01/03 22:40:19 Waiting for src bucket item count to get to: 200000 curr count: 170965
2022/01/03 22:40:24 Waiting for src bucket item count to get to: 200000 curr count: 186176
2022/01/03 22:40:29 Waiting for src bucket item count to get to: 200000 curr count: 186176
2022/01/03 22:40:34 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 22:40:34 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 22:40:34 Starting bucket ops to source bucket
2022/01/03 22:44:20 Waiting for dst bucket item count to get to: 0 curr count: 9122
2022/01/03 22:44:25 Waiting for dst bucket item count to get to: 0 curr count: 9122
2022/01/03 22:44:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:44:25 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 22:44:30 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/01/03 22:44:35 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/01/03 22:44:40 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/01/03 22:44:45 Waiting for app: TestKVRebOutWithOps to get un-deployed
2022/01/03 22:44:45 App: TestKVRebOutWithOps got un-deployed
2022/01/03 22:44:45 No eventing-con process running
2022/01/03 22:44:45 Function: TestKVRebOutWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithOps deleting in background"
}
2022/01/03 22:44:47 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:44:52 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:44:52 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:44:53 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:44:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:44:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOutWithOps (449.46s)
=== RUN   TestKVSwapRebWithOps
2022/01/03 22:45:08 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/01/03 22:45:08 App: TestKVSwapRebWithOps got un-deployed
2022/01/03 22:45:08 No eventing-con process running
2022/01/03 22:45:08 Function: TestKVSwapRebWithOps delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVSwapRebWithOps not found"
}
2022/01/03 22:45:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:45:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:45:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:45:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:45:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:45:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:45:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:45:27 Deploying app: TestKVSwapRebWithOps. Item count src bucket: 0 dst bucket: 0
2022/01/03 22:45:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithOps stored in temp store"
}
2022/01/03 22:45:33 Waiting for app: TestKVSwapRebWithOps to get deployed
2022/01/03 22:45:38 Waiting for app: TestKVSwapRebWithOps to get deployed
2022/01/03 22:45:43 Waiting for app: TestKVSwapRebWithOps to get deployed
2022/01/03 22:45:48 Waiting for app: TestKVSwapRebWithOps to get deployed
2022/01/03 22:45:48 App: TestKVSwapRebWithOps got deployed
2022/01/03 22:45:48 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 22:45:48 Starting bucket ops to source bucket
2022/01/03 22:45:48 Removing node(s): [] from the cluster
2022/01/03 22:45:53 Rebalance progress: 12.5
2022/01/03 22:45:58 Rebalance progress: 12.5
2022/01/03 22:46:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:46:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:46:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:46:03 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/03 22:46:04 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 22:46:09 Rebalance progress: 12.5
2022/01/03 22:46:14 Rebalance progress: 12.5
2022/01/03 22:46:19 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:46:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:46:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:46:19 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 22:46:24 Rebalance progress: 12.5
2022/01/03 22:46:29 Rebalance progress: 12.5
2022/01/03 22:46:34 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:46:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:46:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:46:34 Waiting for src bucket item count to get to: 200000 curr count: 64149
2022/01/03 22:46:39 Waiting for src bucket item count to get to: 200000 curr count: 64149
2022/01/03 22:46:44 Waiting for src bucket item count to get to: 200000 curr count: 79319
2022/01/03 22:46:49 Waiting for src bucket item count to get to: 200000 curr count: 79319
2022/01/03 22:46:54 Waiting for src bucket item count to get to: 200000 curr count: 95406
2022/01/03 22:46:59 Waiting for src bucket item count to get to: 200000 curr count: 95406
2022/01/03 22:47:04 Waiting for src bucket item count to get to: 200000 curr count: 111937
2022/01/03 22:47:09 Waiting for src bucket item count to get to: 200000 curr count: 111937
2022/01/03 22:47:14 Waiting for src bucket item count to get to: 200000 curr count: 128386
2022/01/03 22:47:19 Waiting for src bucket item count to get to: 200000 curr count: 128386
2022/01/03 22:47:24 Waiting for src bucket item count to get to: 200000 curr count: 144937
2022/01/03 22:47:29 Waiting for src bucket item count to get to: 200000 curr count: 144937
2022/01/03 22:47:34 Waiting for src bucket item count to get to: 200000 curr count: 144937
2022/01/03 22:47:39 Waiting for src bucket item count to get to: 200000 curr count: 161333
2022/01/03 22:47:44 Waiting for src bucket item count to get to: 200000 curr count: 161333
2022/01/03 22:47:49 Waiting for src bucket item count to get to: 200000 curr count: 176305
2022/01/03 22:47:54 Waiting for src bucket item count to get to: 200000 curr count: 176305
2022/01/03 22:47:59 Waiting for src bucket item count to get to: 200000 curr count: 192337
2022/01/03 22:48:04 Waiting for src bucket item count to get to: 200000 curr count: 192337
2022/01/03 22:48:09 src & dst bucket item count matched up. src bucket count: 200000 dst bucket count: 200000
2022/01/03 22:48:09 Post SET ops. Expected item count: 200000 got 200000
2022/01/03 22:48:09 Starting bucket ops to source bucket
2022/01/03 22:51:55 Waiting for dst bucket item count to get to: 0 curr count: 19162
2022/01/03 22:52:00 Waiting for dst bucket item count to get to: 0 curr count: 611
2022/01/03 22:52:05 Waiting for dst bucket item count to get to: 0 curr count: 611
2022/01/03 22:52:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:52:05 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 22:52:10 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/01/03 22:52:15 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/01/03 22:52:20 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/01/03 22:52:25 Waiting for app: TestKVSwapRebWithOps to get un-deployed
2022/01/03 22:52:25 App: TestKVSwapRebWithOps got un-deployed
2022/01/03 22:52:25 No eventing-con process running
2022/01/03 22:52:25 Function: TestKVSwapRebWithOps delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithOps deleting in background"
}
2022/01/03 22:52:27 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:52:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:52:32 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:52:33 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:52:38 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:52:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebWithOps (460.10s)
=== RUN   TestEventingRebInWithTimers
2022/01/03 22:52:48 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/01/03 22:52:48 App: TestEventingRebInWithTimers got un-deployed
2022/01/03 22:52:48 No eventing-con process running
2022/01/03 22:52:48 Function: TestEventingRebInWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebInWithTimers not found"
}
2022/01/03 22:52:50 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:52:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:52:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:52:57 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:53:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:53:02 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:53:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:53:07 Deploying app: TestEventingRebInWithTimers. Item count src bucket: 0 dst bucket: 0
2022/01/03 22:53:08 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithTimers stored in temp store"
}
2022/01/03 22:53:13 Waiting for app: TestEventingRebInWithTimers to get deployed
2022/01/03 22:53:18 Waiting for app: TestEventingRebInWithTimers to get deployed
2022/01/03 22:53:23 Waiting for app: TestEventingRebInWithTimers to get deployed
2022/01/03 22:53:28 Waiting for app: TestEventingRebInWithTimers to get deployed
2022/01/03 22:53:28 App: TestEventingRebInWithTimers got deployed
2022/01/03 22:53:28 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 22:53:28 Starting bucket ops to source bucket
2022/01/03 22:53:28 Removing node(s): [] from the cluster
2022/01/03 22:53:33 Rebalance progress: 12.5
2022/01/03 22:53:38 Rebalance progress: 12.5
2022/01/03 22:53:43 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:53:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:53:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:53:43 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 22:53:49 Rebalance progress: 12.5
2022/01/03 22:53:54 Rebalance progress: 12.5
2022/01/03 22:53:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:53:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:53:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:53:59 Waiting for src bucket item count to get to: 50000 curr count: 27073
2022/01/03 22:54:04 Waiting for src bucket item count to get to: 50000 curr count: 36927
2022/01/03 22:54:09 Waiting for src bucket item count to get to: 50000 curr count: 36927
2022/01/03 22:54:14 Waiting for src bucket item count to get to: 50000 curr count: 49511
2022/01/03 22:54:19 Waiting for src bucket item count to get to: 50000 curr count: 49511
2022/01/03 22:54:29 Waiting for dst bucket item count to get to: 50000 curr count: 46886
2022/01/03 22:54:34 Waiting for dst bucket item count to get to: 50000 curr count: 46886
2022/01/03 22:54:34 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 22:54:34 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 22:54:34 Starting bucket ops to source bucket
2022/01/03 22:55:43 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 22:55:48 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 22:55:53 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 22:55:58 Waiting for dst bucket item count to get to: 0 curr count: 41021
2022/01/03 22:56:03 Waiting for dst bucket item count to get to: 0 curr count: 41021
2022/01/03 22:56:08 Waiting for dst bucket item count to get to: 0 curr count: 27140
2022/01/03 22:56:13 Waiting for dst bucket item count to get to: 0 curr count: 27140
2022/01/03 22:56:18 Waiting for dst bucket item count to get to: 0 curr count: 10425
2022/01/03 22:56:23 Waiting for dst bucket item count to get to: 0 curr count: 10425
2022/01/03 22:56:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:56:23 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 22:56:28 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/01/03 22:56:33 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/01/03 22:56:38 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/01/03 22:56:43 Waiting for app: TestEventingRebInWithTimers to get un-deployed
2022/01/03 22:56:43 App: TestEventingRebInWithTimers got un-deployed
2022/01/03 22:56:43 No eventing-con process running
2022/01/03 22:56:43 Function: TestEventingRebInWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebInWithTimers deleting in background"
}
2022/01/03 22:56:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:56:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:56:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:56:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:56:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:56:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebInWithTimers (258.08s)
=== RUN   TestEventingRebOutWithTimers
2022/01/03 22:57:01 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 22:57:02 Removing node(s): [] from the cluster
2022/01/03 22:57:07 Rebalance progress: 100
2022/01/03 22:57:12 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/01/03 22:57:12 App: TestEventingRebOutWithTimers got un-deployed
2022/01/03 22:57:12 No eventing-con process running
2022/01/03 22:57:12 Function: TestEventingRebOutWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingRebOutWithTimers not found"
}
2022/01/03 22:57:14 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:57:19 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:57:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 22:57:21 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:57:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:57:26 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:57:31 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 22:57:31 Deploying app: TestEventingRebOutWithTimers. Item count src bucket: 0 dst bucket: 0
2022/01/03 22:57:32 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithTimers stored in temp store"
}
2022/01/03 22:57:37 Waiting for app: TestEventingRebOutWithTimers to get deployed
2022/01/03 22:57:42 Waiting for app: TestEventingRebOutWithTimers to get deployed
2022/01/03 22:57:47 Waiting for app: TestEventingRebOutWithTimers to get deployed
2022/01/03 22:57:52 Waiting for app: TestEventingRebOutWithTimers to get deployed
2022/01/03 22:57:52 App: TestEventingRebOutWithTimers got deployed
2022/01/03 22:57:52 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 22:57:52 Starting bucket ops to source bucket
2022/01/03 22:57:57 Rebalance progress: 12.5
2022/01/03 22:58:02 Rebalance progress: 12.5
2022/01/03 22:58:07 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:58:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 22:58:07 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 22:58:07 Waiting for src bucket item count to get to: 50000 curr count: 9724
2022/01/03 22:58:12 Waiting for src bucket item count to get to: 50000 curr count: 21576
2022/01/03 22:58:17 Waiting for src bucket item count to get to: 50000 curr count: 21576
2022/01/03 22:58:22 Waiting for src bucket item count to get to: 50000 curr count: 33335
2022/01/03 22:58:27 Waiting for src bucket item count to get to: 50000 curr count: 33335
2022/01/03 22:58:32 Waiting for src bucket item count to get to: 50000 curr count: 43574
2022/01/03 22:58:37 Waiting for src bucket item count to get to: 50000 curr count: 43574
2022/01/03 22:58:42 Waiting for src bucket item count to get to: 50000 curr count: 43574
2022/01/03 22:58:52 Waiting for dst bucket item count to get to: 50000 curr count: 41260
2022/01/03 22:58:57 Waiting for dst bucket item count to get to: 50000 curr count: 41260
2022/01/03 22:58:57 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 22:58:57 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 22:58:57 Starting bucket ops to source bucket
2022/01/03 23:00:06 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:00:11 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:00:16 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:00:21 Waiting for dst bucket item count to get to: 0 curr count: 43687
2022/01/03 23:00:26 Waiting for dst bucket item count to get to: 0 curr count: 43687
2022/01/03 23:00:31 Waiting for dst bucket item count to get to: 0 curr count: 30549
2022/01/03 23:00:36 Waiting for dst bucket item count to get to: 0 curr count: 30549
2022/01/03 23:00:41 Waiting for dst bucket item count to get to: 0 curr count: 10162
2022/01/03 23:00:46 Waiting for dst bucket item count to get to: 0 curr count: 10162
2022/01/03 23:00:46 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:00:46 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 23:00:51 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/01/03 23:00:57 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/01/03 23:01:02 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/01/03 23:01:07 Waiting for app: TestEventingRebOutWithTimers to get un-deployed
2022/01/03 23:01:07 App: TestEventingRebOutWithTimers got un-deployed
2022/01/03 23:01:07 No eventing-con process running
2022/01/03 23:01:07 Function: TestEventingRebOutWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingRebOutWithTimers deleting in background"
}
2022/01/03 23:01:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:01:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:01:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:01:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:01:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:01:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingRebOutWithTimers (263.64s)
=== RUN   TestEventingSwapRebWithTimers
2022/01/03 23:01:30 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/01/03 23:01:30 App: TestEventingSwapRebWithTimers got un-deployed
2022/01/03 23:01:30 No eventing-con process running
2022/01/03 23:01:30 Function: TestEventingSwapRebWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestEventingSwapRebWithTimers not found"
}
2022/01/03 23:01:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:01:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:01:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:01:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:01:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:01:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:01:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:01:49 Deploying app: TestEventingSwapRebWithTimers. Item count src bucket: 0 dst bucket: 0
2022/01/03 23:01:50 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithTimers stored in temp store"
}
2022/01/03 23:01:55 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2022/01/03 23:02:00 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2022/01/03 23:02:05 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2022/01/03 23:02:10 Waiting for app: TestEventingSwapRebWithTimers to get deployed
2022/01/03 23:02:10 App: TestEventingSwapRebWithTimers got deployed
2022/01/03 23:02:10 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 23:02:10 Starting bucket ops to source bucket
2022/01/03 23:02:10 Removing node(s): [] from the cluster
2022/01/03 23:02:15 Rebalance progress: 12.5
2022/01/03 23:02:20 Rebalance progress: 12.5
2022/01/03 23:02:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:02:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:02:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:02:25 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 23:02:26 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 23:02:31 Rebalance progress: 12.5
2022/01/03 23:02:36 Rebalance progress: 12.5
2022/01/03 23:02:41 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:02:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:02:41 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:02:41 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 23:02:46 Rebalance progress: 12.5
2022/01/03 23:02:51 Rebalance progress: 12.5
2022/01/03 23:02:56 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:02:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:02:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:02:56 Waiting for src bucket item count to get to: 50000 curr count: 47661
2022/01/03 23:03:06 Waiting for dst bucket item count to get to: 50000 curr count: 40558
2022/01/03 23:03:11 Waiting for dst bucket item count to get to: 50000 curr count: 40558
2022/01/03 23:03:11 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 23:03:11 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 23:03:11 Starting bucket ops to source bucket
2022/01/03 23:04:20 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:04:25 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:04:30 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:04:35 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:04:40 Waiting for dst bucket item count to get to: 0 curr count: 43618
2022/01/03 23:04:45 Waiting for dst bucket item count to get to: 0 curr count: 43618
2022/01/03 23:04:50 Waiting for dst bucket item count to get to: 0 curr count: 24852
2022/01/03 23:04:55 Waiting for dst bucket item count to get to: 0 curr count: 24852
2022/01/03 23:05:00 Waiting for dst bucket item count to get to: 0 curr count: 13691
2022/01/03 23:05:05 Waiting for dst bucket item count to get to: 0 curr count: 13691
2022/01/03 23:05:05 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:05:05 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 23:05:11 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/01/03 23:05:16 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/01/03 23:05:21 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/01/03 23:05:26 Waiting for app: TestEventingSwapRebWithTimers to get un-deployed
2022/01/03 23:05:26 App: TestEventingSwapRebWithTimers got un-deployed
2022/01/03 23:05:26 No eventing-con process running
2022/01/03 23:05:26 Function: TestEventingSwapRebWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestEventingSwapRebWithTimers deleting in background"
}
2022/01/03 23:05:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:05:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:05:33 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:05:34 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:05:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:05:39 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestEventingSwapRebWithTimers (259.29s)
=== RUN   TestKVRebInWithTimers
2022/01/03 23:05:49 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/01/03 23:05:49 App: TestKVRebInWithTimers got un-deployed
2022/01/03 23:05:49 No eventing-con process running
2022/01/03 23:05:49 Function: TestKVRebInWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebInWithTimers not found"
}
2022/01/03 23:05:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:05:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:05:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:05:58 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:06:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:06:03 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:06:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:06:08 Deploying app: TestKVRebInWithTimers. Item count src bucket: 0 dst bucket: 0
2022/01/03 23:06:09 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithTimers stored in temp store"
}
2022/01/03 23:06:14 Waiting for app: TestKVRebInWithTimers to get deployed
2022/01/03 23:06:19 Waiting for app: TestKVRebInWithTimers to get deployed
2022/01/03 23:06:24 Waiting for app: TestKVRebInWithTimers to get deployed
2022/01/03 23:06:29 Waiting for app: TestKVRebInWithTimers to get deployed
2022/01/03 23:06:29 App: TestKVRebInWithTimers got deployed
2022/01/03 23:06:29 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 23:06:29 Starting bucket ops to source bucket
2022/01/03 23:06:29 Removing node(s): [] from the cluster
2022/01/03 23:06:34 Rebalance progress: 12.5
2022/01/03 23:06:39 Rebalance progress: 12.5
2022/01/03 23:06:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:06:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:06:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:06:44 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 23:06:49 Rebalance progress: 12.5
2022/01/03 23:06:54 Rebalance progress: 12.5
2022/01/03 23:06:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:06:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:06:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:07:00 Waiting for src bucket item count to get to: 50000 curr count: 27231
2022/01/03 23:07:05 Waiting for src bucket item count to get to: 50000 curr count: 36675
2022/01/03 23:07:10 Waiting for src bucket item count to get to: 50000 curr count: 36675
2022/01/03 23:07:15 Waiting for src bucket item count to get to: 50000 curr count: 48145
2022/01/03 23:07:20 Waiting for src bucket item count to get to: 50000 curr count: 48145
2022/01/03 23:07:30 Waiting for dst bucket item count to get to: 50000 curr count: 43716
2022/01/03 23:07:35 Waiting for dst bucket item count to get to: 50000 curr count: 43716
2022/01/03 23:07:40 Waiting for dst bucket item count to get to: 50000 curr count: 49823
2022/01/03 23:07:40 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 23:07:40 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 23:07:40 Starting bucket ops to source bucket
2022/01/03 23:08:49 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:08:54 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:08:59 Waiting for dst bucket item count to get to: 0 curr count: 47421
2022/01/03 23:09:04 Waiting for dst bucket item count to get to: 0 curr count: 47421
2022/01/03 23:09:09 Waiting for dst bucket item count to get to: 0 curr count: 36995
2022/01/03 23:09:14 Waiting for dst bucket item count to get to: 0 curr count: 36995
2022/01/03 23:09:19 Waiting for dst bucket item count to get to: 0 curr count: 26566
2022/01/03 23:09:24 Waiting for dst bucket item count to get to: 0 curr count: 26566
2022/01/03 23:09:29 Waiting for dst bucket item count to get to: 0 curr count: 4596
2022/01/03 23:09:34 Waiting for dst bucket item count to get to: 0 curr count: 4596
2022/01/03 23:09:34 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:09:34 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 23:09:39 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/01/03 23:09:44 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/01/03 23:09:49 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/01/03 23:09:54 Waiting for app: TestKVRebInWithTimers to get un-deployed
2022/01/03 23:09:54 App: TestKVRebInWithTimers got un-deployed
2022/01/03 23:09:54 No eventing-con process running
2022/01/03 23:09:54 Function: TestKVRebInWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebInWithTimers deleting in background"
}
2022/01/03 23:09:56 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:10:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:10:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:10:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:10:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:10:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebInWithTimers (268.55s)
=== RUN   TestKVRebOutWithTimers
2022/01/03 23:10:13 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 23:10:13 Removing node(s): [] from the cluster
2022/01/03 23:10:18 Rebalance progress: 100
2022/01/03 23:10:23 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/01/03 23:10:23 App: TestKVRebOutWithTimers got un-deployed
2022/01/03 23:10:23 No eventing-con process running
2022/01/03 23:10:23 Function: TestKVRebOutWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVRebOutWithTimers not found"
}
2022/01/03 23:10:25 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:10:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:10:30 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:10:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:10:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:10:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:10:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:10:42 Deploying app: TestKVRebOutWithTimers. Item count src bucket: 0 dst bucket: 0
2022/01/03 23:10:43 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithTimers stored in temp store"
}
2022/01/03 23:10:48 Waiting for app: TestKVRebOutWithTimers to get deployed
2022/01/03 23:10:53 Waiting for app: TestKVRebOutWithTimers to get deployed
2022/01/03 23:10:58 Waiting for app: TestKVRebOutWithTimers to get deployed
2022/01/03 23:11:03 Waiting for app: TestKVRebOutWithTimers to get deployed
2022/01/03 23:11:03 App: TestKVRebOutWithTimers got deployed
2022/01/03 23:11:03 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 23:11:03 Starting bucket ops to source bucket
2022/01/03 23:11:08 Rebalance progress: 12.5
2022/01/03 23:11:13 Rebalance progress: 12.5
2022/01/03 23:11:18 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:11:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:11:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:11:18 Waiting for src bucket item count to get to: 50000 curr count: 8214
2022/01/03 23:11:23 Waiting for src bucket item count to get to: 50000 curr count: 20471
2022/01/03 23:11:28 Waiting for src bucket item count to get to: 50000 curr count: 20471
2022/01/03 23:11:33 Waiting for src bucket item count to get to: 50000 curr count: 31834
2022/01/03 23:11:38 Waiting for src bucket item count to get to: 50000 curr count: 31834
2022/01/03 23:11:43 Waiting for src bucket item count to get to: 50000 curr count: 42890
2022/01/03 23:11:48 Waiting for src bucket item count to get to: 50000 curr count: 42890
2022/01/03 23:11:53 Waiting for src bucket item count to get to: 50000 curr count: 42890
2022/01/03 23:12:03 Waiting for dst bucket item count to get to: 50000 curr count: 41514
2022/01/03 23:12:08 Waiting for dst bucket item count to get to: 50000 curr count: 41514
2022/01/03 23:12:08 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 23:12:08 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 23:12:08 Starting bucket ops to source bucket
2022/01/03 23:13:18 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:13:23 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:13:28 Waiting for dst bucket item count to get to: 0 curr count: 44197
2022/01/03 23:13:33 Waiting for dst bucket item count to get to: 0 curr count: 44197
2022/01/03 23:13:38 Waiting for dst bucket item count to get to: 0 curr count: 35920
2022/01/03 23:13:43 Waiting for dst bucket item count to get to: 0 curr count: 35920
2022/01/03 23:13:48 Waiting for dst bucket item count to get to: 0 curr count: 11079
2022/01/03 23:13:53 Waiting for dst bucket item count to get to: 0 curr count: 11079
2022/01/03 23:13:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:13:53 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 23:13:58 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/01/03 23:14:03 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/01/03 23:14:08 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/01/03 23:14:13 Waiting for app: TestKVRebOutWithTimers to get un-deployed
2022/01/03 23:14:13 App: TestKVRebOutWithTimers got un-deployed
2022/01/03 23:14:13 No eventing-con process running
2022/01/03 23:14:13 Function: TestKVRebOutWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVRebOutWithTimers deleting in background"
}
2022/01/03 23:14:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:14:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:14:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:14:22 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:14:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:14:27 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOutWithTimers (258.91s)
=== RUN   TestKVSwapRebWithTimers
2022/01/03 23:14:37 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/01/03 23:14:37 App: TestKVSwapRebWithTimers got un-deployed
2022/01/03 23:14:37 No eventing-con process running
2022/01/03 23:14:37 Function: TestKVSwapRebWithTimers delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestKVSwapRebWithTimers not found"
}
2022/01/03 23:14:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:14:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:14:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:14:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:14:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:14:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:14:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:14:55 Deploying app: TestKVSwapRebWithTimers. Item count src bucket: 0 dst bucket: 0
2022/01/03 23:14:56 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithTimers stored in temp store"
}
2022/01/03 23:15:02 Waiting for app: TestKVSwapRebWithTimers to get deployed
2022/01/03 23:15:07 Waiting for app: TestKVSwapRebWithTimers to get deployed
2022/01/03 23:15:12 Waiting for app: TestKVSwapRebWithTimers to get deployed
2022/01/03 23:15:17 Waiting for app: TestKVSwapRebWithTimers to get deployed
2022/01/03 23:15:17 App: TestKVSwapRebWithTimers got deployed
2022/01/03 23:15:17 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 23:15:17 Starting bucket ops to source bucket
2022/01/03 23:15:17 Removing node(s): [] from the cluster
2022/01/03 23:15:22 Rebalance progress: 12.5
2022/01/03 23:15:27 Rebalance progress: 12.5
2022/01/03 23:15:32 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:15:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:15:32 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:15:32 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/03 23:15:33 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 23:15:38 Rebalance progress: 12.5
2022/01/03 23:15:43 Rebalance progress: 12.5
2022/01/03 23:15:48 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:15:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:15:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:15:48 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 23:15:53 Rebalance progress: 12.5
2022/01/03 23:15:58 Rebalance progress: 12.5
2022/01/03 23:16:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:16:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:16:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:16:03 Waiting for src bucket item count to get to: 50000 curr count: 49898
2022/01/03 23:16:08 Waiting for src bucket item count to get to: 50000 curr count: 49898
2022/01/03 23:16:18 Waiting for dst bucket item count to get to: 50000 curr count: 46834
2022/01/03 23:16:23 Waiting for dst bucket item count to get to: 50000 curr count: 46834
2022/01/03 23:16:23 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 23:16:23 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 23:16:23 Starting bucket ops to source bucket
2022/01/03 23:17:32 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:17:37 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:17:42 Waiting for dst bucket item count to get to: 0 curr count: 49771
2022/01/03 23:17:47 Waiting for dst bucket item count to get to: 0 curr count: 49771
2022/01/03 23:17:52 Waiting for dst bucket item count to get to: 0 curr count: 42286
2022/01/03 23:17:57 Waiting for dst bucket item count to get to: 0 curr count: 42286
2022/01/03 23:18:02 Waiting for dst bucket item count to get to: 0 curr count: 27848
2022/01/03 23:18:07 Waiting for dst bucket item count to get to: 0 curr count: 27848
2022/01/03 23:18:12 Waiting for dst bucket item count to get to: 0 curr count: 5661
2022/01/03 23:18:18 Waiting for dst bucket item count to get to: 0 curr count: 5661
2022/01/03 23:18:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:18:18 Post DELETE ops. Expected item count: 0 got 0
2022/01/03 23:18:23 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/01/03 23:18:28 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/01/03 23:18:33 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/01/03 23:18:38 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/01/03 23:18:43 Waiting for app: TestKVSwapRebWithTimers to get un-deployed
2022/01/03 23:18:43 App: TestKVSwapRebWithTimers got un-deployed
2022/01/03 23:18:43 No eventing-con process running
2022/01/03 23:18:43 Function: TestKVSwapRebWithTimers delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestKVSwapRebWithTimers deleting in background"
}
2022/01/03 23:18:45 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:18:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:18:50 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:18:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:18:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:18:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebWithTimers (269.58s)
=== RUN   TestDuplicateTimerCreationEventingRebIn
2022/01/03 23:19:06 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/03 23:19:06 App: TestDuplicateTimerCreationEventingRebIn got un-deployed
2022/01/03 23:19:06 No eventing-con process running
2022/01/03 23:19:06 Function: TestDuplicateTimerCreationEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingRebIn not found"
}
2022/01/03 23:19:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:19:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:19:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:19:15 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:19:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:19:20 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:19:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:19:25 Deploying app: TestDuplicateTimerCreationEventingRebIn. Item count src bucket: 0 dst bucket: 0
2022/01/03 23:19:26 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebIn stored in temp store"
}
2022/01/03 23:19:31 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2022/01/03 23:19:36 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2022/01/03 23:19:41 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2022/01/03 23:19:46 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get deployed
2022/01/03 23:19:46 App: TestDuplicateTimerCreationEventingRebIn got deployed
2022/01/03 23:19:46 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 23:19:46 Starting bucket ops to source bucket
2022/01/03 23:19:47 Removing node(s): [] from the cluster
2022/01/03 23:19:52 Rebalance progress: 12.5
2022/01/03 23:19:57 Rebalance progress: 12.5
2022/01/03 23:20:02 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:20:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:20:02 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:20:02 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 23:20:07 Rebalance progress: 12.5
2022/01/03 23:20:12 Rebalance progress: 12.5
2022/01/03 23:20:17 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:20:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:20:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:20:17 Waiting for src bucket item count to get to: 50000 curr count: 30317
2022/01/03 23:20:22 Waiting for src bucket item count to get to: 50000 curr count: 41951
2022/01/03 23:20:27 Waiting for src bucket item count to get to: 50000 curr count: 41951
2022/01/03 23:20:37 Waiting for dst bucket item count to get to: 50000 curr count: 26518
2022/01/03 23:20:42 Waiting for dst bucket item count to get to: 50000 curr count: 26518
2022/01/03 23:20:47 Waiting for dst bucket item count to get to: 50000 curr count: 36306
2022/01/03 23:20:52 Waiting for dst bucket item count to get to: 50000 curr count: 36306
2022/01/03 23:20:57 Waiting for dst bucket item count to get to: 50000 curr count: 47060
2022/01/03 23:21:02 Waiting for dst bucket item count to get to: 50000 curr count: 47060
2022/01/03 23:21:02 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 23:21:02 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 23:21:07 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/03 23:21:12 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/03 23:21:18 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/03 23:21:23 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/03 23:21:28 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/03 23:21:33 Waiting for app: TestDuplicateTimerCreationEventingRebIn to get un-deployed
2022/01/03 23:21:33 App: TestDuplicateTimerCreationEventingRebIn got un-deployed
2022/01/03 23:21:33 No eventing-con process running
2022/01/03 23:21:33 Function: TestDuplicateTimerCreationEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebIn deleting in background"
}
2022/01/03 23:21:34 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:21:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:21:44 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:21:44 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:21:46 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:21:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:21:56 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:21:56 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingRebIn (179.78s)
=== RUN   TestDuplicateTimerCreationEventingRebOut
2022/01/03 23:22:01 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 23:22:02 Removing node(s): [] from the cluster
2022/01/03 23:22:07 Rebalance progress: 100
2022/01/03 23:22:12 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/01/03 23:22:12 App: TestDuplicateTimerCreationEventingRebOut got un-deployed
2022/01/03 23:22:12 No eventing-con process running
2022/01/03 23:22:12 Function: TestDuplicateTimerCreationEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingRebOut not found"
}
2022/01/03 23:22:13 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:22:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:22:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:22:20 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:22:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:22:25 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:22:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:22:30 Deploying app: TestDuplicateTimerCreationEventingRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/03 23:22:31 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebOut stored in temp store"
}
2022/01/03 23:22:36 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2022/01/03 23:22:41 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2022/01/03 23:22:46 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2022/01/03 23:22:51 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get deployed
2022/01/03 23:22:51 App: TestDuplicateTimerCreationEventingRebOut got deployed
2022/01/03 23:22:51 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 23:22:51 Starting bucket ops to source bucket
2022/01/03 23:22:56 Rebalance progress: 12.5
2022/01/03 23:23:01 Rebalance progress: 12.5
2022/01/03 23:23:06 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:23:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:23:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:23:06 Waiting for src bucket item count to get to: 50000 curr count: 10245
2022/01/03 23:23:11 Waiting for src bucket item count to get to: 50000 curr count: 24169
2022/01/03 23:23:16 Waiting for src bucket item count to get to: 50000 curr count: 24169
2022/01/03 23:23:21 Waiting for src bucket item count to get to: 50000 curr count: 36392
2022/01/03 23:23:26 Waiting for src bucket item count to get to: 50000 curr count: 36392
2022/01/03 23:23:31 Waiting for src bucket item count to get to: 50000 curr count: 45608
2022/01/03 23:23:36 Waiting for src bucket item count to get to: 50000 curr count: 45608
2022/01/03 23:23:47 Waiting for dst bucket item count to get to: 50000 curr count: 32764
2022/01/03 23:23:52 Waiting for dst bucket item count to get to: 50000 curr count: 32764
2022/01/03 23:23:57 Waiting for dst bucket item count to get to: 50000 curr count: 32764
2022/01/03 23:24:02 Waiting for dst bucket item count to get to: 50000 curr count: 47163
2022/01/03 23:24:07 Waiting for dst bucket item count to get to: 50000 curr count: 47163
2022/01/03 23:24:07 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 23:24:07 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 23:24:12 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/01/03 23:24:17 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/01/03 23:24:22 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/01/03 23:24:27 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/01/03 23:24:32 Waiting for app: TestDuplicateTimerCreationEventingRebOut to get un-deployed
2022/01/03 23:24:32 App: TestDuplicateTimerCreationEventingRebOut got un-deployed
2022/01/03 23:24:32 No eventing-con process running
2022/01/03 23:24:32 Function: TestDuplicateTimerCreationEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingRebOut deleting in background"
}
2022/01/03 23:24:34 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:24:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:24:44 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:24:49 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:24:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:24:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:24:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:25:01 Waiting for dst bucket item count to get to: 0 curr count: 35773
2022/01/03 23:25:06 Waiting for dst bucket item count to get to: 0 curr count: 35773
2022/01/03 23:25:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingRebOut (189.46s)
=== RUN   TestDuplicateTimerCreationEventingSwapReb
2022/01/03 23:25:16 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/01/03 23:25:16 App: TestDuplicateTimerCreationEventingSwapReb got un-deployed
2022/01/03 23:25:16 No eventing-con process running
2022/01/03 23:25:16 Function: TestDuplicateTimerCreationEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationEventingSwapReb not found"
}
2022/01/03 23:25:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:25:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:25:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:25:24 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:25:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:25:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:25:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:25:34 Deploying app: TestDuplicateTimerCreationEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2022/01/03 23:25:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingSwapReb stored in temp store"
}
2022/01/03 23:25:40 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2022/01/03 23:25:45 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2022/01/03 23:25:50 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2022/01/03 23:25:55 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get deployed
2022/01/03 23:25:55 App: TestDuplicateTimerCreationEventingSwapReb got deployed
2022/01/03 23:25:55 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 23:25:55 Starting bucket ops to source bucket
2022/01/03 23:25:56 Removing node(s): [] from the cluster
2022/01/03 23:26:01 Rebalance progress: 12.5
2022/01/03 23:26:06 Rebalance progress: 12.5
2022/01/03 23:26:11 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:26:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:26:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:26:11 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 23:26:12 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 23:26:17 Rebalance progress: 12.5
2022/01/03 23:26:22 Rebalance progress: 12.5
2022/01/03 23:26:27 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:26:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:26:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:26:27 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 23:26:32 Rebalance progress: 12.5
2022/01/03 23:26:37 Rebalance progress: 12.5
2022/01/03 23:26:42 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:26:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:26:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:26:47 Waiting for dst bucket item count to get to: 50000 curr count: 29609
2022/01/03 23:26:52 Waiting for dst bucket item count to get to: 50000 curr count: 29609
2022/01/03 23:26:57 Waiting for dst bucket item count to get to: 50000 curr count: 35720
2022/01/03 23:27:02 Waiting for dst bucket item count to get to: 50000 curr count: 35720
2022/01/03 23:27:07 Waiting for dst bucket item count to get to: 50000 curr count: 48326
2022/01/03 23:27:12 Waiting for dst bucket item count to get to: 50000 curr count: 48326
2022/01/03 23:27:12 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 23:27:12 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 23:27:17 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/01/03 23:27:22 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/01/03 23:27:27 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/01/03 23:27:32 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/01/03 23:27:37 Waiting for app: TestDuplicateTimerCreationEventingSwapReb to get un-deployed
2022/01/03 23:27:37 App: TestDuplicateTimerCreationEventingSwapReb got un-deployed
2022/01/03 23:27:37 No eventing-con process running
2022/01/03 23:27:37 Function: TestDuplicateTimerCreationEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationEventingSwapReb deleting in background"
}
2022/01/03 23:27:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:27:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:27:49 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:27:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:27:51 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:27:56 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:28:01 Waiting for dst bucket item count to get to: 0 curr count: 43629
2022/01/03 23:28:06 Waiting for dst bucket item count to get to: 0 curr count: 43629
2022/01/03 23:28:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationEventingSwapReb (180.17s)
=== RUN   TestDuplicateTimerCreationKVRebIn
2022/01/03 23:28:16 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/01/03 23:28:16 App: TestDuplicateTimerCreationKVRebIn got un-deployed
2022/01/03 23:28:16 No eventing-con process running
2022/01/03 23:28:16 Function: TestDuplicateTimerCreationKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVRebIn not found"
}
2022/01/03 23:28:18 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:28:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:28:23 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:28:24 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:28:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:28:29 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:28:34 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:28:34 Deploying app: TestDuplicateTimerCreationKVRebIn. Item count src bucket: 0 dst bucket: 0
2022/01/03 23:28:35 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebIn stored in temp store"
}
2022/01/03 23:28:40 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2022/01/03 23:28:46 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2022/01/03 23:28:51 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2022/01/03 23:28:56 Waiting for app: TestDuplicateTimerCreationKVRebIn to get deployed
2022/01/03 23:28:56 App: TestDuplicateTimerCreationKVRebIn got deployed
2022/01/03 23:28:56 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 23:28:56 Starting bucket ops to source bucket
2022/01/03 23:28:56 Removing node(s): [] from the cluster
2022/01/03 23:29:01 Rebalance progress: 12.5
2022/01/03 23:29:06 Rebalance progress: 12.5
2022/01/03 23:29:11 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:29:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:29:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:29:11 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 23:29:16 Rebalance progress: 12.5
2022/01/03 23:29:21 Rebalance progress: 12.5
2022/01/03 23:29:26 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:29:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:29:26 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:29:26 Waiting for src bucket item count to get to: 50000 curr count: 29895
2022/01/03 23:29:31 Waiting for src bucket item count to get to: 50000 curr count: 40757
2022/01/03 23:29:36 Waiting for src bucket item count to get to: 50000 curr count: 40757
2022/01/03 23:29:46 Waiting for dst bucket item count to get to: 50000 curr count: 31287
2022/01/03 23:29:51 Waiting for dst bucket item count to get to: 50000 curr count: 31287
2022/01/03 23:29:56 Waiting for dst bucket item count to get to: 50000 curr count: 38181
2022/01/03 23:30:01 Waiting for dst bucket item count to get to: 50000 curr count: 38181
2022/01/03 23:30:01 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 23:30:01 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 23:30:06 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/01/03 23:30:11 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/01/03 23:30:16 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/01/03 23:30:22 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/01/03 23:30:27 Waiting for app: TestDuplicateTimerCreationKVRebIn to get un-deployed
2022/01/03 23:30:27 App: TestDuplicateTimerCreationKVRebIn got un-deployed
2022/01/03 23:30:27 No eventing-con process running
2022/01/03 23:30:27 Function: TestDuplicateTimerCreationKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebIn deleting in background"
}
2022/01/03 23:30:28 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:30:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:30:38 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:30:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:30:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:30:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:30:50 Waiting for dst bucket item count to get to: 0 curr count: 7862
2022/01/03 23:30:55 Waiting for dst bucket item count to get to: 0 curr count: 7862
2022/01/03 23:30:55 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVRebIn (169.22s)
=== RUN   TestDuplicateTimerCreationKVRebOut
2022/01/03 23:31:00 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 23:31:00 Removing node(s): [] from the cluster
2022/01/03 23:31:05 Rebalance progress: 100
2022/01/03 23:31:10 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/01/03 23:31:10 App: TestDuplicateTimerCreationKVRebOut got un-deployed
2022/01/03 23:31:10 No eventing-con process running
2022/01/03 23:31:10 Function: TestDuplicateTimerCreationKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVRebOut not found"
}
2022/01/03 23:31:12 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:31:17 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:31:17 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:31:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:31:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:31:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:31:29 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:31:29 Deploying app: TestDuplicateTimerCreationKVRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/03 23:31:30 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebOut stored in temp store"
}
2022/01/03 23:31:35 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2022/01/03 23:31:40 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2022/01/03 23:31:45 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2022/01/03 23:31:50 Waiting for app: TestDuplicateTimerCreationKVRebOut to get deployed
2022/01/03 23:31:50 App: TestDuplicateTimerCreationKVRebOut got deployed
2022/01/03 23:31:50 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 23:31:50 Starting bucket ops to source bucket
2022/01/03 23:31:55 Rebalance progress: 12.5
2022/01/03 23:32:00 Rebalance progress: 12.5
2022/01/03 23:32:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:32:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:32:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:32:05 Waiting for src bucket item count to get to: 50000 curr count: 11813
2022/01/03 23:32:10 Waiting for src bucket item count to get to: 50000 curr count: 25432
2022/01/03 23:32:15 Waiting for src bucket item count to get to: 50000 curr count: 25432
2022/01/03 23:32:20 Waiting for src bucket item count to get to: 50000 curr count: 36651
2022/01/03 23:32:25 Waiting for src bucket item count to get to: 50000 curr count: 36651
2022/01/03 23:32:30 Waiting for src bucket item count to get to: 50000 curr count: 46795
2022/01/03 23:32:35 Waiting for src bucket item count to get to: 50000 curr count: 46795
2022/01/03 23:32:40 Waiting for src bucket item count to get to: 50000 curr count: 46795
2022/01/03 23:32:50 Waiting for dst bucket item count to get to: 50000 curr count: 36641
2022/01/03 23:32:55 Waiting for dst bucket item count to get to: 50000 curr count: 36641
2022/01/03 23:33:00 Waiting for dst bucket item count to get to: 50000 curr count: 47053
2022/01/03 23:33:05 Waiting for dst bucket item count to get to: 50000 curr count: 47053
2022/01/03 23:33:05 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 23:33:05 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 23:33:10 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/01/03 23:33:15 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/01/03 23:33:21 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/01/03 23:33:26 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/01/03 23:33:31 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/01/03 23:33:36 Waiting for app: TestDuplicateTimerCreationKVRebOut to get un-deployed
2022/01/03 23:33:36 App: TestDuplicateTimerCreationKVRebOut got un-deployed
2022/01/03 23:33:36 No eventing-con process running
2022/01/03 23:33:36 Function: TestDuplicateTimerCreationKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVRebOut deleting in background"
}
2022/01/03 23:33:38 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:33:43 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:33:48 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:33:48 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:33:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:33:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:33:54 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVRebOut (179.29s)
=== RUN   TestDuplicateTimerCreationKVSwapReb
2022/01/03 23:34:04 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/01/03 23:34:04 App: TestDuplicateTimerCreationKVSwapReb got un-deployed
2022/01/03 23:34:04 No eventing-con process running
2022/01/03 23:34:04 Function: TestDuplicateTimerCreationKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerCreationKVSwapReb not found"
}
2022/01/03 23:34:06 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:34:11 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:34:11 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:34:13 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:34:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:34:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:34:23 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:34:23 Deploying app: TestDuplicateTimerCreationKVSwapReb. Item count src bucket: 0 dst bucket: 0
2022/01/03 23:34:24 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVSwapReb stored in temp store"
}
2022/01/03 23:34:29 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2022/01/03 23:34:34 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2022/01/03 23:34:39 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2022/01/03 23:34:44 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get deployed
2022/01/03 23:34:44 App: TestDuplicateTimerCreationKVSwapReb got deployed
2022/01/03 23:34:44 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 23:34:44 Starting bucket ops to source bucket
2022/01/03 23:34:44 Removing node(s): [] from the cluster
2022/01/03 23:34:49 Rebalance progress: 12.5
2022/01/03 23:34:54 Rebalance progress: 12.5
2022/01/03 23:34:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:34:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:34:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:35:00 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/03 23:35:00 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 23:35:05 Rebalance progress: 12.5
2022/01/03 23:35:10 Rebalance progress: 12.5
2022/01/03 23:35:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:35:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:35:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:35:15 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 23:35:20 Rebalance progress: 12.5
2022/01/03 23:35:25 Rebalance progress: 12.5
2022/01/03 23:35:30 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:35:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:35:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:35:30 Waiting for src bucket item count to get to: 50000 curr count: 39692
2022/01/03 23:35:35 Waiting for src bucket item count to get to: 50000 curr count: 49610
2022/01/03 23:35:40 Waiting for src bucket item count to get to: 50000 curr count: 49610
2022/01/03 23:35:50 Waiting for dst bucket item count to get to: 50000 curr count: 38272
2022/01/03 23:35:55 Waiting for dst bucket item count to get to: 50000 curr count: 38272
2022/01/03 23:35:55 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 23:35:55 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 23:36:01 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/01/03 23:36:06 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/01/03 23:36:11 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/01/03 23:36:16 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/01/03 23:36:21 Waiting for app: TestDuplicateTimerCreationKVSwapReb to get un-deployed
2022/01/03 23:36:21 App: TestDuplicateTimerCreationKVSwapReb got un-deployed
2022/01/03 23:36:21 No eventing-con process running
2022/01/03 23:36:21 Function: TestDuplicateTimerCreationKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerCreationKVSwapReb deleting in background"
}
2022/01/03 23:36:23 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:36:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:36:33 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:36:38 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:36:38 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:36:40 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:36:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:36:45 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerCreationKVSwapReb (170.25s)
=== RUN   TestDuplicateTimerFiringEventingRebIn
2022/01/03 23:36:55 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/01/03 23:36:55 App: TestDuplicateTimerFiringEventingRebIn got un-deployed
2022/01/03 23:36:55 No eventing-con process running
2022/01/03 23:36:55 Function: TestDuplicateTimerFiringEventingRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingRebIn not found"
}
2022/01/03 23:36:56 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:37:01 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:37:01 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:37:03 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:37:08 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:37:08 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:37:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:37:13 Deploying app: TestDuplicateTimerFiringEventingRebIn. Item count src bucket: 0 dst bucket: 0
2022/01/03 23:37:14 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebIn stored in temp store"
}
2022/01/03 23:37:19 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2022/01/03 23:37:24 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2022/01/03 23:37:29 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2022/01/03 23:37:34 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get deployed
2022/01/03 23:37:34 App: TestDuplicateTimerFiringEventingRebIn got deployed
2022/01/03 23:37:34 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 23:37:34 Starting bucket ops to source bucket
2022/01/03 23:37:35 Removing node(s): [] from the cluster
2022/01/03 23:37:40 Rebalance progress: 12.5
2022/01/03 23:37:45 Rebalance progress: 12.5
2022/01/03 23:37:50 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:37:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:37:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:37:50 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 23:37:55 Rebalance progress: 12.5
2022/01/03 23:38:00 Rebalance progress: 12.5
2022/01/03 23:38:05 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:38:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:38:05 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:38:05 Waiting for src bucket item count to get to: 50000 curr count: 29707
2022/01/03 23:38:10 Waiting for src bucket item count to get to: 50000 curr count: 29707
2022/01/03 23:38:15 Waiting for src bucket item count to get to: 50000 curr count: 41327
2022/01/03 23:38:20 Waiting for src bucket item count to get to: 50000 curr count: 41327
2022/01/03 23:38:30 Waiting for dst bucket item count to get to: 50000 curr count: 37747
2022/01/03 23:38:35 Waiting for dst bucket item count to get to: 50000 curr count: 46066
2022/01/03 23:38:40 Waiting for dst bucket item count to get to: 50000 curr count: 46066
2022/01/03 23:38:40 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 23:38:40 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 23:38:45 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/01/03 23:38:50 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/01/03 23:38:56 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/01/03 23:39:01 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/01/03 23:39:06 Waiting for app: TestDuplicateTimerFiringEventingRebIn to get un-deployed
2022/01/03 23:39:06 App: TestDuplicateTimerFiringEventingRebIn got un-deployed
2022/01/03 23:39:06 No eventing-con process running
2022/01/03 23:39:06 Function: TestDuplicateTimerFiringEventingRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebIn deleting in background"
}
2022/01/03 23:39:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:39:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:39:18 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:39:18 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:39:19 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:39:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:39:24 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingRebIn (159.83s)
=== RUN   TestDuplicateTimerFiringEventingRebOut
2022/01/03 23:39:29 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 23:39:30 Removing node(s): [] from the cluster
2022/01/03 23:39:35 Rebalance progress: 100
2022/01/03 23:39:40 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/01/03 23:39:40 App: TestDuplicateTimerFiringEventingRebOut got un-deployed
2022/01/03 23:39:40 No eventing-con process running
2022/01/03 23:39:40 Function: TestDuplicateTimerFiringEventingRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingRebOut not found"
}
2022/01/03 23:39:42 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:39:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:39:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:39:48 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:39:53 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:39:53 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:39:58 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:39:58 Deploying app: TestDuplicateTimerFiringEventingRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/03 23:39:59 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebOut stored in temp store"
}
2022/01/03 23:40:04 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2022/01/03 23:40:09 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2022/01/03 23:40:14 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2022/01/03 23:40:19 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get deployed
2022/01/03 23:40:20 App: TestDuplicateTimerFiringEventingRebOut got deployed
2022/01/03 23:40:20 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 23:40:20 Starting bucket ops to source bucket
2022/01/03 23:40:25 Rebalance progress: 12.5
2022/01/03 23:40:30 Rebalance progress: 12.5
2022/01/03 23:40:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:40:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:40:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:40:35 Waiting for src bucket item count to get to: 50000 curr count: 13425
2022/01/03 23:40:40 Waiting for src bucket item count to get to: 50000 curr count: 13425
2022/01/03 23:40:45 Waiting for src bucket item count to get to: 50000 curr count: 24741
2022/01/03 23:40:50 Waiting for src bucket item count to get to: 50000 curr count: 24741
2022/01/03 23:40:55 Waiting for src bucket item count to get to: 50000 curr count: 34698
2022/01/03 23:41:00 Waiting for src bucket item count to get to: 50000 curr count: 47218
2022/01/03 23:41:05 Waiting for src bucket item count to get to: 50000 curr count: 47218
2022/01/03 23:41:10 Waiting for src bucket item count to get to: 50000 curr count: 47218
2022/01/03 23:41:20 Waiting for dst bucket item count to get to: 50000 curr count: 47368
2022/01/03 23:41:25 Waiting for dst bucket item count to get to: 50000 curr count: 47368
2022/01/03 23:41:25 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 23:41:25 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 23:41:30 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/01/03 23:41:35 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/01/03 23:41:40 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/01/03 23:41:45 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/01/03 23:41:50 Waiting for app: TestDuplicateTimerFiringEventingRebOut to get un-deployed
2022/01/03 23:41:50 App: TestDuplicateTimerFiringEventingRebOut got un-deployed
2022/01/03 23:41:50 No eventing-con process running
2022/01/03 23:41:50 Function: TestDuplicateTimerFiringEventingRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingRebOut deleting in background"
}
2022/01/03 23:41:52 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:41:57 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:42:02 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:42:07 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:42:07 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:42:09 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:42:14 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:42:19 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:42:19 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingRebOut (174.44s)
=== RUN   TestDuplicateTimerFiringEventingSwapReb
2022/01/03 23:42:29 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/01/03 23:42:29 App: TestDuplicateTimerFiringEventingSwapReb got un-deployed
2022/01/03 23:42:29 No eventing-con process running
2022/01/03 23:42:29 Function: TestDuplicateTimerFiringEventingSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringEventingSwapReb not found"
}
2022/01/03 23:42:31 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:42:36 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:42:36 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:42:37 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:42:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:42:42 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:42:47 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:42:47 Deploying app: TestDuplicateTimerFiringEventingSwapReb. Item count src bucket: 0 dst bucket: 0
2022/01/03 23:42:49 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingSwapReb stored in temp store"
}
2022/01/03 23:42:54 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2022/01/03 23:42:59 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2022/01/03 23:43:04 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2022/01/03 23:43:09 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get deployed
2022/01/03 23:43:09 App: TestDuplicateTimerFiringEventingSwapReb got deployed
2022/01/03 23:43:09 Adding node: https://127.0.0.1:19001 with role: eventing to the cluster
2022/01/03 23:43:09 Starting bucket ops to source bucket
2022/01/03 23:43:09 Removing node(s): [] from the cluster
2022/01/03 23:43:14 Rebalance progress: 12.5
2022/01/03 23:43:19 Rebalance progress: 12.5
2022/01/03 23:43:24 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:43:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:43:24 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:43:24 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 23:43:25 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 23:43:30 Rebalance progress: 12.5
2022/01/03 23:43:35 Rebalance progress: 12.5
2022/01/03 23:43:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:43:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:43:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:43:40 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 23:43:45 Rebalance progress: 12.5
2022/01/03 23:43:50 Rebalance progress: 12.5
2022/01/03 23:43:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:43:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:43:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:43:55 Waiting for src bucket item count to get to: 50000 curr count: 45747
2022/01/03 23:44:00 Waiting for src bucket item count to get to: 50000 curr count: 45747
2022/01/03 23:44:10 Waiting for dst bucket item count to get to: 50000 curr count: 46031
2022/01/03 23:44:15 Waiting for dst bucket item count to get to: 50000 curr count: 46031
2022/01/03 23:44:15 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 23:44:15 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 23:44:20 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/01/03 23:44:26 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/01/03 23:44:31 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/01/03 23:44:36 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/01/03 23:44:41 Waiting for app: TestDuplicateTimerFiringEventingSwapReb to get un-deployed
2022/01/03 23:44:41 App: TestDuplicateTimerFiringEventingSwapReb got un-deployed
2022/01/03 23:44:41 No eventing-con process running
2022/01/03 23:44:41 Function: TestDuplicateTimerFiringEventingSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringEventingSwapReb deleting in background"
}
2022/01/03 23:44:43 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:44:48 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:44:53 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:44:58 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:44:58 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:44:59 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:45:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:45:04 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringEventingSwapReb (165.56s)
=== RUN   TestDuplicateTimerFiringKVRebIn
2022/01/03 23:45:14 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/01/03 23:45:14 App: TestDuplicateTimerFiringKVRebIn got un-deployed
2022/01/03 23:45:14 No eventing-con process running
2022/01/03 23:45:14 Function: TestDuplicateTimerFiringKVRebIn delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVRebIn not found"
}
2022/01/03 23:45:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:45:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:45:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:45:23 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:45:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:45:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:45:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:45:33 Deploying app: TestDuplicateTimerFiringKVRebIn. Item count src bucket: 0 dst bucket: 0
2022/01/03 23:45:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebIn stored in temp store"
}
2022/01/03 23:45:39 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2022/01/03 23:45:44 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2022/01/03 23:45:49 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2022/01/03 23:45:54 Waiting for app: TestDuplicateTimerFiringKVRebIn to get deployed
2022/01/03 23:45:54 App: TestDuplicateTimerFiringKVRebIn got deployed
2022/01/03 23:45:54 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 23:45:54 Starting bucket ops to source bucket
2022/01/03 23:45:55 Removing node(s): [] from the cluster
2022/01/03 23:46:00 Rebalance progress: 12.5
2022/01/03 23:46:05 Rebalance progress: 12.5
2022/01/03 23:46:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:46:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:46:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:46:10 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 23:46:15 Rebalance progress: 12.5
2022/01/03 23:46:20 Rebalance progress: 12.5
2022/01/03 23:46:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:46:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:46:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:46:25 Waiting for src bucket item count to get to: 50000 curr count: 31861
2022/01/03 23:46:30 Waiting for src bucket item count to get to: 50000 curr count: 31861
2022/01/03 23:46:35 Waiting for src bucket item count to get to: 50000 curr count: 42451
2022/01/03 23:46:40 Waiting for src bucket item count to get to: 50000 curr count: 42451
2022/01/03 23:46:50 Waiting for dst bucket item count to get to: 50000 curr count: 34886
2022/01/03 23:46:55 Waiting for dst bucket item count to get to: 50000 curr count: 34886
2022/01/03 23:47:00 Waiting for dst bucket item count to get to: 50000 curr count: 41895
2022/01/03 23:47:05 Waiting for dst bucket item count to get to: 50000 curr count: 41895
2022/01/03 23:47:05 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 23:47:05 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 23:47:10 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/01/03 23:47:15 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/01/03 23:47:20 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/01/03 23:47:25 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/01/03 23:47:31 Waiting for app: TestDuplicateTimerFiringKVRebIn to get un-deployed
2022/01/03 23:47:31 App: TestDuplicateTimerFiringKVRebIn got un-deployed
2022/01/03 23:47:31 No eventing-con process running
2022/01/03 23:47:31 Function: TestDuplicateTimerFiringKVRebIn delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebIn deleting in background"
}
2022/01/03 23:47:32 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:47:37 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:47:42 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:47:47 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:47:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:47:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:47:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:47:59 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:47:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVRebIn (174.64s)
=== RUN   TestDuplicateTimerFiringKVRebOut
2022/01/03 23:48:04 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 23:48:04 Removing node(s): [] from the cluster
2022/01/03 23:48:09 Rebalance progress: 100
2022/01/03 23:48:14 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/01/03 23:48:14 App: TestDuplicateTimerFiringKVRebOut got un-deployed
2022/01/03 23:48:14 No eventing-con process running
2022/01/03 23:48:14 Function: TestDuplicateTimerFiringKVRebOut delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVRebOut not found"
}
2022/01/03 23:48:16 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:48:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:48:21 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:48:23 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:48:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:48:28 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:48:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:48:33 Deploying app: TestDuplicateTimerFiringKVRebOut. Item count src bucket: 0 dst bucket: 0
2022/01/03 23:48:34 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebOut stored in temp store"
}
2022/01/03 23:48:39 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2022/01/03 23:48:44 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2022/01/03 23:48:49 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2022/01/03 23:48:54 Waiting for app: TestDuplicateTimerFiringKVRebOut to get deployed
2022/01/03 23:48:54 App: TestDuplicateTimerFiringKVRebOut got deployed
2022/01/03 23:48:54 Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 23:48:54 Starting bucket ops to source bucket
2022/01/03 23:48:59 Rebalance progress: 12.5
2022/01/03 23:49:04 Rebalance progress: 12.5
2022/01/03 23:49:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:49:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:49:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:49:09 Waiting for src bucket item count to get to: 50000 curr count: 6824
2022/01/03 23:49:14 Waiting for src bucket item count to get to: 50000 curr count: 20033
2022/01/03 23:49:19 Waiting for src bucket item count to get to: 50000 curr count: 20033
2022/01/03 23:49:24 Waiting for src bucket item count to get to: 50000 curr count: 31630
2022/01/03 23:49:29 Waiting for src bucket item count to get to: 50000 curr count: 31630
2022/01/03 23:49:34 Waiting for src bucket item count to get to: 50000 curr count: 31630
2022/01/03 23:49:39 Waiting for src bucket item count to get to: 50000 curr count: 42893
2022/01/03 23:49:44 Waiting for src bucket item count to get to: 50000 curr count: 42893
2022/01/03 23:49:54 Waiting for dst bucket item count to get to: 50000 curr count: 38034
2022/01/03 23:49:59 Waiting for dst bucket item count to get to: 50000 curr count: 38034
2022/01/03 23:50:04 Waiting for dst bucket item count to get to: 50000 curr count: 46615
2022/01/03 23:50:09 Waiting for dst bucket item count to get to: 50000 curr count: 46615
2022/01/03 23:50:09 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 23:50:09 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 23:50:14 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/01/03 23:50:19 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/01/03 23:50:25 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/01/03 23:50:30 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/01/03 23:50:35 Waiting for app: TestDuplicateTimerFiringKVRebOut to get un-deployed
2022/01/03 23:50:35 App: TestDuplicateTimerFiringKVRebOut got un-deployed
2022/01/03 23:50:35 No eventing-con process running
2022/01/03 23:50:35 Function: TestDuplicateTimerFiringKVRebOut delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVRebOut deleting in background"
}
2022/01/03 23:50:37 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:50:42 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:50:47 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:50:47 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:50:49 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:50:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:50:59 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:50:59 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVRebOut (179.48s)
=== RUN   TestDuplicateTimerFiringKVSwapReb
2022/01/03 23:51:09 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/01/03 23:51:09 App: TestDuplicateTimerFiringKVSwapReb got un-deployed
2022/01/03 23:51:09 No eventing-con process running
2022/01/03 23:51:09 Function: TestDuplicateTimerFiringKVSwapReb delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: TestDuplicateTimerFiringKVSwapReb not found"
}
2022/01/03 23:51:10 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:51:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:51:15 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:51:17 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:51:22 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:51:22 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:51:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:51:27 Deploying app: TestDuplicateTimerFiringKVSwapReb. Item count src bucket: 0 dst bucket: 0
2022/01/03 23:51:28 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVSwapReb stored in temp store"
}
2022/01/03 23:51:33 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2022/01/03 23:51:38 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2022/01/03 23:51:43 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2022/01/03 23:51:48 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get deployed
2022/01/03 23:51:48 App: TestDuplicateTimerFiringKVSwapReb got deployed
2022/01/03 23:51:48 Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 23:51:48 Starting bucket ops to source bucket
2022/01/03 23:51:49 Removing node(s): [] from the cluster
2022/01/03 23:51:54 Rebalance progress: 12.5
2022/01/03 23:51:59 Rebalance progress: 12.5
2022/01/03 23:52:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:52:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:52:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:52:04 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/03 23:52:04 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 23:52:10 Rebalance progress: 12.5
2022/01/03 23:52:15 Rebalance progress: 12.5
2022/01/03 23:52:20 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:52:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:52:20 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:52:20 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 23:52:25 Rebalance progress: 12.5
2022/01/03 23:52:30 Rebalance progress: 12.5
2022/01/03 23:52:35 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:52:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:52:35 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:52:35 Waiting for src bucket item count to get to: 50000 curr count: 47984
2022/01/03 23:52:40 Waiting for src bucket item count to get to: 50000 curr count: 47984
2022/01/03 23:52:50 Waiting for dst bucket item count to get to: 50000 curr count: 45336
2022/01/03 23:52:55 Waiting for dst bucket item count to get to: 50000 curr count: 45336
2022/01/03 23:52:55 src & dst bucket item count matched up. src bucket count: 50000 dst bucket count: 50000
2022/01/03 23:52:55 Post SET ops. Expected item count: 50000 got 50000
2022/01/03 23:53:00 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/01/03 23:53:05 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/01/03 23:53:10 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/01/03 23:53:15 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/01/03 23:53:20 Waiting for app: TestDuplicateTimerFiringKVSwapReb to get un-deployed
2022/01/03 23:53:20 App: TestDuplicateTimerFiringKVSwapReb got un-deployed
2022/01/03 23:53:20 No eventing-con process running
2022/01/03 23:53:20 Function: TestDuplicateTimerFiringKVSwapReb delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: TestDuplicateTimerFiringKVSwapReb deleting in background"
}
2022/01/03 23:53:22 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:53:27 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:53:32 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:53:37 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:53:37 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:53:39 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:53:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:53:49 Waiting for dst bucket item count to get to: 0 curr count: 50000
2022/01/03 23:53:49 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestDuplicateTimerFiringKVSwapReb (170.40s)
=== RUN   TestKVRebOnUpdateBucketOpOneByOne
2022/01/03 23:53:59 Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 23:53:59 App: bucket_op_on_update got un-deployed
2022/01/03 23:53:59 No eventing-con process running
2022/01/03 23:53:59 Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/03 23:54:01 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:54:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:54:06 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:54:08 Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:54:13 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:54:13 src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:54:18 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:54:18 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 23:54:19 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/03 23:54:24 Starting bucket ops to source bucket
2022/01/03 23:54:29 Waiting for app: bucket_op_on_update to get deployed
2022/01/03 23:54:34 Waiting for app: bucket_op_on_update to get deployed
2022/01/03 23:54:39 Waiting for app: bucket_op_on_update to get deployed
2022/01/03 23:54:39 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:54:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:54:39 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:54:39 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 23:54:39 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 23:54:44 Rebalance progress: 12.5
2022/01/03 23:54:49 Rebalance progress: 12.5
2022/01/03 23:54:54 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:54:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:54:54 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:54:54 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/03 23:54:54 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 23:54:59 Rebalance progress: 12.5
2022/01/03 23:55:04 Rebalance progress: 12.5
2022/01/03 23:55:09 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:55:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:55:09 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:55:09 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2022/01/03 23:55:10 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 23:55:15 Rebalance progress: 12.5
2022/01/03 23:55:20 Rebalance progress: 12.5
2022/01/03 23:55:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:55:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:55:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:55:25 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/03 23:55:30 Rebalance progress: 12.5
2022/01/03 23:55:35 Rebalance progress: 12.5
2022/01/03 23:55:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:55:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:55:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:55:40 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/03 23:55:45 Rebalance progress: 12.5
2022/01/03 23:55:50 Rebalance progress: 12.5
2022/01/03 23:55:55 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:55:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:55:55 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:55:55 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/03 23:56:00 Rebalance progress: 12.5
2022/01/03 23:56:05 Rebalance progress: 12.5
2022/01/03 23:56:10 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:56:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:56:10 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:56:15 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 23:56:20 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 23:56:26 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 23:56:31 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 23:56:36 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 23:56:36 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 23:56:36 eventingSetup.go:46: No eventing-con process running
2022/01/03 23:56:36 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/03 23:56:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:56:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:56:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 10626
2022/01/03 23:56:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:56:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:56:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:56:54 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOnUpdateBucketOpOneByOne (185.44s)
=== RUN   TestKVForceFailover
2022/01/03 23:57:09 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 23:57:09 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 23:57:09 eventingSetup.go:46: No eventing-con process running
2022/01/03 23:57:09 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/03 23:57:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:57:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:57:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:57:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:57:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:57:23 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:57:23 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/03 23:57:23 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/03 23:57:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:57:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:57:28 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 23:57:30 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/03 23:57:30 Starting bucket ops to source bucket
2022/01/03 23:57:35 Waiting for app: bucket_op_on_update to get deployed
2022/01/03 23:57:40 Waiting for app: bucket_op_on_update to get deployed
2022/01/03 23:57:45 Waiting for app: bucket_op_on_update to get deployed
2022/01/03 23:57:50 Waiting for app: bucket_op_on_update to get deployed
2022/01/03 23:57:50 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:57:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:57:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:57:50 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
2022/01/03 23:58:10 clusterSetup.go:237: Kicking off failover recovery, type: full
2022/01/03 23:58:10 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: eventing to the cluster
2022/01/03 23:58:15 Rebalance progress: 12.5
2022/01/03 23:58:20 Rebalance progress: 12.5
2022/01/03 23:58:25 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:58:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:58:25 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:58:25 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002] from the cluster
2022/01/03 23:58:30 Rebalance progress: 12.5
2022/01/03 23:58:35 Rebalance progress: 12.5
2022/01/03 23:58:40 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:58:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:58:40 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/03 23:58:45 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 23:58:51 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 23:58:56 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 23:59:01 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 23:59:06 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 23:59:06 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 23:59:06 eventingSetup.go:46: No eventing-con process running
2022/01/03 23:59:06 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/03 23:59:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:59:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:59:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7064
2022/01/03 23:59:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:59:20 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:59:25 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:59:25 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVForceFailover (150.13s)
=== RUN   TestKVHardFailoverRecovery
2022/01/03 23:59:35 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/03 23:59:35 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/03 23:59:35 eventingSetup.go:46: No eventing-con process running
2022/01/03 23:59:35 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/03 23:59:36 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:59:41 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:59:41 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/03 23:59:43 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:59:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:59:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/03 23:59:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/03 23:59:53 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/03 23:59:54 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/03 23:59:59 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 00:00:04 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:00:09 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:00:14 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:00:14 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:00:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:00:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:00:14 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 00:00:15 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 00:00:20 Rebalance progress: 12.5
2022/01/04 00:00:25 Rebalance progress: 12.5
2022/01/04 00:00:30 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:00:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:00:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:00:30 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
2022/01/04 00:01:30 clusterSetup.go:237: Kicking off failover recovery, type: full
2022/01/04 00:01:35 Rebalance progress: 12.5
2022/01/04 00:01:40 Rebalance progress: 12.5
2022/01/04 00:01:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:01:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:01:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:01:45 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 00:01:50 Rebalance progress: 12.5
2022/01/04 00:01:55 Rebalance progress: 12.5
2022/01/04 00:02:00 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:02:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:02:00 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:02:05 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:02:10 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:02:15 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:02:20 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:02:26 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:02:31 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:02:31 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 00:02:31 eventingSetup.go:46: No eventing-con process running
2022/01/04 00:02:31 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/04 00:02:32 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:02:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:02:42 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12062
2022/01/04 00:02:47 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12062
2022/01/04 00:02:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:02:49 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:02:54 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:02:59 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12062
2022/01/04 00:02:59 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVHardFailoverRecovery (214.62s)
=== RUN   TestKVRebOnUpdateBucketOpAllAtOnce
2022/01/04 00:03:09 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:03:09 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 00:03:09 eventingSetup.go:46: No eventing-con process running
2022/01/04 00:03:09 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/04 00:03:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:03:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:03:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:03:18 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:03:23 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:03:23 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:03:28 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:03:28 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 00:03:29 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/04 00:03:34 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 00:03:39 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:03:44 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:03:49 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:03:49 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:03:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:03:49 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:03:49 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 00:03:49 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/04 00:03:50 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2022/01/04 00:03:50 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 00:03:56 Rebalance progress: 12.5
2022/01/04 00:04:01 Rebalance progress: 12.5
2022/01/04 00:04:06 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:04:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:04:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:04:06 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001 127.0.0.1:19002 127.0.0.1:19003] from the cluster
2022/01/04 00:04:11 Rebalance progress: 12.5
2022/01/04 00:04:16 Rebalance progress: 12.5
2022/01/04 00:04:21 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:04:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:04:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:04:26 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:04:31 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:04:36 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:04:41 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:04:46 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:04:46 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 00:04:46 eventingSetup.go:46: No eventing-con process running
2022/01/04 00:04:46 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/04 00:04:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:04:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:04:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 4674
2022/01/04 00:04:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:05:00 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:05:05 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:05:10 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 253
2022/01/04 00:05:15 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 253
2022/01/04 00:05:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebOnUpdateBucketOpAllAtOnce (135.80s)
=== RUN   TestKVSwapRebOnUpdateBucketOp
2022/01/04 00:05:25 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:05:25 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 00:05:25 eventingSetup.go:46: No eventing-con process running
2022/01/04 00:05:25 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/04 00:05:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:05:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:05:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:05:33 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:05:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:05:38 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:05:38 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:05:38 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 00:05:40 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/04 00:05:45 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 00:05:50 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:05:55 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:06:00 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:06:00 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:06:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:06:00 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:06:00 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 00:06:00 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 00:06:05 Rebalance progress: 12.5
2022/01/04 00:06:10 Rebalance progress: 12.5
2022/01/04 00:06:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:06:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:06:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:06:15 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/04 00:06:15 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 00:06:20 Rebalance progress: 12.5
2022/01/04 00:06:25 Rebalance progress: 12.5
2022/01/04 00:06:30 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:06:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:06:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:06:30 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 00:06:36 Rebalance progress: 12.5
2022/01/04 00:06:41 Rebalance progress: 12.5
2022/01/04 00:06:46 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:06:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:06:46 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:06:51 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:06:56 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:07:01 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:07:06 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:07:11 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:07:11 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 00:07:11 eventingSetup.go:46: No eventing-con process running
2022/01/04 00:07:11 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/04 00:07:13 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:07:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:07:23 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6083
2022/01/04 00:07:28 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 6083
2022/01/04 00:07:28 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:07:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:07:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:07:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:07:40 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:07:40 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 00:07:40 eventingSetup.go:46: No eventing-con process running
2022/01/04 00:07:40 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/04 00:07:42 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:07:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:07:47 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:07:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:07:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:07:53 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebOnUpdateBucketOp (158.39s)
=== RUN   TestKVRebalanceWithMultipleHandlers
2022/01/04 00:08:03 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:08:03 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 00:08:03 eventingSetup.go:46: No eventing-con process running
2022/01/04 00:08:03 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/04 00:08:05 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:08:10 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:08:10 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:08:12 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:08:17 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:08:17 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:08:22 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 00:08:22 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2022/01/04 00:08:22 eventingSetup.go:46: No eventing-con process running
2022/01/04 00:08:22 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: sys_test_bucket_op not found"
}
2022/01/04 00:08:24 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:08:29 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:08:29 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:08:30 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:08:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:08:35 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:08:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:08:35 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 00:08:37 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:08:37 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:08:37 eventingSetup.go:125: Deploying app: sys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/01/04 00:08:38 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op stored in temp store"
}
2022/01/04 00:08:43 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 00:08:48 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:08:53 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:08:58 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:08:58 clusterSetup.go:354: App: bucket_op_on_update got deployed
2022/01/04 00:09:03 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/01/04 00:09:08 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/01/04 00:09:13 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/01/04 00:09:13 clusterSetup.go:354: App: sys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:09:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:09:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:09:13 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 00:09:13 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 00:09:18 Rebalance progress: 12.5
2022/01/04 00:09:23 Rebalance progress: 12.5
2022/01/04 00:09:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:09:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:09:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:09:29 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/04 00:09:29 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 00:09:34 Rebalance progress: 12.5
2022/01/04 00:09:39 Rebalance progress: 12.5
2022/01/04 00:09:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:09:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:09:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:09:44 clusterSetup.go:245: Adding node: https://127.0.0.1:19003 with role: kv to the cluster
2022/01/04 00:09:44 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 00:09:49 Rebalance progress: 12.5
2022/01/04 00:09:54 Rebalance progress: 12.5
2022/01/04 00:09:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:09:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:09:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:10:00 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 00:10:05 Rebalance progress: 12.5
2022/01/04 00:10:10 Rebalance progress: 12.5
2022/01/04 00:10:15 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:10:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:10:15 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:10:15 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 00:10:20 Rebalance progress: 12.5
2022/01/04 00:10:25 Rebalance progress: 12.5
2022/01/04 00:10:30 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:10:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:10:30 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:10:30 clusterSetup.go:253: Removing node(s): [127.0.0.1:19003] from the cluster
2022/01/04 00:10:35 Rebalance progress: 12.5
2022/01/04 00:10:40 Rebalance progress: 12.5
2022/01/04 00:10:45 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:10:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:10:45 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:10:50 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:10:55 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:11:00 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:11:05 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:11:11 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:11:11 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 00:11:11 eventingSetup.go:46: No eventing-con process running
2022/01/04 00:11:11 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/04 00:11:14 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:11:19 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:11:24 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12194
2022/01/04 00:11:24 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:11:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:11:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:11:36 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 12194
2022/01/04 00:11:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:11:41 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 00:11:46 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 00:11:52 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 00:11:57 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 00:12:02 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 00:12:02 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2022/01/04 00:12:02 eventingSetup.go:46: No eventing-con process running
2022/01/04 00:12:02 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op deleting in background"
}
2022/01/04 00:12:04 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:12:09 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:12:09 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:12:11 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:12:16 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:12:16 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebalanceWithMultipleHandlers (262.19s)
=== RUN   TestKVSwapRebalanceWithMultipleHandlers
2022/01/04 00:12:26 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:12:26 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 00:12:26 eventingSetup.go:46: No eventing-con process running
2022/01/04 00:12:26 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/04 00:12:27 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:12:32 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:12:32 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:12:34 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:12:39 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:12:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:12:44 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 00:12:44 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2022/01/04 00:12:44 eventingSetup.go:46: No eventing-con process running
2022/01/04 00:12:44 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: sys_test_bucket_op not found"
}
2022/01/04 00:12:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:12:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:12:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:12:53 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:12:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:12:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:12:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:12:58 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 00:12:59 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:12:59 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:12:59 eventingSetup.go:125: Deploying app: sys_test_bucket_op. Item count src bucket: 0 dst bucket: 0
2022/01/04 00:13:00 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op stored in temp store"
}
2022/01/04 00:13:05 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 00:13:10 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:13:15 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:13:20 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:13:20 clusterSetup.go:354: App: bucket_op_on_update got deployed
2022/01/04 00:13:25 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/01/04 00:13:30 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/01/04 00:13:35 clusterSetup.go:346: Waiting for app: sys_test_bucket_op to get deployed
2022/01/04 00:13:35 clusterSetup.go:354: App: sys_test_bucket_op got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:13:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:13:35 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:13:35 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 00:13:35 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 00:13:41 Rebalance progress: 12.5
2022/01/04 00:13:46 Rebalance progress: 12.5
2022/01/04 00:13:51 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:13:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:13:51 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:13:51 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/04 00:13:51 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 00:13:56 Rebalance progress: 12.5
2022/01/04 00:14:01 Rebalance progress: 12.5
2022/01/04 00:14:06 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:14:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:14:06 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:14:06 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 00:14:11 Rebalance progress: 12.5
2022/01/04 00:14:16 Rebalance progress: 12.5
2022/01/04 00:14:21 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:14:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:14:21 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:14:26 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:14:31 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:14:36 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:14:42 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:14:47 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:14:47 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 00:14:47 eventingSetup.go:46: No eventing-con process running
2022/01/04 00:14:47 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/04 00:14:52 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:14:57 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:15:02 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 972
2022/01/04 00:15:07 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 972
2022/01/04 00:15:07 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:15:08 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:15:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:15:18 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 7610
2022/01/04 00:15:18 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:15:23 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 00:15:29 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 00:15:34 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 00:15:39 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 00:15:44 clusterSetup.go:397: Waiting for app: sys_test_bucket_op to get un-deployed
2022/01/04 00:15:44 clusterSetup.go:405: App: sys_test_bucket_op got un-deployed
2022/01/04 00:15:44 eventingSetup.go:46: No eventing-con process running
2022/01/04 00:15:44 eventingSetup.go:418: Function: sys_test_bucket_op delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: sys_test_bucket_op deleting in background"
}
2022/01/04 00:15:46 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:15:51 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:15:51 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:15:53 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:15:58 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:15:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVSwapRebalanceWithMultipleHandlers (222.07s)
=== RUN   TestKVRebStopStartKVOpsOnUpdateBucketOpOneByOne
2022/01/04 00:16:08 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:16:08 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 00:16:08 eventingSetup.go:46: No eventing-con process running
2022/01/04 00:16:08 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/04 00:16:09 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:16:14 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:16:14 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:16:16 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:16:21 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:16:21 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:16:26 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:16:26 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 00:16:27 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/04 00:16:32 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 00:16:37 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:16:42 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:16:47 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:16:47 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:16:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:16:47 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:16:47 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 00:16:48 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 00:17:08 clusterSetup.go:165: Stopping rebalance
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:17:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:17:08 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:17:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:17:18 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:17:18 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 00:17:23 Rebalance progress: 12.5
2022/01/04 00:17:28 Rebalance progress: 12.5
2022/01/04 00:17:33 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:17:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:17:33 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:17:33 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/04 00:17:34 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 00:17:39 Rebalance progress: 12.5
2022/01/04 00:17:44 Rebalance progress: 12.5
2022/01/04 00:17:49 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:17:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:17:49 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:17:49 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 00:17:54 Rebalance progress: 12.5
2022/01/04 00:17:59 Rebalance progress: 12.5
2022/01/04 00:18:04 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:18:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:18:04 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:18:09 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:18:14 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:18:19 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:18:24 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:18:29 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:18:29 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 00:18:30 eventingSetup.go:46: No eventing-con process running
2022/01/04 00:18:30 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/04 00:18:31 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:18:36 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:18:41 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9134
2022/01/04 00:18:46 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9134
2022/01/04 00:18:46 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:18:48 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:18:53 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:18:58 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 9134
2022/01/04 00:18:58 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVRebStopStartKVOpsOnUpdateBucketOpOneByOne (180.47s)
=== RUN   TestKVFailoverOnUpdateBucketOp
2022/01/04 00:19:08 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:19:08 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 00:19:08 eventingSetup.go:46: No eventing-con process running
2022/01/04 00:19:08 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 404 dump: {
 "name": "ERR_APP_NOT_FOUND_TS",
 "code": 13,
 "description": "Function: bucket_op_on_update not found"
}
2022/01/04 00:19:10 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:19:15 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:19:15 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:19:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:19:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:19:22 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:19:27 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:19:27 eventingSetup.go:125: Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 00:19:28 eventingSetup.go:102: Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/04 00:19:33 bucketOps.go:157: Starting bucket ops to source bucket
2022/01/04 00:19:38 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:19:43 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:19:48 clusterSetup.go:346: Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:19:48 clusterSetup.go:354: App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:19:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:19:48 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:19:48 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 00:19:48 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 00:19:53 Rebalance progress: 12.5
2022/01/04 00:19:58 Rebalance progress: 12.5
2022/01/04 00:20:03 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:20:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:20:03 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:20:03 clusterSetup.go:229: Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:20:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:20:13 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:20:13 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 00:20:18 Rebalance progress: 12.5
2022/01/04 00:20:23 Rebalance progress: 12.5
2022/01/04 00:20:28 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:20:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:20:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:20:28 clusterSetup.go:245: Adding node: https://127.0.0.1:19002 with role: kv to the cluster
2022/01/04 00:20:29 clusterSetup.go:253: Removing node(s): [127.0.0.1:19001] from the cluster
2022/01/04 00:20:34 Rebalance progress: 12.5
2022/01/04 00:20:39 Rebalance progress: 12.5
2022/01/04 00:20:44 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:20:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:20:44 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:20:44 clusterSetup.go:253: Removing node(s): [127.0.0.1:19002] from the cluster
2022/01/04 00:20:49 Rebalance progress: 12.5
2022/01/04 00:20:54 Rebalance progress: 12.5
2022/01/04 00:20:59 Rebalance progress: 100
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:20:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:20:59 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:21:04 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:21:09 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:21:14 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:21:19 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:21:24 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:21:24 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 00:21:24 eventingSetup.go:46: No eventing-con process running
2022/01/04 00:21:24 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/04 00:21:26 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:21:31 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:21:36 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8591
2022/01/04 00:21:36 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:21:38 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:21:43 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:21:48 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 8591
2022/01/04 00:21:48 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestKVFailoverOnUpdateBucketOp (169.81s)
=== RUN   TestBootstrapAfterKVHardFailover
2022/01/04 00:21:53 clusterSetup.go:245: Adding node: https://127.0.0.1:19001 with role: kv to the cluster
2022/01/04 00:21:53 clusterSetup.go:253: Removing node(s): [] from the cluster
2022/01/04 00:21:58 Rebalance progress: 100
2022/01/04 00:21:58 Failing over: [127.0.0.1:19001]
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:22:28 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:22:28 Deploying app: bucket_op_on_update. Item count src bucket: 0 dst bucket: 0
2022/01/04 00:22:29 Context: Post to main store, response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update stored in temp store"
}
2022/01/04 00:22:34 Removing node(s): [] from the cluster
2022/01/04 00:22:34 Starting bucket ops to source bucket
2022/01/04 00:22:40 Rebalance failed. See logs for detailed reason. You can try again.
2022/01/04 00:22:45 Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:22:50 Waiting for app: bucket_op_on_update to get deployed
2022/01/04 00:22:50 App: bucket_op_on_update got deployed
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:22:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

VB distribution across eventing nodes and their workers::

Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:22:50 waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 

DCP Stream statuses:

vbucket curr owner:


2022/01/04 00:22:55 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:23:00 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:23:05 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:23:10 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:23:15 clusterSetup.go:397: Waiting for app: bucket_op_on_update to get un-deployed
2022/01/04 00:23:15 clusterSetup.go:405: App: bucket_op_on_update got un-deployed
2022/01/04 00:23:15 eventingSetup.go:46: No eventing-con process running
2022/01/04 00:23:15 eventingSetup.go:418: Function: bucket_op_on_update delete from main store request response code: 200 dump: {
 "code": 0,
 "info": "Function: bucket_op_on_update deleting in background"
}
2022/01/04 00:23:17 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:23:22 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:23:27 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1506
2022/01/04 00:23:27 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
2022/01/04 00:23:29 eventingSetup.go:102: Context: Bucket flush, response code: 200 dump: 
Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused
2022/01/04 00:23:34 clusterSetup.go:81: waitForIndexes giving up: err Get "http://127.0.0.1:9108/getIndexStatus": dial tcp 127.0.0.1:9108: connect: connection refused response 
2022/01/04 00:23:39 eventingSetup.go:441: Waiting for dst bucket item count to get to: 0 curr count: 1506
2022/01/04 00:23:39 eventingSetup.go:436: src & dst bucket item count matched up. src bucket count: 0 dst bucket count: 0
--- PASS: TestBootstrapAfterKVHardFailover (110.94s)
PASS
ok  	github.com/couchbase/eventing/tests/functional_tests	11967.126s

Rebalance tests took 3 hours, 19 minutes and 29 seconds.

Testing Succeeded


Version: versions-03.01.2022-16.46.cfg
Build Log: make-03.01.2022-16.46.log
Server Log: logs-03.01.2022-16.46.tar.gz

Finished